Jul 29 21:01:28.158631 ip-10-0-134-66 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 29 21:01:28.158646 ip-10-0-134-66 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 29 21:01:28.158655 ip-10-0-134-66 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 29 21:01:28.158950 ip-10-0-134-66 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 29 21:01:37.465882 ip-10-0-134-66 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 29 21:01:37.465897 ip-10-0-134-66 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 36220034c2674444942361e81605dd53 --
Jul 29 21:03:26.789322 ip-10-0-134-66 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 21:03:27.158490 ip-10-0-134-66 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 21:03:27.158490 ip-10-0-134-66 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 21:03:27.158490 ip-10-0-134-66 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 21:03:27.158490 ip-10-0-134-66 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 21:03:27.158490 ip-10-0-134-66 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 21:03:27.161282 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.161197    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 21:03:27.168190 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168174    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 21:03:27.168190 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168189    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168193    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168197    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168200    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168203    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168206    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168210    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168213    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168216    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168219    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168222    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168224    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168227    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168230    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168233    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168235    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168238    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168241    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168244    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168246    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 21:03:27.168259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168249    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168252    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168254    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168257    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168260    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168262    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168265    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168268    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168271    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168274    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168276    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168279    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168281    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168285    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168288    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168290    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168293    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168297    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168300    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 21:03:27.168730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168304    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168306    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168309    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168311    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168314    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168316    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168319    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168321    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168323    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168326    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168328    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168331    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168333    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168336    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168338    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168341    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168344    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168346    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168349    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168352    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 21:03:27.169198 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168355    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168357    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168360    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168362    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168365    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168367    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168369    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168372    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168374    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168377    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168380    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168383    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168386    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168388    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168391    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168394    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168398    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168401    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168404    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168407    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 21:03:27.169695 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168410    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168413    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168415    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168418    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168420    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168423    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168425    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168429    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168431    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168434    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168437    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168440    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168443    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168445    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168449    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168452    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168455    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168458    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.168461    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 21:03:27.170221 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169170    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169177    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169180    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169183    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169186    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169189    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169192    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169195    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169198    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169201    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169204    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169207    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169209    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169213    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169217    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169220    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169222    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169224    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169227    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169230    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 21:03:27.170691 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169234    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169237    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169240    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169243    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169245    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169248    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169252    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169254    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169257    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169260    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169262    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169265    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169267    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169270    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169272    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169275    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169278    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169280    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169283    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169293    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 21:03:27.171196 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169298    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169301    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169304    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169306    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169309    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169311    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169314    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169317    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169320    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169322    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169325    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169327    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169330    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169332    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169335    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169338    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169341    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169343    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169346    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169348    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 21:03:27.171686 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169351    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169353    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169356    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169358    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169361    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169364    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169367    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169370    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169374    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169378    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169381    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169383    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169386    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169389    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169392    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169394    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169396    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169399    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169401    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169404    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 21:03:27.172200 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169406    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169409    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169411    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169413    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169416    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169419    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169423    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169426    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169429    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169432    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169434    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169437    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169439    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169442    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169444    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169447    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169450    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169452    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169455    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 21:03:27.172684 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169805    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169810    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169813    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169816    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169818    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169821    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169824    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169827    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169829    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169833    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169836    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169838    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169841    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169844    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169846    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169848    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169851    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169854    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169856    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 21:03:27.173255 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169859    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169861    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169864    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169867    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169871    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169874    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169877    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169880    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169883    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169886    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169889    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169891    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169894    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169897    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169900    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169903    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169907    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169910    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169913    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 21:03:27.173919 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169916    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169919    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169922    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169924    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169927    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169930    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169932    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169935    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169937    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169940    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169942    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169945    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169947    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169950    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169952    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169954    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169957    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169959    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169962    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169964    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 21:03:27.174453 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169967    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169969    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169972    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169974    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169977    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169979    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169982    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169985    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169987    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169990    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169992    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169995    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.169998    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170000    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170003    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170006    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170008    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170010    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170013    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 21:03:27.174975 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170015    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170018    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170021    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170024    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170029    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170031    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170034    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170036    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170038    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170041    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170043    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170046    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170048    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170051    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170068    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170071    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170074    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170077    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170080    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170082    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 21:03:27.175505 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170085    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170087    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170157    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170164    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170172    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170179    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170185    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170190    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170197    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170201    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170205    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170207    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170211    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170214    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170218    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170221    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170226    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170229    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170232    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170235    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170239    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170242    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170245    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170248    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 21:03:27.176208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170251    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170257    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170261    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170264    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170269    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170272    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170275    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170278    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170282    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170284    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170288    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170291    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170294    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170297    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170300    2575 flags.go:64] FLAG: --enable-server="true"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170303    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170308    2575 flags.go:64] FLAG: --event-burst="100"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170311    2575 flags.go:64] FLAG: --event-qps="50"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170314    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170317    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170320    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170324    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170327    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170330    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170334    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 29 21:03:27.176829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170337    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170340    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170342    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170345    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170348    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170351    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170354    2575 flags.go:64] FLAG: --feature-gates=""
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170357    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170360    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170364    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170368    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170372    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170375    2575 flags.go:64] FLAG: --help="false"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170378    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-134-66.ec2.internal"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170381    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170384    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170387    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170390    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170393    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170396    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170399    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170402    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170405    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 21:03:27.177548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170407    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170411    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170421    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170424    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170427    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170430    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170432    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170435    2575 flags.go:64] FLAG: --lock-file=""
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170439    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170442    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170445    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170451    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170454    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170456    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170459    2575 flags.go:64] FLAG: --logging-format="text"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170462    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170466    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170468    2575 flags.go:64] FLAG: --manifest-url=""
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170471    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170475    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170479    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170483    2575 flags.go:64] FLAG: --max-pods="110"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170487    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170489    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170493    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 21:03:27.178172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170496    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170499    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170501    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170504    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170524    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170530    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170535    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170538    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170541    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170546    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170555    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170558    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170561    2575 flags.go:64] FLAG: --port="10250"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170564    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170567    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a5c44b0ee67723da"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170572    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170575    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170578    2575 flags.go:64] FLAG: --register-node="true"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170581    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170585    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170588    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170590    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170593    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170597    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170600    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 21:03:27.178781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170603    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170606    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170608    2575 flags.go:64] FLAG: --runonce="false"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170613    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170616    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170619    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170622    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170625    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170628    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170631    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170634    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170637    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170640    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170643    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170645    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170648    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170651    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170654    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170665    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170668    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170671    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170675    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170680    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170683    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170685    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 21:03:27.179439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170696    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170700    2575 flags.go:64] FLAG: --v="2"
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170704    2575 flags.go:64] FLAG: --version="false"
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170708    2575 flags.go:64] FLAG: --vmodule=""
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170711    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.170715    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170859    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170862    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170865    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170868    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170872    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170875    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170878    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170881    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170884    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170888    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170891    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170894    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170897    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170900    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170902    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 21:03:27.180066 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170905    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170908    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170910    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170913    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170915    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170923    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170926    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170928    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170932    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170935    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170937    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170940    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170942    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170945    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170947    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170950    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170952    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170955    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170957    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170960    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 21:03:27.180580 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170962    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170967    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170970    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170973    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170975    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170978    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170980    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170983    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170986    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170989    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170993    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170996    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.170999    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171002    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171005    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171007    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171010    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171013    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171026    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 21:03:27.181076 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171029    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171034    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171036    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171039    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171041    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171044    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171047    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171049    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171052    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171067    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171071    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171075    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171079    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171082    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171085    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171088    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171090    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171093    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171096    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 21:03:27.181558 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171098    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171101    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171104    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171106    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171109    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171111    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171114    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171117    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171119    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171122    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171125    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171127    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171129    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171139    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171143    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171146    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171148    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171151    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171153    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171156    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 21:03:27.182022 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171158    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 21:03:27.182546 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171161    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 21:03:27.182546 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171163    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 21:03:27.182546 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171166    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 21:03:27.182546 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171168    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 21:03:27.182546 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.171171    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 21:03:27.182546 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.171750    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 21:03:27.182546 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.178793    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 21:03:27.182546 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.178809    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 21:03:27.182546 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.179538    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 21:03:27.182546 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.179545    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 21:03:27.182546 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179600    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 21:03:27.182546 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179605    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 21:03:27.182546 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179609    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 21:03:27.182546 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179612    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 21:03:27.182546 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179615    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179618    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179621    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179624    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179627    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179630    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179633    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179635    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179638    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179641    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179643    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179646    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179649    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179651    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179654    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179656    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179659    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179661    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179664    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 21:03:27.182913 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179667    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179671    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179675    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179679    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179682    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179687    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179690    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179694    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179697    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179700    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179703    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179706    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179709    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179711    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179714    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179717    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179720    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179723    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179725    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 21:03:27.183384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179728    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179730    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179733    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179736    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179738    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179741    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179743    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179746    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179748    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179751    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179753    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179756    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179758    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179761    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179764    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179767    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179771    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179774    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179777    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 21:03:27.183858 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179780    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179783    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179786    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179789    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179792    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179796    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179798    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179801    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179804    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179807    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179809    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179812    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179814    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179817    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179820    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179823    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179825    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179828    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179831    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 21:03:27.184340 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179834    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179837    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179839    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179842    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179845    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179847    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179850    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179852    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179855    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179857    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179860    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179862    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179865    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179868    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179871    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179874    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179876    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179879    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 21:03:27.184803 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.179881    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 21:03:27.185431 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.179886    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 21:03:27.185431 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180020    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 21:03:27.185431 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180026    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 21:03:27.185431 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180029    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 21:03:27.185431 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180032    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 21:03:27.185431 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180035    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 21:03:27.185431 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180038    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 21:03:27.185431 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180041    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 21:03:27.185431 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180043    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 21:03:27.185431 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180046    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 21:03:27.185431 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180048    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 21:03:27.185431 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180051    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 21:03:27.185431 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180065    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 21:03:27.185431 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180068    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 21:03:27.185431 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180071    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180074    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180077    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180080    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180082    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180085    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180087    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180090    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180092    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180095    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180097    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180100    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180103    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180106    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180109    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180111    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180114    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180117    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180119    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 21:03:27.185800 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180122    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180126    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180130    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180133    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180136    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180139    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180142    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180145    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180147    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180150    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180153    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180156    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180160    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180164    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180166    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180169    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180171    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180174    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180176    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 21:03:27.186276 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180179    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180182    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180184    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180187    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180189    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180192    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180194    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180197    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180200    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180202    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180205    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180207    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180210    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180213    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180216    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180218    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180220    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180223    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180227    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180230    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 21:03:27.186762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180232    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180235    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180238    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180240    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180243    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180245    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180248    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180252    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180254    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180257    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180260    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180262    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180265    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180267    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180270    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180272    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180275    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180277    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180280    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 21:03:27.187263 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180283    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 21:03:27.187717 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180285    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 21:03:27.187717 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180288    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 21:03:27.187717 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180290    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 21:03:27.187717 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180293    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 21:03:27.187717 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180295    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 21:03:27.187717 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180298    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 21:03:27.187717 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180301    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 21:03:27.187717 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:27.180303    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 21:03:27.187717 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.180308    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 21:03:27.187717 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.180418    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 21:03:27.187717 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.183001    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 21:03:27.187717 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.184307    2575 server.go:1019] "Starting client certificate rotation"
Jul 29 21:03:27.187717 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.184420    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 21:03:27.187717 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.184459    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 21:03:27.188113 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.186774    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 21:03:27.190663 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.190645    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 21:03:27.201294 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.201273    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 29 21:03:27.204381 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.204366    2575 log.go:25] "Validated CRI v1 image API"
Jul 29 21:03:27.205275 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.205252    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 21:03:27.209879 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.209859    2575 fs.go:135] Filesystem UUIDs: map[35f03f6e-6125-4892-b92b-c3fc76d1812f:/dev/nvme0n1p4 7066d85d-a680-4fd4-919b-b707e98ae9d8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 29 21:03:27.209952 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.209878    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 21:03:27.211646 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.211623    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 21:03:27.216955 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.216849    2575 manager.go:216] Machine: {Timestamp:2026-07-29 21:03:27.215608887 +0000 UTC m=+0.315520083 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091357 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23ee406106138e673c7a260f5cb8ba SystemUUID:ec23ee40-6106-138e-673c-7a260f5cb8ba BootID:36220034-c267-4444-9423-61e81605dd53 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:64:21:3a:f8:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:64:21:3a:f8:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:02:27:37:ae:1a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 21:03:27.216955 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.216950    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 21:03:27.217081 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.217052    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 21:03:27.219730 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.219701    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 21:03:27.219863 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.219733    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-66.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 21:03:27.220361 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.220351    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 21:03:27.220395 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.220363    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 21:03:27.220395 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.220371    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 21:03:27.221048 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.221038    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 21:03:27.221852 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.221842    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 21:03:27.224549 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.224538    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 21:03:27.224653 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.224645    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 21:03:27.224682 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.224673    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 21:03:27.224709 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.224683    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 21:03:27.224709 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.224700    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 21:03:27.224709 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.224709    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 29 21:03:27.224790 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.224718    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 21:03:27.225120 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.225109    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 21:03:27.225177 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.225127    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 21:03:27.227211 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.227196    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 21:03:27.228913 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.228900    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 21:03:27.228954 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.228930    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 21:03:27.230475 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.230463    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 21:03:27.230513 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.230489    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 21:03:27.230513 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.230499    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 21:03:27.230513 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.230509    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 21:03:27.230586 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.230522    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 21:03:27.230586 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.230531    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 21:03:27.230586 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.230549    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 21:03:27.230586 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.230560    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 21:03:27.230586 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.230569    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 21:03:27.230586 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.230575    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 21:03:27.230586 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.230583    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 21:03:27.230764 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.230589    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 21:03:27.231262 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.231253    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 21:03:27.231262 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.231261    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 21:03:27.234197 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.234184    2575 server.go:1268] "Started kubelet"
Jul 29 21:03:27.234334 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.234308    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 21:03:27.234426 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.234357    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 21:03:27.234491 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.234477    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 21:03:27.234800 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:27.234775    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 21:03:27.234800 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.234787    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-66.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 21:03:27.234906 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:27.234850    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-66.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 21:03:27.235852 ip-10-0-134-66 systemd[1]: Started Kubernetes Kubelet.
Jul 29 21:03:27.236150 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.236126    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 21:03:27.237424 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.237412    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 21:03:27.241407 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:27.241388    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 21:03:27.241538 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:27.240611    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-66.ec2.internal.18c6de8ecebc650e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-66.ec2.internal,UID:ip-10-0-134-66.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-66.ec2.internal,},FirstTimestamp:2026-07-29 21:03:27.23415579 +0000 UTC m=+0.334066986,LastTimestamp:2026-07-29 21:03:27.23415579 +0000 UTC m=+0.334066986,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-66.ec2.internal,}"
Jul 29 21:03:27.245976 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.245958    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 21:03:27.246045 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.245978    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 21:03:27.246640 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.246606    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 21:03:27.246732 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:27.246717    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-66.ec2.internal\" not found"
Jul 29 21:03:27.246846 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.246796    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 21:03:27.246910 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.246903    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 21:03:27.247168 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.247156    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 21:03:27.247259 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.247251    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 21:03:27.249785 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:27.249737    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-66.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 21:03:27.249876 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:27.249806    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 21:03:27.250332 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.250309    2575 factory.go:55] Registering systemd factory
Jul 29 21:03:27.250412 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.250334    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 29 21:03:27.251204 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.251185    2575 factory.go:153] Registering CRI-O factory
Jul 29 21:03:27.251204 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.251204    2575 factory.go:223] Registration of the crio container factory successfully
Jul 29 21:03:27.251344 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.251261    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 21:03:27.251344 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.251279    2575 factory.go:103] Registering Raw factory
Jul 29 21:03:27.251344 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.251289    2575 manager.go:1196] Started watching for new ooms in manager
Jul 29 21:03:27.251671 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.251654    2575 manager.go:349] Starting recovery of all containers
Jul 29 21:03:27.256761 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.256736    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sl5cx"
Jul 29 21:03:27.261252 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.261238    2575 manager.go:354] Recovery completed
Jul 29 21:03:27.264697 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.264683    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sl5cx"
Jul 29 21:03:27.265334 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.265323    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 21:03:27.267098 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.267082    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 21:03:27.267176 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.267109    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 21:03:27.267176 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.267120    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasSufficientPID"
Jul 29 21:03:27.267670 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.267654    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 21:03:27.267670 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.267668    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 21:03:27.267769 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.267686    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 21:03:27.267769 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.267654    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 21:03:27.268399 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.268382    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 21:03:27.268399 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.268402    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 21:03:27.268508 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.268412    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasSufficientPID"
Jul 29 21:03:27.270258 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.270244    2575 policy_none.go:49] "None policy: Start"
Jul 29 21:03:27.270258 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.270260    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 21:03:27.270355 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.270270    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 21:03:27.272234 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:27.272223    2575 policy_none.go:47] "Start"
Jul 29 21:03:28.401103 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.400970    2575 manager.go:337] "Starting Device Plugin manager"
Jul 29 21:03:28.401208 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:28.401125    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 21:03:28.401208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.401139    2575 server.go:87] "Starting device plugin registration server"
Jul 29 21:03:28.401385 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.401371    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 21:03:28.401461 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.401386    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 21:03:28.401577 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.401563    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 21:03:28.402043 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.401642    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 21:03:28.402043 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.401653    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 21:03:28.402226 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:28.402090    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 21:03:28.402226 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:28.402135    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-66.ec2.internal\" not found"
Jul 29 21:03:28.474738 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.474697    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 21:03:28.476526 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.475904    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 21:03:28.476526 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.475939    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 21:03:28.476526 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.475958    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 21:03:28.476526 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:28.475992    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 21:03:28.478292 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.478272    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 21:03:28.501938 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.501920    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 21:03:28.502699 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.502680    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 21:03:28.502782 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.502714    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 21:03:28.502782 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.502726    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasSufficientPID"
Jul 29 21:03:28.502782 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.502749    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.510895 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.510850    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.510895 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:28.510873    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-66.ec2.internal\": node \"ip-10-0-134-66.ec2.internal\" not found"
Jul 29 21:03:28.539456 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:28.539428    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-66.ec2.internal\" not found"
Jul 29 21:03:28.577015 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.576969    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-66.ec2.internal"]
Jul 29 21:03:28.577093 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.577049    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 21:03:28.577816 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.577800    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 21:03:28.577887 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.577825    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 21:03:28.577887 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.577835    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasSufficientPID"
Jul 29 21:03:28.579790 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.579778    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 21:03:28.579911 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.579897    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.579948 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.579930    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 21:03:28.580475 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.580459    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 21:03:28.580475 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.580470    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 21:03:28.580570 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.580485    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 21:03:28.580570 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.580491    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 21:03:28.580570 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.580496    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasSufficientPID"
Jul 29 21:03:28.580570 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.580502    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasSufficientPID"
Jul 29 21:03:28.582428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.582415    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.582486 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.582438    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 21:03:28.583665 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.583649    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 21:03:28.583770 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.583683    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 21:03:28.583770 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.583697    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeHasSufficientPID"
Jul 29 21:03:28.606050 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:28.606029    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-66.ec2.internal\" not found" node="ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.610396 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:28.610381    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-66.ec2.internal\" not found" node="ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.640381 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:28.640360    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-66.ec2.internal\" not found"
Jul 29 21:03:28.644742 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.644724    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd1b452a1808694511815956217406d9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal\" (UID: \"bd1b452a1808694511815956217406d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.644825 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.644752    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/396253a3efd1499c22363fbe927d2664-config\") pod \"kube-apiserver-proxy-ip-10-0-134-66.ec2.internal\" (UID: \"396253a3efd1499c22363fbe927d2664\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.644825 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.644771    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd1b452a1808694511815956217406d9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal\" (UID: \"bd1b452a1808694511815956217406d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.740707 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:28.740684    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-66.ec2.internal\" not found"
Jul 29 21:03:28.744963 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.744946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd1b452a1808694511815956217406d9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal\" (UID: \"bd1b452a1808694511815956217406d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.745008 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.744971    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd1b452a1808694511815956217406d9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal\" (UID: \"bd1b452a1808694511815956217406d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.745008 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.744987    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/396253a3efd1499c22363fbe927d2664-config\") pod \"kube-apiserver-proxy-ip-10-0-134-66.ec2.internal\" (UID: \"396253a3efd1499c22363fbe927d2664\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.745073 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.745031    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/396253a3efd1499c22363fbe927d2664-config\") pod \"kube-apiserver-proxy-ip-10-0-134-66.ec2.internal\" (UID: \"396253a3efd1499c22363fbe927d2664\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.745073 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.745039    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd1b452a1808694511815956217406d9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal\" (UID: \"bd1b452a1808694511815956217406d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.745073 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.745045    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd1b452a1808694511815956217406d9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal\" (UID: \"bd1b452a1808694511815956217406d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.841424 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:28.841363    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-66.ec2.internal\" not found"
Jul 29 21:03:28.908821 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.908790    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.913929 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:28.913665    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-66.ec2.internal"
Jul 29 21:03:28.941509 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:28.941484    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-66.ec2.internal\" not found"
Jul 29 21:03:29.041869 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:29.041835    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-66.ec2.internal\" not found"
Jul 29 21:03:29.142261 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:29.142204    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-66.ec2.internal\" not found"
Jul 29 21:03:29.242657 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:29.242627    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-66.ec2.internal\" not found"
Jul 29 21:03:29.277933 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:29.277916    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 21:03:29.278309 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:29.278058    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 21:03:29.342938 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:29.342910    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-66.ec2.internal\" not found"
Jul 29 21:03:29.364765 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:29.364735    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 20:58:28 +0000 UTC" deadline="2028-03-24 17:41:27.726867766 +0000 UTC"
Jul 29 21:03:29.364765 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:29.364759    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14492h37m58.362111407s"
Jul 29 21:03:29.443180 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:29.443125    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-66.ec2.internal\" not found"
Jul 29 21:03:29.543967 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:29.543937    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-66.ec2.internal\" not found"
Jul 29 21:03:29.617349 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:29.617306    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd1b452a1808694511815956217406d9.slice/crio-948c6c806a3b5428e9842d0f29e201d047a9b6916e92421d4de0f583aea76ba1 WatchSource:0}: Error finding container 948c6c806a3b5428e9842d0f29e201d047a9b6916e92421d4de0f583aea76ba1: Status 404 returned error can't find the container with id 948c6c806a3b5428e9842d0f29e201d047a9b6916e92421d4de0f583aea76ba1
Jul 29 21:03:29.619321 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:29.619293    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod396253a3efd1499c22363fbe927d2664.slice/crio-e53af979d35e59b60537e4fc77f3cf3661eb6185cb6e0045d036227f500216a9 WatchSource:0}: Error finding container e53af979d35e59b60537e4fc77f3cf3661eb6185cb6e0045d036227f500216a9: Status 404 returned error can't find the container with id e53af979d35e59b60537e4fc77f3cf3661eb6185cb6e0045d036227f500216a9
Jul 29 21:03:29.623187 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:29.623169    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 21:03:29.637686 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:29.637659    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 21:03:29.644295 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:29.644276    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-66.ec2.internal\" not found"
Jul 29 21:03:29.661419 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:29.661399    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 21:03:29.745278 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:29.745220    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-66.ec2.internal\" not found"
Jul 29 21:03:29.814487 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:29.814463    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 21:03:29.841747 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:29.841727    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-66.ec2.internal"
Jul 29 21:03:29.855740 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:29.855718    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 21:03:29.856588 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:29.856573    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal"
Jul 29 21:03:29.885884 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:29.885867    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 21:03:30.321104 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.321075    2575 apiserver.go:52] "Watching apiserver"
Jul 29 21:03:30.332455 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.332420    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 21:03:30.332822 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.332782    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-ttp4q","openshift-multus/multus-p9nbl","openshift-multus/network-metrics-daemon-4wwgl","openshift-network-diagnostics/network-check-target-927zg","kube-system/konnectivity-agent-4r87h","openshift-dns/node-resolver-5kmcr","openshift-image-registry/node-ca-696n2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal","openshift-network-operator/iptables-alerter-27vqp","openshift-ovn-kubernetes/ovnkube-node-xmhhp","kube-system/global-pull-secret-syncer-lhv4n","kube-system/kube-apiserver-proxy-ip-10-0-134-66.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf","openshift-cluster-node-tuning-operator/tuned-jpwfd"]
Jul 29 21:03:30.335219 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.335198    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-696n2"
Jul 29 21:03:30.337364 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.337342    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.339584 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.339563    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:30.339694 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.339636    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:03:30.340113 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.339973    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 21:03:30.340113 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.340065    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ls92z\""
Jul 29 21:03:30.340266 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.340167    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 21:03:30.340433 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.340415    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 21:03:30.341769 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.341751    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:30.341863 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.341812    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:03:30.342403 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.342381    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 21:03:30.342641 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.342624    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 21:03:30.342903 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.342886    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 21:03:30.342989 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.342911    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 21:03:30.344094 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.343874    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xd859\""
Jul 29 21:03:30.344790 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.344771    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4r87h"
Jul 29 21:03:30.347275 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.347256    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5kmcr"
Jul 29 21:03:30.347378 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.347359    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 21:03:30.347635 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.347616    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hbbm9\""
Jul 29 21:03:30.347724 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.347691    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 21:03:30.349354 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.349335    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-27vqp"
Jul 29 21:03:30.350176 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.350158    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 21:03:30.350426 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.350408    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 21:03:30.350831 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.350812    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c9k4s\""
Jul 29 21:03:30.351538 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.351515    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c9nn\" (UniqueName: \"kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn\") pod \"network-check-target-927zg\" (UID: \"38ccf67f-4ed7-41ae-b793-29fd5ff3cebc\") " pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:30.351631 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.351562    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-etc-selinux\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.351714 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.351619    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-sys-fs\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.351714 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.351662    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df3cf440-cfee-44f5-b194-82f00a6a4c44-host\") pod \"node-ca-696n2\" (UID: \"df3cf440-cfee-44f5-b194-82f00a6a4c44\") " pod="openshift-image-registry/node-ca-696n2"
Jul 29 21:03:30.351862 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.351731    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zjz9\" (UniqueName: \"kubernetes.io/projected/df3cf440-cfee-44f5-b194-82f00a6a4c44-kube-api-access-2zjz9\") pod \"node-ca-696n2\" (UID: \"df3cf440-cfee-44f5-b194-82f00a6a4c44\") " pod="openshift-image-registry/node-ca-696n2"
Jul 29 21:03:30.351862 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.351758    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs\") pod \"network-metrics-daemon-4wwgl\" (UID: \"ff9a3f79-f4da-491d-abb3-8acc9ff17877\") " pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:30.351862 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.351775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/df3cf440-cfee-44f5-b194-82f00a6a4c44-serviceca\") pod \"node-ca-696n2\" (UID: \"df3cf440-cfee-44f5-b194-82f00a6a4c44\") " pod="openshift-image-registry/node-ca-696n2"
Jul 29 21:03:30.351862 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.351797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-kubelet-dir\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.351862 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.351818    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-registration-dir\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.351862 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.351822    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 21:03:30.351862 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.351840    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8sbw\" (UniqueName: \"kubernetes.io/projected/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-kube-api-access-m8sbw\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.351862 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.351861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wtnv\" (UniqueName: \"kubernetes.io/projected/ff9a3f79-f4da-491d-abb3-8acc9ff17877-kube-api-access-5wtnv\") pod \"network-metrics-daemon-4wwgl\" (UID: \"ff9a3f79-f4da-491d-abb3-8acc9ff17877\") " pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:30.352340 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.351877    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-socket-dir\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.352340 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.351892    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-device-dir\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.352340 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.351896    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 21:03:30.352340 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.352070    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 21:03:30.352340 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.352317    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-85464\""
Jul 29 21:03:30.352625 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.352582    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.354854 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.354815    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.355923 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.355888    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 21:03:30.356006 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.355960    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 21:03:30.356102 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.356087    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 21:03:30.356509 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.356490    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 21:03:30.356583 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.356518    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 21:03:30.356583 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.356534    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s88d5\""
Jul 29 21:03:30.357382 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.357364    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.357487 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.357469    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 21:03:30.357588 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.357486    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rv76t\""
Jul 29 21:03:30.359915 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.359899    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:30.359995 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.359976    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:03:30.360539 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.360520    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 21:03:30.360650 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.360585    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 21:03:30.360865 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.360849    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 21:03:30.361130 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.361110    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 21:03:30.361199 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.361120    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5z9r9\""
Jul 29 21:03:30.362091 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.362071    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.362334 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.362319    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 21:03:30.362513 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.362492    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 21:03:30.366212 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.366056    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p2xbt\""
Jul 29 21:03:30.366212 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.366086    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 21:03:30.366403 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.366311    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 21:03:30.366738 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.366720    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 21:03:30.393593 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.393571    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-klqdv"
Jul 29 21:03:30.401080 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.401055    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-klqdv"
Jul 29 21:03:30.442786 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.442754    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 21:03:30.452495 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452461    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-var-lib-kubelet\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.452606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452506    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-registration-dir\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.452606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452538    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d-iptables-alerter-script\") pod \"iptables-alerter-27vqp\" (UID: \"fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d\") " pod="openshift-network-operator/iptables-alerter-27vqp"
Jul 29 21:03:30.452606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452564    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-slash\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.452606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452587    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-run-ovn-kubernetes\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.452764 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452609    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/091fbbf5-b287-4969-bdbf-b84d4981c4f3-kubelet-config\") pod \"global-pull-secret-syncer-lhv4n\" (UID: \"091fbbf5-b287-4969-bdbf-b84d4981c4f3\") " pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:30.452764 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452616    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-registration-dir\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.452764 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452635    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-device-dir\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.452764 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452673    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2b7b29-9225-48c9-966d-1e90a3b431a8-system-cni-dir\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.452764 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452737    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-cnibin\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.452961 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-sysctl-d\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.452961 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452790    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-var-lib-kubelet\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.452961 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452743    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-device-dir\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.452961 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27a2289f-24f7-46a6-aa54-972b9a5c8df3-env-overrides\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.452961 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-sys-fs\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.452961 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452870    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/78fa3b29-d371-437e-ab96-47269879af94-hosts-file\") pod \"node-resolver-5kmcr\" (UID: \"78fa3b29-d371-437e-ab96-47269879af94\") " pod="openshift-dns/node-resolver-5kmcr"
Jul 29 21:03:30.452961 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452893    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-run-netns\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.452961 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452931    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-sys-fs\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.452961 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.452946    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-var-lib-openvswitch\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.453309 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453007    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-etc-openvswitch\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.453309 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453032    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8dae69cf-821a-44a8-88c0-71231fa90777-agent-certs\") pod \"konnectivity-agent-4r87h\" (UID: \"8dae69cf-821a-44a8-88c0-71231fa90777\") " pod="kube-system/konnectivity-agent-4r87h"
Jul 29 21:03:30.453309 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453056    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b2b7b29-9225-48c9-966d-1e90a3b431a8-cnibin\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.453309 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453092    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-run\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.453309 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453130    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-kubelet\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.453309 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453161    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wtnv\" (UniqueName: \"kubernetes.io/projected/ff9a3f79-f4da-491d-abb3-8acc9ff17877-kube-api-access-5wtnv\") pod \"network-metrics-daemon-4wwgl\" (UID: \"ff9a3f79-f4da-491d-abb3-8acc9ff17877\") " pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:30.453309 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453184    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b2b7b29-9225-48c9-966d-1e90a3b431a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.453309 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453210    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-modprobe-d\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.453309 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453230    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0272b3fe-182e-4e24-817c-a85b0479bd70-tmp\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.453309 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27a2289f-24f7-46a6-aa54-972b9a5c8df3-ovn-node-metrics-cert\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.453309 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b2b7b29-9225-48c9-966d-1e90a3b431a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.453309 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-os-release\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453328    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-log-socket\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453350    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b2b7b29-9225-48c9-966d-1e90a3b431a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453373    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b2b7b29-9225-48c9-966d-1e90a3b431a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-run-netns\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453429    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/091fbbf5-b287-4969-bdbf-b84d4981c4f3-dbus\") pod \"global-pull-secret-syncer-lhv4n\" (UID: \"091fbbf5-b287-4969-bdbf-b84d4981c4f3\") " pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453482    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg8qx\" (UniqueName: \"kubernetes.io/projected/97bfc384-e246-4ee4-b5f7-39cbe1917d44-kube-api-access-wg8qx\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453543    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-lib-modules\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453572    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-tuned\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df3cf440-cfee-44f5-b194-82f00a6a4c44-host\") pod \"node-ca-696n2\" (UID: \"df3cf440-cfee-44f5-b194-82f00a6a4c44\") " pod="openshift-image-registry/node-ca-696n2"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zjz9\" (UniqueName: \"kubernetes.io/projected/df3cf440-cfee-44f5-b194-82f00a6a4c44-kube-api-access-2zjz9\") pod \"node-ca-696n2\" (UID: \"df3cf440-cfee-44f5-b194-82f00a6a4c44\") " pod="openshift-image-registry/node-ca-696n2"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453662    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8dae69cf-821a-44a8-88c0-71231fa90777-konnectivity-ca\") pod \"konnectivity-agent-4r87h\" (UID: \"8dae69cf-821a-44a8-88c0-71231fa90777\") " pod="kube-system/konnectivity-agent-4r87h"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453689    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df3cf440-cfee-44f5-b194-82f00a6a4c44-host\") pod \"node-ca-696n2\" (UID: \"df3cf440-cfee-44f5-b194-82f00a6a4c44\") " pod="openshift-image-registry/node-ca-696n2"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453693    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-multus-conf-dir\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453751    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-run-openvswitch\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453782    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/df3cf440-cfee-44f5-b194-82f00a6a4c44-serviceca\") pod \"node-ca-696n2\" (UID: \"df3cf440-cfee-44f5-b194-82f00a6a4c44\") " pod="openshift-image-registry/node-ca-696n2"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-kubelet-dir\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.453820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453831    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-systemd-units\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.454606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453853    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-node-log\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.454606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453874    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-cni-bin\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.454606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453899    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret\") pod \"global-pull-secret-syncer-lhv4n\" (UID: \"091fbbf5-b287-4969-bdbf-b84d4981c4f3\") " pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:30.454606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453924    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-kubelet-dir\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.454606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453924    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b2b7b29-9225-48c9-966d-1e90a3b431a8-os-release\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.454606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.453975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj7lm\" (UniqueName: \"kubernetes.io/projected/fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d-kube-api-access-kj7lm\") pod \"iptables-alerter-27vqp\" (UID: \"fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d\") " pod="openshift-network-operator/iptables-alerter-27vqp"
Jul 29 21:03:30.454606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454016    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfx98\" (UniqueName: \"kubernetes.io/projected/27a2289f-24f7-46a6-aa54-972b9a5c8df3-kube-api-access-hfx98\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.454606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454042    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-multus-cni-dir\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.454606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454063    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-run-k8s-cni-cncf-io\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.454606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454085    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-run-systemd\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.454606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454117    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-system-cni-dir\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.454606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454138    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-hostroot\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.454606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454152    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-systemd\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.454606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454177    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-sys\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.454606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454219    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78fa3b29-d371-437e-ab96-47269879af94-tmp-dir\") pod \"node-resolver-5kmcr\" (UID: \"78fa3b29-d371-437e-ab96-47269879af94\") " pod="openshift-dns/node-resolver-5kmcr"
Jul 29 21:03:30.454606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454245    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d-host-slash\") pod \"iptables-alerter-27vqp\" (UID: \"fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d\") " pod="openshift-network-operator/iptables-alerter-27vqp"
Jul 29 21:03:30.455138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454264    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.455138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454294    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8sbw\" (UniqueName: \"kubernetes.io/projected/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-kube-api-access-m8sbw\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.455138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/df3cf440-cfee-44f5-b194-82f00a6a4c44-serviceca\") pod \"node-ca-696n2\" (UID: \"df3cf440-cfee-44f5-b194-82f00a6a4c44\") " pod="openshift-image-registry/node-ca-696n2"
Jul 29 21:03:30.455138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454313    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-var-lib-cni-bin\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.455138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454330    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-run-multus-certs\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.455138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454417    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-run-ovn\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.455138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27a2289f-24f7-46a6-aa54-972b9a5c8df3-ovnkube-config\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.455138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454496    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-socket-dir\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.455138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454527    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97bfc384-e246-4ee4-b5f7-39cbe1917d44-cni-binary-copy\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.455138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454550    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97bfc384-e246-4ee4-b5f7-39cbe1917d44-multus-daemon-config\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.455138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454579    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-etc-kubernetes\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.455138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454618    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-kubernetes\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.455138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454645    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-socket-dir\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.455138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454647    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx5t2\" (UniqueName: \"kubernetes.io/projected/78fa3b29-d371-437e-ab96-47269879af94-kube-api-access-kx5t2\") pod \"node-resolver-5kmcr\" (UID: \"78fa3b29-d371-437e-ab96-47269879af94\") " pod="openshift-dns/node-resolver-5kmcr"
Jul 29 21:03:30.455138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454691    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-cni-netd\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.455138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454728    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c9nn\" (UniqueName: \"kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn\") pod \"network-check-target-927zg\" (UID: \"38ccf67f-4ed7-41ae-b793-29fd5ff3cebc\") " pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:30.455631 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-etc-selinux\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.455631 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454924    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-var-lib-cni-multus\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.455631 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454947    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4v56\" (UniqueName: \"kubernetes.io/projected/0272b3fe-182e-4e24-817c-a85b0479bd70-kube-api-access-b4v56\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.455631 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454969    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27a2289f-24f7-46a6-aa54-972b9a5c8df3-ovnkube-script-lib\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.455631 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.454988    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-sysconfig\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.455631 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.455011    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-sysctl-conf\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.455631 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.455031    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-host\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.455631 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.455036    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-etc-selinux\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.455631 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.455055    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs\") pod \"network-metrics-daemon-4wwgl\" (UID: \"ff9a3f79-f4da-491d-abb3-8acc9ff17877\") " pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:30.455631 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.455091    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56cm7\" (UniqueName: \"kubernetes.io/projected/0b2b7b29-9225-48c9-966d-1e90a3b431a8-kube-api-access-56cm7\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.455631 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.455133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-multus-socket-dir-parent\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.455631 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.455154    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 21:03:30.455631 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.455216    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs podName:ff9a3f79-f4da-491d-abb3-8acc9ff17877 nodeName:}" failed. No retries permitted until 2026-07-29 21:03:30.955195707 +0000 UTC m=+2.960719054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs") pod "network-metrics-daemon-4wwgl" (UID: "ff9a3f79-f4da-491d-abb3-8acc9ff17877") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 21:03:30.460807 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.460240    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 21:03:30.460807 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.460265    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 21:03:30.460807 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.460278    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4c9nn for pod openshift-network-diagnostics/network-check-target-927zg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 21:03:30.460807 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.460341    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn podName:38ccf67f-4ed7-41ae-b793-29fd5ff3cebc nodeName:}" failed. No retries permitted until 2026-07-29 21:03:30.960323833 +0000 UTC m=+2.965847181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4c9nn" (UniqueName: "kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn") pod "network-check-target-927zg" (UID: "38ccf67f-4ed7-41ae-b793-29fd5ff3cebc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 21:03:30.460807 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.460611    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 21:03:30.464901 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.464880    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zjz9\" (UniqueName: \"kubernetes.io/projected/df3cf440-cfee-44f5-b194-82f00a6a4c44-kube-api-access-2zjz9\") pod \"node-ca-696n2\" (UID: \"df3cf440-cfee-44f5-b194-82f00a6a4c44\") " pod="openshift-image-registry/node-ca-696n2"
Jul 29 21:03:30.465009 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.464887    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8sbw\" (UniqueName: \"kubernetes.io/projected/42e0c6e1-9ddc-4684-9c84-5289d9c6fa26-kube-api-access-m8sbw\") pod \"aws-ebs-csi-driver-node-shfpf\" (UID: \"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.465009 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.464965    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wtnv\" (UniqueName: \"kubernetes.io/projected/ff9a3f79-f4da-491d-abb3-8acc9ff17877-kube-api-access-5wtnv\") pod \"network-metrics-daemon-4wwgl\" (UID: \"ff9a3f79-f4da-491d-abb3-8acc9ff17877\") " pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:30.482105 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.482061    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal" event={"ID":"bd1b452a1808694511815956217406d9","Type":"ContainerStarted","Data":"948c6c806a3b5428e9842d0f29e201d047a9b6916e92421d4de0f583aea76ba1"}
Jul 29 21:03:30.483459 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.483422    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-66.ec2.internal" event={"ID":"396253a3efd1499c22363fbe927d2664","Type":"ContainerStarted","Data":"e53af979d35e59b60537e4fc77f3cf3661eb6185cb6e0045d036227f500216a9"}
Jul 29 21:03:30.541071 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.541044    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 21:03:30.555350 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555327    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-modprobe-d\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.555350 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555357    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0272b3fe-182e-4e24-817c-a85b0479bd70-tmp\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.555585 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555377    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27a2289f-24f7-46a6-aa54-972b9a5c8df3-ovn-node-metrics-cert\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.555585 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555397    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b2b7b29-9225-48c9-966d-1e90a3b431a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.555585 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555494    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-os-release\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.555585 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-log-socket\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.555585 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555546    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b2b7b29-9225-48c9-966d-1e90a3b431a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.555585 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555570    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-modprobe-d\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.555585 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555570    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b2b7b29-9225-48c9-966d-1e90a3b431a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.555911 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555726    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-run-netns\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.555911 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555754    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-os-release\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.555911 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555758    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/091fbbf5-b287-4969-bdbf-b84d4981c4f3-dbus\") pod \"global-pull-secret-syncer-lhv4n\" (UID: \"091fbbf5-b287-4969-bdbf-b84d4981c4f3\") " pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:30.555911 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg8qx\" (UniqueName: \"kubernetes.io/projected/97bfc384-e246-4ee4-b5f7-39cbe1917d44-kube-api-access-wg8qx\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.555911 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555830    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-lib-modules\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.555911 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555855    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-tuned\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.555911 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555881    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8dae69cf-821a-44a8-88c0-71231fa90777-konnectivity-ca\") pod \"konnectivity-agent-4r87h\" (UID: \"8dae69cf-821a-44a8-88c0-71231fa90777\") " pod="kube-system/konnectivity-agent-4r87h"
Jul 29 21:03:30.555911 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555904    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-multus-conf-dir\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555928    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-run-openvswitch\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555953    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-systemd-units\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555966    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-run-netns\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555976    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b2b7b29-9225-48c9-966d-1e90a3b431a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556018    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/091fbbf5-b287-4969-bdbf-b84d4981c4f3-dbus\") pod \"global-pull-secret-syncer-lhv4n\" (UID: \"091fbbf5-b287-4969-bdbf-b84d4981c4f3\") " pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.555978    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-node-log\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556059    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b2b7b29-9225-48c9-966d-1e90a3b431a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556076    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-lib-modules\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556060    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-cni-bin\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556089    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-cni-bin\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556109    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret\") pod \"global-pull-secret-syncer-lhv4n\" (UID: \"091fbbf5-b287-4969-bdbf-b84d4981c4f3\") " pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556125    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-multus-conf-dir\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556129    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-run-openvswitch\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556130    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b2b7b29-9225-48c9-966d-1e90a3b431a8-os-release\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556157    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-systemd-units\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556164    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj7lm\" (UniqueName: \"kubernetes.io/projected/fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d-kube-api-access-kj7lm\") pod \"iptables-alerter-27vqp\" (UID: \"fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d\") " pod="openshift-network-operator/iptables-alerter-27vqp"
Jul 29 21:03:30.556297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556185    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b2b7b29-9225-48c9-966d-1e90a3b431a8-os-release\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556191    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfx98\" (UniqueName: \"kubernetes.io/projected/27a2289f-24f7-46a6-aa54-972b9a5c8df3-kube-api-access-hfx98\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-multus-cni-dir\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556217    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-node-log\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.556225    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-run-k8s-cni-cncf-io\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556265    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-run-systemd\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-system-cni-dir\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556313    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-hostroot\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556335    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-systemd\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556346    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b2b7b29-9225-48c9-966d-1e90a3b431a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556356    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-sys\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556220    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-log-socket\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556381    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78fa3b29-d371-437e-ab96-47269879af94-tmp-dir\") pod \"node-resolver-5kmcr\" (UID: \"78fa3b29-d371-437e-ab96-47269879af94\") " pod="openshift-dns/node-resolver-5kmcr"
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556410    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-run-systemd\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556472    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-hostroot\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.556497    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret podName:091fbbf5-b287-4969-bdbf-b84d4981c4f3 nodeName:}" failed. No retries permitted until 2026-07-29 21:03:31.056484278 +0000 UTC m=+3.062007624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret") pod "global-pull-secret-syncer-lhv4n" (UID: "091fbbf5-b287-4969-bdbf-b84d4981c4f3") : object "kube-system"/"original-pull-secret" not registered
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556552    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-system-cni-dir\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.557131 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556580    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-systemd\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556624    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-multus-cni-dir\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556652    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d-host-slash\") pod \"iptables-alerter-27vqp\" (UID: \"fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d\") " pod="openshift-network-operator/iptables-alerter-27vqp"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556662    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-sys\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556684    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556700    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-run-k8s-cni-cncf-io\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556712    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8dae69cf-821a-44a8-88c0-71231fa90777-konnectivity-ca\") pod \"konnectivity-agent-4r87h\" (UID: \"8dae69cf-821a-44a8-88c0-71231fa90777\") " pod="kube-system/konnectivity-agent-4r87h"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556738    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d-host-slash\") pod \"iptables-alerter-27vqp\" (UID: \"fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d\") " pod="openshift-network-operator/iptables-alerter-27vqp"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556716    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-var-lib-cni-bin\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556757    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-var-lib-cni-bin\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556757    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556784    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-run-multus-certs\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556812    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-run-ovn\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556844    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27a2289f-24f7-46a6-aa54-972b9a5c8df3-ovnkube-config\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556871    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97bfc384-e246-4ee4-b5f7-39cbe1917d44-cni-binary-copy\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556897    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78fa3b29-d371-437e-ab96-47269879af94-tmp-dir\") pod \"node-resolver-5kmcr\" (UID: \"78fa3b29-d371-437e-ab96-47269879af94\") " pod="openshift-dns/node-resolver-5kmcr"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556911    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97bfc384-e246-4ee4-b5f7-39cbe1917d44-multus-daemon-config\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556936    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-etc-kubernetes\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.558052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556869    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-run-multus-certs\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556960    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-kubernetes\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556984    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx5t2\" (UniqueName: \"kubernetes.io/projected/78fa3b29-d371-437e-ab96-47269879af94-kube-api-access-kx5t2\") pod \"node-resolver-5kmcr\" (UID: \"78fa3b29-d371-437e-ab96-47269879af94\") " pod="openshift-dns/node-resolver-5kmcr"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.556992    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-run-ovn\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-cni-netd\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557040    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-etc-kubernetes\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557043    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-var-lib-cni-multus\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557079    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-var-lib-cni-multus\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-kubernetes\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557440    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27a2289f-24f7-46a6-aa54-972b9a5c8df3-ovnkube-config\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4v56\" (UniqueName: \"kubernetes.io/projected/0272b3fe-182e-4e24-817c-a85b0479bd70-kube-api-access-b4v56\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27a2289f-24f7-46a6-aa54-972b9a5c8df3-ovnkube-script-lib\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557559    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-sysconfig\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557573    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97bfc384-e246-4ee4-b5f7-39cbe1917d44-multus-daemon-config\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-sysctl-conf\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557605    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-host\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56cm7\" (UniqueName: \"kubernetes.io/projected/0b2b7b29-9225-48c9-966d-1e90a3b431a8-kube-api-access-56cm7\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557650    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-sysconfig\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.558838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557528    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-cni-netd\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557792    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-sysctl-conf\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.557841    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-host\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558002    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97bfc384-e246-4ee4-b5f7-39cbe1917d44-cni-binary-copy\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558036    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27a2289f-24f7-46a6-aa54-972b9a5c8df3-ovnkube-script-lib\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558187    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-multus-socket-dir-parent\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558229    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-var-lib-kubelet\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d-iptables-alerter-script\") pod \"iptables-alerter-27vqp\" (UID: \"fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d\") " pod="openshift-network-operator/iptables-alerter-27vqp"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558284    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-slash\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558307    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-run-ovn-kubernetes\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558316    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-multus-socket-dir-parent\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558340    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/091fbbf5-b287-4969-bdbf-b84d4981c4f3-kubelet-config\") pod \"global-pull-secret-syncer-lhv4n\" (UID: \"091fbbf5-b287-4969-bdbf-b84d4981c4f3\") " pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2b7b29-9225-48c9-966d-1e90a3b431a8-system-cni-dir\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-cnibin\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-sysctl-d\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558472    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-run-ovn-kubernetes\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558509    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-var-lib-kubelet\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.559643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558536    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27a2289f-24f7-46a6-aa54-972b9a5c8df3-env-overrides\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558542    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-sysctl-d\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/78fa3b29-d371-437e-ab96-47269879af94-hosts-file\") pod \"node-resolver-5kmcr\" (UID: \"78fa3b29-d371-437e-ab96-47269879af94\") " pod="openshift-dns/node-resolver-5kmcr"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-run-netns\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558600    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/091fbbf5-b287-4969-bdbf-b84d4981c4f3-kubelet-config\") pod \"global-pull-secret-syncer-lhv4n\" (UID: \"091fbbf5-b287-4969-bdbf-b84d4981c4f3\") " pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-var-lib-openvswitch\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-etc-openvswitch\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558668    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8dae69cf-821a-44a8-88c0-71231fa90777-agent-certs\") pod \"konnectivity-agent-4r87h\" (UID: \"8dae69cf-821a-44a8-88c0-71231fa90777\") " pod="kube-system/konnectivity-agent-4r87h"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558686    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-cnibin\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558693    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b2b7b29-9225-48c9-966d-1e90a3b431a8-cnibin\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558716    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-run\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558732    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/78fa3b29-d371-437e-ab96-47269879af94-hosts-file\") pod \"node-resolver-5kmcr\" (UID: \"78fa3b29-d371-437e-ab96-47269879af94\") " pod="openshift-dns/node-resolver-5kmcr"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558739    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-kubelet\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558644    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2b7b29-9225-48c9-966d-1e90a3b431a8-system-cni-dir\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558766    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b2b7b29-9225-48c9-966d-1e90a3b431a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558774    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97bfc384-e246-4ee4-b5f7-39cbe1917d44-host-var-lib-kubelet\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558822    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-run-netns\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558834    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-slash\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.560194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558834    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-var-lib-kubelet\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.560947 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558864    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-var-lib-openvswitch\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.560947 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558913    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0272b3fe-182e-4e24-817c-a85b0479bd70-run\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.560947 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558912    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b2b7b29-9225-48c9-966d-1e90a3b431a8-cnibin\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.560947 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.558965    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-host-kubelet\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.560947 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.559007    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b2b7b29-9225-48c9-966d-1e90a3b431a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.560947 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.559051    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27a2289f-24f7-46a6-aa54-972b9a5c8df3-etc-openvswitch\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.560947 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.559337    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27a2289f-24f7-46a6-aa54-972b9a5c8df3-env-overrides\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.560947 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.559416    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d-iptables-alerter-script\") pod \"iptables-alerter-27vqp\" (UID: \"fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d\") " pod="openshift-network-operator/iptables-alerter-27vqp"
Jul 29 21:03:30.560947 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.560328    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0272b3fe-182e-4e24-817c-a85b0479bd70-etc-tuned\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.560947 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.560468    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0272b3fe-182e-4e24-817c-a85b0479bd70-tmp\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.560947 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.560721    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27a2289f-24f7-46a6-aa54-972b9a5c8df3-ovn-node-metrics-cert\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.561623 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.561601    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8dae69cf-821a-44a8-88c0-71231fa90777-agent-certs\") pod \"konnectivity-agent-4r87h\" (UID: \"8dae69cf-821a-44a8-88c0-71231fa90777\") " pod="kube-system/konnectivity-agent-4r87h"
Jul 29 21:03:30.565704 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.565662    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj7lm\" (UniqueName: \"kubernetes.io/projected/fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d-kube-api-access-kj7lm\") pod \"iptables-alerter-27vqp\" (UID: \"fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d\") " pod="openshift-network-operator/iptables-alerter-27vqp"
Jul 29 21:03:30.566886 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.566059    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx5t2\" (UniqueName: \"kubernetes.io/projected/78fa3b29-d371-437e-ab96-47269879af94-kube-api-access-kx5t2\") pod \"node-resolver-5kmcr\" (UID: \"78fa3b29-d371-437e-ab96-47269879af94\") " pod="openshift-dns/node-resolver-5kmcr"
Jul 29 21:03:30.566886 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.566729    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4v56\" (UniqueName: \"kubernetes.io/projected/0272b3fe-182e-4e24-817c-a85b0479bd70-kube-api-access-b4v56\") pod \"tuned-jpwfd\" (UID: \"0272b3fe-182e-4e24-817c-a85b0479bd70\") " pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.567365 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.567341    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg8qx\" (UniqueName: \"kubernetes.io/projected/97bfc384-e246-4ee4-b5f7-39cbe1917d44-kube-api-access-wg8qx\") pod \"multus-p9nbl\" (UID: \"97bfc384-e246-4ee4-b5f7-39cbe1917d44\") " pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.567818 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.567798    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfx98\" (UniqueName: \"kubernetes.io/projected/27a2289f-24f7-46a6-aa54-972b9a5c8df3-kube-api-access-hfx98\") pod \"ovnkube-node-xmhhp\" (UID: \"27a2289f-24f7-46a6-aa54-972b9a5c8df3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.568212 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.568196    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56cm7\" (UniqueName: \"kubernetes.io/projected/0b2b7b29-9225-48c9-966d-1e90a3b431a8-kube-api-access-56cm7\") pod \"multus-additional-cni-plugins-ttp4q\" (UID: \"0b2b7b29-9225-48c9-966d-1e90a3b431a8\") " pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.648351 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.648282    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-696n2"
Jul 29 21:03:30.655321 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.655300    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf"
Jul 29 21:03:30.660510 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:30.660484    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf3cf440_cfee_44f5_b194_82f00a6a4c44.slice/crio-f2e40ef81bd3e59225ca6be33080c45bffb20ad903c27520c393c3dc69131717 WatchSource:0}: Error finding container f2e40ef81bd3e59225ca6be33080c45bffb20ad903c27520c393c3dc69131717: Status 404 returned error can't find the container with id f2e40ef81bd3e59225ca6be33080c45bffb20ad903c27520c393c3dc69131717
Jul 29 21:03:30.664650 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.664628    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4r87h"
Jul 29 21:03:30.665769 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:30.665745    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e0c6e1_9ddc_4684_9c84_5289d9c6fa26.slice/crio-ea00eea37ccc83aeb85b84a12343dffbd74a4d89e7ce597902f834644bbb49b2 WatchSource:0}: Error finding container ea00eea37ccc83aeb85b84a12343dffbd74a4d89e7ce597902f834644bbb49b2: Status 404 returned error can't find the container with id ea00eea37ccc83aeb85b84a12343dffbd74a4d89e7ce597902f834644bbb49b2
Jul 29 21:03:30.671835 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.671818    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5kmcr"
Jul 29 21:03:30.675259 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:30.675224    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dae69cf_821a_44a8_88c0_71231fa90777.slice/crio-9ec523ec5d84f98ced1cbabb5eff54d9d16cecaf4f37065a38154b947b833f7e WatchSource:0}: Error finding container 9ec523ec5d84f98ced1cbabb5eff54d9d16cecaf4f37065a38154b947b833f7e: Status 404 returned error can't find the container with id 9ec523ec5d84f98ced1cbabb5eff54d9d16cecaf4f37065a38154b947b833f7e
Jul 29 21:03:30.681058 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.681033    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-27vqp"
Jul 29 21:03:30.681544 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:30.681503    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78fa3b29_d371_437e_ab96_47269879af94.slice/crio-08d06a1e637b6a8527cf02088a1f132dfb72895c765793b476189a54dc6d5806 WatchSource:0}: Error finding container 08d06a1e637b6a8527cf02088a1f132dfb72895c765793b476189a54dc6d5806: Status 404 returned error can't find the container with id 08d06a1e637b6a8527cf02088a1f132dfb72895c765793b476189a54dc6d5806
Jul 29 21:03:30.690205 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.690183    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ttp4q"
Jul 29 21:03:30.696436 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.696416    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p9nbl"
Jul 29 21:03:30.705826 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.705804    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:30.712432 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.712398    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jpwfd"
Jul 29 21:03:30.961207 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.961116    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c9nn\" (UniqueName: \"kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn\") pod \"network-check-target-927zg\" (UID: \"38ccf67f-4ed7-41ae-b793-29fd5ff3cebc\") " pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:30.961207 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:30.961164    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs\") pod \"network-metrics-daemon-4wwgl\" (UID: \"ff9a3f79-f4da-491d-abb3-8acc9ff17877\") " pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:30.961423 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.961279    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 21:03:30.961423 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.961308    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 21:03:30.961423 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.961334    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 21:03:30.961423 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.961340    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs podName:ff9a3f79-f4da-491d-abb3-8acc9ff17877 nodeName:}" failed. No retries permitted until 2026-07-29 21:03:31.961320974 +0000 UTC m=+3.966844340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs") pod "network-metrics-daemon-4wwgl" (UID: "ff9a3f79-f4da-491d-abb3-8acc9ff17877") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 21:03:30.961423 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.961348    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4c9nn for pod openshift-network-diagnostics/network-check-target-927zg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 21:03:30.961423 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:30.961399    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn podName:38ccf67f-4ed7-41ae-b793-29fd5ff3cebc nodeName:}" failed. No retries permitted until 2026-07-29 21:03:31.961383067 +0000 UTC m=+3.966906416 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4c9nn" (UniqueName: "kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn") pod "network-check-target-927zg" (UID: "38ccf67f-4ed7-41ae-b793-29fd5ff3cebc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 21:03:31.061833 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.061791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret\") pod \"global-pull-secret-syncer-lhv4n\" (UID: \"091fbbf5-b287-4969-bdbf-b84d4981c4f3\") " pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:31.062001 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:31.061966    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 21:03:31.062068 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:31.062046    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret podName:091fbbf5-b287-4969-bdbf-b84d4981c4f3 nodeName:}" failed. No retries permitted until 2026-07-29 21:03:32.062027708 +0000 UTC m=+4.067551054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret") pod "global-pull-secret-syncer-lhv4n" (UID: "091fbbf5-b287-4969-bdbf-b84d4981c4f3") : object "kube-system"/"original-pull-secret" not registered
Jul 29 21:03:31.321094 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:31.321027    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc4ca3d5_ad8a_49b2_9bfa_bea2936d463d.slice/crio-159b1f9538e781c065cc2a8e4a82eb08441c23b151ebcc61fc1f08d3e9032993 WatchSource:0}: Error finding container 159b1f9538e781c065cc2a8e4a82eb08441c23b151ebcc61fc1f08d3e9032993: Status 404 returned error can't find the container with id 159b1f9538e781c065cc2a8e4a82eb08441c23b151ebcc61fc1f08d3e9032993
Jul 29 21:03:31.332113 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:31.332090    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a2289f_24f7_46a6_aa54_972b9a5c8df3.slice/crio-24c852a937a0181d17387612362fe2a47b2ffe744a493069a25052b2375ee13b WatchSource:0}: Error finding container 24c852a937a0181d17387612362fe2a47b2ffe744a493069a25052b2375ee13b: Status 404 returned error can't find the container with id 24c852a937a0181d17387612362fe2a47b2ffe744a493069a25052b2375ee13b
Jul 29 21:03:31.333707 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:31.333604    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0272b3fe_182e_4e24_817c_a85b0479bd70.slice/crio-e7f9d5e2fa80563b8f6dfa8f912f43c91b414ebcbd7b910f4d386174ed977602 WatchSource:0}: Error finding container e7f9d5e2fa80563b8f6dfa8f912f43c91b414ebcbd7b910f4d386174ed977602: Status 404 returned error can't find the container with id e7f9d5e2fa80563b8f6dfa8f912f43c91b414ebcbd7b910f4d386174ed977602
Jul 29 21:03:31.335346 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:31.335323    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2b7b29_9225_48c9_966d_1e90a3b431a8.slice/crio-d33cc71fb6e8307dc382aa9f0401d2a99d39e1a48e8daebb6ca4fb1af4d368b3 WatchSource:0}: Error finding container d33cc71fb6e8307dc382aa9f0401d2a99d39e1a48e8daebb6ca4fb1af4d368b3: Status 404 returned error can't find the container with id d33cc71fb6e8307dc382aa9f0401d2a99d39e1a48e8daebb6ca4fb1af4d368b3
Jul 29 21:03:31.337065 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:03:31.337040    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97bfc384_e246_4ee4_b5f7_39cbe1917d44.slice/crio-1f781687863f0b2eb781042d7d390dbcb0b4a5bbc25608e155ee21b7eff129d4 WatchSource:0}: Error finding container 1f781687863f0b2eb781042d7d390dbcb0b4a5bbc25608e155ee21b7eff129d4: Status 404 returned error can't find the container with id 1f781687863f0b2eb781042d7d390dbcb0b4a5bbc25608e155ee21b7eff129d4
Jul 29 21:03:31.404599 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.404553    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 20:58:30 +0000 UTC" deadline="2028-04-29 02:43:13.283700904 +0000 UTC"
Jul 29 21:03:31.404599 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.404595    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15341h39m41.879108523s"
Jul 29 21:03:31.476778 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.476756    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:31.476902 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:31.476860    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:03:31.487311 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.487240    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttp4q" event={"ID":"0b2b7b29-9225-48c9-966d-1e90a3b431a8","Type":"ContainerStarted","Data":"d33cc71fb6e8307dc382aa9f0401d2a99d39e1a48e8daebb6ca4fb1af4d368b3"}
Jul 29 21:03:31.488816 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.488788    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp" event={"ID":"27a2289f-24f7-46a6-aa54-972b9a5c8df3","Type":"ContainerStarted","Data":"24c852a937a0181d17387612362fe2a47b2ffe744a493069a25052b2375ee13b"}
Jul 29 21:03:31.490054 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.490006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5kmcr" event={"ID":"78fa3b29-d371-437e-ab96-47269879af94","Type":"ContainerStarted","Data":"08d06a1e637b6a8527cf02088a1f132dfb72895c765793b476189a54dc6d5806"}
Jul 29 21:03:31.491295 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.491264    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4r87h" event={"ID":"8dae69cf-821a-44a8-88c0-71231fa90777","Type":"ContainerStarted","Data":"9ec523ec5d84f98ced1cbabb5eff54d9d16cecaf4f37065a38154b947b833f7e"}
Jul 29 21:03:31.492765 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.492730    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p9nbl" event={"ID":"97bfc384-e246-4ee4-b5f7-39cbe1917d44","Type":"ContainerStarted","Data":"1f781687863f0b2eb781042d7d390dbcb0b4a5bbc25608e155ee21b7eff129d4"}
Jul 29 21:03:31.494247 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.494172    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jpwfd" event={"ID":"0272b3fe-182e-4e24-817c-a85b0479bd70","Type":"ContainerStarted","Data":"e7f9d5e2fa80563b8f6dfa8f912f43c91b414ebcbd7b910f4d386174ed977602"}
Jul 29 21:03:31.495418 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.495397    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-27vqp" event={"ID":"fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d","Type":"ContainerStarted","Data":"159b1f9538e781c065cc2a8e4a82eb08441c23b151ebcc61fc1f08d3e9032993"}
Jul 29 21:03:31.496838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.496814    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf" event={"ID":"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26","Type":"ContainerStarted","Data":"ea00eea37ccc83aeb85b84a12343dffbd74a4d89e7ce597902f834644bbb49b2"}
Jul 29 21:03:31.498029 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.497998    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-696n2" event={"ID":"df3cf440-cfee-44f5-b194-82f00a6a4c44","Type":"ContainerStarted","Data":"f2e40ef81bd3e59225ca6be33080c45bffb20ad903c27520c393c3dc69131717"}
Jul 29 21:03:31.500261 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.500235    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-66.ec2.internal" event={"ID":"396253a3efd1499c22363fbe927d2664","Type":"ContainerStarted","Data":"b062a4ebd110f50107280c9c3aee152d411d52d83b0d874e46e596bc0e2d7de3"}
Jul 29 21:03:31.516530 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.515847    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-66.ec2.internal" podStartSLOduration=2.515828452 podStartE2EDuration="2.515828452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 21:03:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:03:31.515610171 +0000 UTC m=+3.521133542" watchObservedRunningTime="2026-07-29 21:03:31.515828452 +0000 UTC m=+3.521351821"
Jul 29 21:03:31.970433 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.970396    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c9nn\" (UniqueName: \"kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn\") pod \"network-check-target-927zg\" (UID: \"38ccf67f-4ed7-41ae-b793-29fd5ff3cebc\") " pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:31.970635 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:31.970464    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs\") pod \"network-metrics-daemon-4wwgl\" (UID: \"ff9a3f79-f4da-491d-abb3-8acc9ff17877\") " pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:31.970635 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:31.970592    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 21:03:31.970635 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:31.970620    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 21:03:31.970635 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:31.970626    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 21:03:31.970635 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:31.970635    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4c9nn for pod openshift-network-diagnostics/network-check-target-927zg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 21:03:31.970905 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:31.970700    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs podName:ff9a3f79-f4da-491d-abb3-8acc9ff17877 nodeName:}" failed. No retries permitted until 2026-07-29 21:03:33.97066854 +0000 UTC m=+5.976191900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs") pod "network-metrics-daemon-4wwgl" (UID: "ff9a3f79-f4da-491d-abb3-8acc9ff17877") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 21:03:31.970905 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:31.970721    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn podName:38ccf67f-4ed7-41ae-b793-29fd5ff3cebc nodeName:}" failed. No retries permitted until 2026-07-29 21:03:33.970710666 +0000 UTC m=+5.976234019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4c9nn" (UniqueName: "kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn") pod "network-check-target-927zg" (UID: "38ccf67f-4ed7-41ae-b793-29fd5ff3cebc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 21:03:32.072103 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:32.071495    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret\") pod \"global-pull-secret-syncer-lhv4n\" (UID: \"091fbbf5-b287-4969-bdbf-b84d4981c4f3\") " pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:32.072103 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:32.071701    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 21:03:32.072103 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:32.071765    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret podName:091fbbf5-b287-4969-bdbf-b84d4981c4f3 nodeName:}" failed. No retries permitted until 2026-07-29 21:03:34.071746973 +0000 UTC m=+6.077270323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret") pod "global-pull-secret-syncer-lhv4n" (UID: "091fbbf5-b287-4969-bdbf-b84d4981c4f3") : object "kube-system"/"original-pull-secret" not registered
Jul 29 21:03:32.405121 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:32.405016    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 20:58:30 +0000 UTC" deadline="2028-04-25 12:08:29.590529194 +0000 UTC"
Jul 29 21:03:32.405121 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:32.405048    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15255h4m57.185484506s"
Jul 29 21:03:32.479566 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:32.479315    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:32.479718 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:32.479656    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:03:32.480057 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:32.480036    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:32.480167 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:32.480147    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:03:33.476801 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:33.476765    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:33.477264 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:33.476885    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:03:33.987068 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:33.987032    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c9nn\" (UniqueName: \"kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn\") pod \"network-check-target-927zg\" (UID: \"38ccf67f-4ed7-41ae-b793-29fd5ff3cebc\") " pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:33.987250 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:33.987082    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs\") pod \"network-metrics-daemon-4wwgl\" (UID: \"ff9a3f79-f4da-491d-abb3-8acc9ff17877\") " pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:33.987250 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:33.987206    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 21:03:33.987373 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:33.987308    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs podName:ff9a3f79-f4da-491d-abb3-8acc9ff17877 nodeName:}" failed. No retries permitted until 2026-07-29 21:03:37.987243719 +0000 UTC m=+9.992767079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs") pod "network-metrics-daemon-4wwgl" (UID: "ff9a3f79-f4da-491d-abb3-8acc9ff17877") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 21:03:33.987579 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:33.987439    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 21:03:33.987579 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:33.987480    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 21:03:33.987579 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:33.987493    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4c9nn for pod openshift-network-diagnostics/network-check-target-927zg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 21:03:33.987579 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:33.987543    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn podName:38ccf67f-4ed7-41ae-b793-29fd5ff3cebc nodeName:}" failed. No retries permitted until 2026-07-29 21:03:37.98752777 +0000 UTC m=+9.993051129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4c9nn" (UniqueName: "kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn") pod "network-check-target-927zg" (UID: "38ccf67f-4ed7-41ae-b793-29fd5ff3cebc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 21:03:34.088878 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:34.088256    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret\") pod \"global-pull-secret-syncer-lhv4n\" (UID: \"091fbbf5-b287-4969-bdbf-b84d4981c4f3\") " pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:34.088878 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:34.088492    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 21:03:34.088878 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:34.088550    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret podName:091fbbf5-b287-4969-bdbf-b84d4981c4f3 nodeName:}" failed. No retries permitted until 2026-07-29 21:03:38.0885329 +0000 UTC m=+10.094056263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret") pod "global-pull-secret-syncer-lhv4n" (UID: "091fbbf5-b287-4969-bdbf-b84d4981c4f3") : object "kube-system"/"original-pull-secret" not registered
Jul 29 21:03:34.477070 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:34.477031    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:34.477776 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:34.477176    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:03:34.477776 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:34.477682    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:34.477891 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:34.477787    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:03:35.482485 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:35.482431    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:35.482976 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:35.482577    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:03:36.480427 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:36.480228    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:36.480427 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:36.480361    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:03:36.480427 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:36.480422    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:36.480714 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:36.480536    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:03:37.477282 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:37.477133    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:37.477282 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:37.477270    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:03:38.023108 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:38.022226    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c9nn\" (UniqueName: \"kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn\") pod \"network-check-target-927zg\" (UID: \"38ccf67f-4ed7-41ae-b793-29fd5ff3cebc\") " pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:38.023108 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:38.022282    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs\") pod \"network-metrics-daemon-4wwgl\" (UID: \"ff9a3f79-f4da-491d-abb3-8acc9ff17877\") " pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:38.023108 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:38.022440    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 21:03:38.023108 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:38.022515    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs podName:ff9a3f79-f4da-491d-abb3-8acc9ff17877 nodeName:}" failed. No retries permitted until 2026-07-29 21:03:46.022496655 +0000 UTC m=+18.028020018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs") pod "network-metrics-daemon-4wwgl" (UID: "ff9a3f79-f4da-491d-abb3-8acc9ff17877") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 21:03:38.023108 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:38.022991    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 21:03:38.023108 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:38.023012    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 21:03:38.023108 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:38.023025    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4c9nn for pod openshift-network-diagnostics/network-check-target-927zg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 21:03:38.023108 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:38.023075    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn podName:38ccf67f-4ed7-41ae-b793-29fd5ff3cebc nodeName:}" failed. No retries permitted until 2026-07-29 21:03:46.023058057 +0000 UTC m=+18.028581426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4c9nn" (UniqueName: "kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn") pod "network-check-target-927zg" (UID: "38ccf67f-4ed7-41ae-b793-29fd5ff3cebc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 21:03:38.123229 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:38.123171    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret\") pod \"global-pull-secret-syncer-lhv4n\" (UID: \"091fbbf5-b287-4969-bdbf-b84d4981c4f3\") " pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:38.126428 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:38.123805    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 21:03:38.126428 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:38.123891    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret podName:091fbbf5-b287-4969-bdbf-b84d4981c4f3 nodeName:}" failed. No retries permitted until 2026-07-29 21:03:46.123861535 +0000 UTC m=+18.129384884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret") pod "global-pull-secret-syncer-lhv4n" (UID: "091fbbf5-b287-4969-bdbf-b84d4981c4f3") : object "kube-system"/"original-pull-secret" not registered
Jul 29 21:03:38.477475 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:38.477282    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:38.477475 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:38.477406    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:03:38.477475 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:38.477470    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:38.478023 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:38.477552    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:03:39.476779 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:39.476453    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:39.476779 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:39.476588    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:03:40.480421 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:40.480371    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:40.480887 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:40.480371    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:40.480887 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:40.480522    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:03:40.480887 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:40.480599    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:03:41.476342 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:41.476310    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:41.476529 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:41.476429    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:03:42.476854 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:42.476822    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:42.477281 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:42.476824    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:42.477281 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:42.476934    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:03:42.477281 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:42.477006    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:03:43.476671 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:43.476644    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:43.476843 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:43.476750    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:03:44.476742 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:44.476707    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:44.477204 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:44.476707    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:44.477204 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:44.476845    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:03:44.477204 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:44.476902    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:03:45.477108 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:45.477076    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:45.477537 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:45.477177    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:03:46.087004 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:46.086960    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs\") pod \"network-metrics-daemon-4wwgl\" (UID: \"ff9a3f79-f4da-491d-abb3-8acc9ff17877\") " pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:46.087187 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:46.087099    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c9nn\" (UniqueName: \"kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn\") pod \"network-check-target-927zg\" (UID: \"38ccf67f-4ed7-41ae-b793-29fd5ff3cebc\") " pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:46.087187 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:46.087135    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 21:03:46.087279 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:46.087210    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs podName:ff9a3f79-f4da-491d-abb3-8acc9ff17877 nodeName:}" failed. No retries permitted until 2026-07-29 21:04:02.087188695 +0000 UTC m=+34.092712047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs") pod "network-metrics-daemon-4wwgl" (UID: "ff9a3f79-f4da-491d-abb3-8acc9ff17877") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 21:03:46.087279 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:46.087224    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 21:03:46.087279 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:46.087243    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 21:03:46.087279 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:46.087255    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4c9nn for pod openshift-network-diagnostics/network-check-target-927zg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 21:03:46.087469 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:46.087304    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn podName:38ccf67f-4ed7-41ae-b793-29fd5ff3cebc nodeName:}" failed. No retries permitted until 2026-07-29 21:04:02.087289421 +0000 UTC m=+34.092812767 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4c9nn" (UniqueName: "kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn") pod "network-check-target-927zg" (UID: "38ccf67f-4ed7-41ae-b793-29fd5ff3cebc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 21:03:46.188181 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:46.188133    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret\") pod \"global-pull-secret-syncer-lhv4n\" (UID: \"091fbbf5-b287-4969-bdbf-b84d4981c4f3\") " pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:46.188360 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:46.188289    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 21:03:46.188421 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:46.188359    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret podName:091fbbf5-b287-4969-bdbf-b84d4981c4f3 nodeName:}" failed. No retries permitted until 2026-07-29 21:04:02.18833991 +0000 UTC m=+34.193863258 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret") pod "global-pull-secret-syncer-lhv4n" (UID: "091fbbf5-b287-4969-bdbf-b84d4981c4f3") : object "kube-system"/"original-pull-secret" not registered
Jul 29 21:03:46.477125 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:46.477030    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:46.477125 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:46.477074    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:46.477657 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:46.477167    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:03:46.477657 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:46.477288    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:03:47.476878 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:47.476845    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:47.477051 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:47.476958    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:03:48.477363 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:48.477300    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:48.477821 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:48.477409    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:03:48.477821 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:48.477469    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:48.477821 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:48.477580    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:03:49.476701 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:49.476673    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:49.476835 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:49.476770    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:03:50.476981 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.476798    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:50.477613 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.476890    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:50.477613 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:50.477064    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:03:50.477613 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:50.477179    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:03:50.541493 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.541461    2575 generic.go:356] "Generic (PLEG): container finished" podID="bd1b452a1808694511815956217406d9" containerID="f955b3bb78d33994136a2e8bb519aedca9086c8f3ede552cdc7f7bb0c09726f0" exitCode=0
Jul 29 21:03:50.541654 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.541543    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal" event={"ID":"bd1b452a1808694511815956217406d9","Type":"ContainerDied","Data":"f955b3bb78d33994136a2e8bb519aedca9086c8f3ede552cdc7f7bb0c09726f0"}
Jul 29 21:03:50.543323 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.543299    2575 generic.go:356] "Generic (PLEG): container finished" podID="0b2b7b29-9225-48c9-966d-1e90a3b431a8" containerID="1e49a4d36161ae9cfcd8193d8e749919ebcee2f1767d25846f5c927b4253af62" exitCode=0
Jul 29 21:03:50.543441 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.543382    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttp4q" event={"ID":"0b2b7b29-9225-48c9-966d-1e90a3b431a8","Type":"ContainerDied","Data":"1e49a4d36161ae9cfcd8193d8e749919ebcee2f1767d25846f5c927b4253af62"}
Jul 29 21:03:50.546808 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.546781    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp" event={"ID":"27a2289f-24f7-46a6-aa54-972b9a5c8df3","Type":"ContainerStarted","Data":"704a1d5a2d8b3da98aaf996c61c9a6db3857172c7ffaa575c55665ec0f650cc0"}
Jul 29 21:03:50.546925 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.546858    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp" event={"ID":"27a2289f-24f7-46a6-aa54-972b9a5c8df3","Type":"ContainerStarted","Data":"b07ea7156be2ad2bd7c6b721bec4d808995ed264c7ecaf8745a2adccc67aa9b9"}
Jul 29 21:03:50.546925 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.546910    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp" event={"ID":"27a2289f-24f7-46a6-aa54-972b9a5c8df3","Type":"ContainerStarted","Data":"e6ec1bc4cda8f84893cd3bcaec4d9a5f277714813610daac6a534eb692bab2f5"}
Jul 29 21:03:50.547030 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.546957    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp" event={"ID":"27a2289f-24f7-46a6-aa54-972b9a5c8df3","Type":"ContainerStarted","Data":"883ec3bd34c32b1a8d395e2de5a7944bcd4cb0a08f0f8185acbff41bfbe299d3"}
Jul 29 21:03:50.547030 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.547006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp" event={"ID":"27a2289f-24f7-46a6-aa54-972b9a5c8df3","Type":"ContainerStarted","Data":"262cfaa7ae20e9657d1633ebebe4ac8df504d16479ae49c5903a0e06d45c3231"}
Jul 29 21:03:50.547090 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.547053    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp" event={"ID":"27a2289f-24f7-46a6-aa54-972b9a5c8df3","Type":"ContainerStarted","Data":"1291a8cd499169a4e2e519fb03a4b156f42734946b94af8f46f1c9c2946bbe01"}
Jul 29 21:03:50.548365 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.548344    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5kmcr" event={"ID":"78fa3b29-d371-437e-ab96-47269879af94","Type":"ContainerStarted","Data":"2b5095196883814ae378863526515a603c4e705e018023161caddd3ac744a991"}
Jul 29 21:03:50.549767 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.549744    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4r87h" event={"ID":"8dae69cf-821a-44a8-88c0-71231fa90777","Type":"ContainerStarted","Data":"310709d34f3c058d7b39cdd34e0dd16c164fa90a0f381689d7bf76205011159c"}
Jul 29 21:03:50.551165 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.551146    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p9nbl" event={"ID":"97bfc384-e246-4ee4-b5f7-39cbe1917d44","Type":"ContainerStarted","Data":"630b762af7782a23b126bd55c1beecbbc7c66b333d6a6bdb97f05a97c0e42bd1"}
Jul 29 21:03:50.552530 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.552504    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jpwfd" event={"ID":"0272b3fe-182e-4e24-817c-a85b0479bd70","Type":"ContainerStarted","Data":"163671d157ec12afeb239c5a78ca9f5dda92a7c62ec690576bc9d99cf0b4f0b5"}
Jul 29 21:03:50.553963 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.553937    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf" event={"ID":"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26","Type":"ContainerStarted","Data":"55b94cef34866a446c3649d856c3233cba72dcf002d6008bf34bc0ff4675bfdb"}
Jul 29 21:03:50.555264 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.555243    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-696n2" event={"ID":"df3cf440-cfee-44f5-b194-82f00a6a4c44","Type":"ContainerStarted","Data":"fd136a89392d960c2c4235c659f2c996394a068ad4b4e660774d507a7634a3a0"}
Jul 29 21:03:50.571566 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.571527    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5kmcr" podStartSLOduration=3.509273305 podStartE2EDuration="22.57151502s" totalImagesPullingTime="19.062241715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 21:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:03:50.571135672 +0000 UTC m=+22.576659043" watchObservedRunningTime="2026-07-29 21:03:50.57151502 +0000 UTC m=+22.577038387"
Jul 29 21:03:50.588074 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.587854    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jpwfd" podStartSLOduration=4.176205253 podStartE2EDuration="22.587837348s" totalImagesPullingTime="18.411632095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 21:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:03:50.587544395 +0000 UTC m=+22.593067764" watchObservedRunningTime="2026-07-29 21:03:50.587837348 +0000 UTC m=+22.593360718"
Jul 29 21:03:50.640385 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.640337    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p9nbl" podStartSLOduration=4.200988545 podStartE2EDuration="22.64032364s" totalImagesPullingTime="18.439335095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 21:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:03:50.640142084 +0000 UTC m=+22.645665451" watchObservedRunningTime="2026-07-29 21:03:50.64032364 +0000 UTC m=+22.645847020"
Jul 29 21:03:50.673908 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.673869    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4r87h" podStartSLOduration=3.606521994 podStartE2EDuration="22.673855158s" totalImagesPullingTime="19.067333164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:03:50.655750835 +0000 UTC m=+22.661274204" watchObservedRunningTime="2026-07-29 21:03:50.673855158 +0000 UTC m=+22.679378593"
Jul 29 21:03:50.674031 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:50.673965    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-696n2" podStartSLOduration=3.590819065 podStartE2EDuration="22.67395939s" totalImagesPullingTime="19.083140325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 21:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:03:50.673765711 +0000 UTC m=+22.679289080" watchObservedRunningTime="2026-07-29 21:03:50.67395939 +0000 UTC m=+22.679482758"
Jul 29 21:03:51.476248 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:51.476208    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:51.476609 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:51.476316    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:03:51.560051 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:51.560013    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal" event={"ID":"bd1b452a1808694511815956217406d9","Type":"ContainerStarted","Data":"60fc231aea036b0b5466e6779b2ef60b9701fe105a321c4b20be762d44281070"}
Jul 29 21:03:51.561679 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:51.561648    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-27vqp" event={"ID":"fc4ca3d5-ad8a-49b2-9bfa-bea2936d463d","Type":"ContainerStarted","Data":"6f0d62551480ead6fded42aea811a5f72ab7f9bec142c650851313bec25b919e"}
Jul 29 21:03:51.587681 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:51.587632    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-66.ec2.internal" podStartSLOduration=22.587614077 podStartE2EDuration="22.587614077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 21:03:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:03:51.574709447 +0000 UTC m=+23.580232814" watchObservedRunningTime="2026-07-29 21:03:51.587614077 +0000 UTC m=+23.593137482"
Jul 29 21:03:51.587828 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:51.587713    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-27vqp" podStartSLOduration=5.165375495 podStartE2EDuration="23.587705853s" totalImagesPullingTime="18.422330358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 21:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:03:51.587199854 +0000 UTC m=+23.592723222" watchObservedRunningTime="2026-07-29 21:03:51.587705853 +0000 UTC m=+23.593229222"
Jul 29 21:03:51.718634 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:51.718604    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 21:03:52.412911 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:52.412798    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T21:03:51.718628976Z","UUID":"fa09f761-dc0b-47ba-aef8-a784e3c85355","Handler":null,"Name":"","Endpoint":""}
Jul 29 21:03:52.414541 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:52.414511    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 21:03:52.414681 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:52.414556    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 21:03:52.476690 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:52.476659    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:52.476856 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:52.476792    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:03:52.476856 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:52.476845    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:52.476981 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:52.476958    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:03:52.565273 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:52.565246    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf" event={"ID":"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26","Type":"ContainerStarted","Data":"93ef15b0d158448582484b55c0d4b14f6b6860e17f256a239dfb4f1c81ffb450"}
Jul 29 21:03:53.476741 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:53.476711    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:53.476933 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:53.476825    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:03:53.571287 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:53.571253    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp" event={"ID":"27a2289f-24f7-46a6-aa54-972b9a5c8df3","Type":"ContainerStarted","Data":"e5937b90a94a16f1a7c53464bece472ae409d9e09068bd01f845d64017c67acf"}
Jul 29 21:03:53.720709 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:53.720674    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4r87h"
Jul 29 21:03:53.721247 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:53.721230    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4r87h"
Jul 29 21:03:54.477119 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:54.477081    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:54.477295 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:54.477207    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:03:54.477295 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:54.477264    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:54.477399 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:54.477365    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:03:54.573716 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:54.573676    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4r87h"
Jul 29 21:03:54.574240 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:54.574222    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4r87h"
Jul 29 21:03:55.476604 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:55.476371    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:55.476743 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:55.476640    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:03:55.576880 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:55.576847    2575 generic.go:356] "Generic (PLEG): container finished" podID="0b2b7b29-9225-48c9-966d-1e90a3b431a8" containerID="2aaf65fe2b04dd035ffb2245800d97d0b43c403d3ac89dd08dc53cd15aeefaf4" exitCode=0
Jul 29 21:03:55.577571 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:55.576932    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttp4q" event={"ID":"0b2b7b29-9225-48c9-966d-1e90a3b431a8","Type":"ContainerDied","Data":"2aaf65fe2b04dd035ffb2245800d97d0b43c403d3ac89dd08dc53cd15aeefaf4"}
Jul 29 21:03:55.580565 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:55.580542    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp" event={"ID":"27a2289f-24f7-46a6-aa54-972b9a5c8df3","Type":"ContainerStarted","Data":"3ce4727511ce8e61d6bbe5c0bff6284e887fb97486b9543357621012cf58bf67"}
Jul 29 21:03:55.580857 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:55.580837    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:55.580918 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:55.580906    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:55.595870 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:55.595851    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:55.595993 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:55.595980    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:55.623491 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:55.623435    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp" podStartSLOduration=9.10513656 podStartE2EDuration="27.623422734s" totalImagesPullingTime="18.518286174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 21:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:03:55.62157527 +0000 UTC m=+27.627098636" watchObservedRunningTime="2026-07-29 21:03:55.623422734 +0000 UTC m=+27.628946101"
Jul 29 21:03:56.476760 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:56.476433    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:56.476760 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:56.476433    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:56.476760 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:56.476592    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:03:56.476760 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:56.476719    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:03:56.585427 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:56.585384    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf" event={"ID":"42e0c6e1-9ddc-4684-9c84-5289d9c6fa26","Type":"ContainerStarted","Data":"007c4383718272a3c3e7b67603c73b3530959f18534831ac44582c0a634f44bf"}
Jul 29 21:03:56.585976 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:56.585735    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:03:56.950604 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:56.950549    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shfpf" podStartSLOduration=11.671279821 podStartE2EDuration="28.950527199s" totalImagesPullingTime="17.279247378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 21:03:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:03:56.604211366 +0000 UTC m=+28.609734735" watchObservedRunningTime="2026-07-29 21:03:56.950527199 +0000 UTC m=+28.956050568"
Jul 29 21:03:56.950769 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:56.950752    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lhv4n"]
Jul 29 21:03:56.950892 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:56.950874    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:56.951013 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:56.950990    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:03:56.954307 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:56.954181    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-927zg"]
Jul 29 21:03:56.954307 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:56.954296    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:56.954464 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:56.954387    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:03:56.955179 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:56.955151    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4wwgl"]
Jul 29 21:03:56.955271 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:56.955256    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:56.955377 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:56.955357    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:03:57.589873 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:57.589840    2575 generic.go:356] "Generic (PLEG): container finished" podID="0b2b7b29-9225-48c9-966d-1e90a3b431a8" containerID="f41cc18c9781fbe1269551fa037fbd356ce089c0ba2787147c0f51560f055423" exitCode=0
Jul 29 21:03:57.590351 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:57.589928    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttp4q" event={"ID":"0b2b7b29-9225-48c9-966d-1e90a3b431a8","Type":"ContainerDied","Data":"f41cc18c9781fbe1269551fa037fbd356ce089c0ba2787147c0f51560f055423"}
Jul 29 21:03:58.477297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:58.477267    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:03:58.477467 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:58.477376    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:03:58.477805 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:58.477784    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:03:58.477909 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:58.477841    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:03:58.477964 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:58.477932    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:03:58.478084 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:03:58.478064    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:03:59.596619 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:59.596588    2575 generic.go:356] "Generic (PLEG): container finished" podID="0b2b7b29-9225-48c9-966d-1e90a3b431a8" containerID="f55deb6da59414df1f28127438484c9902e7bd6464a4317ab7024593434c49a8" exitCode=0
Jul 29 21:03:59.597011 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:03:59.596641    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttp4q" event={"ID":"0b2b7b29-9225-48c9-966d-1e90a3b431a8","Type":"ContainerDied","Data":"f55deb6da59414df1f28127438484c9902e7bd6464a4317ab7024593434c49a8"}
Jul 29 21:04:00.476798 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:00.476764    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:04:00.476992 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:00.476764    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:04:00.476992 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:00.476893    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:04:00.476992 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:00.476907    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:04:00.476992 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:00.476960    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:04:00.477213 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:00.477032    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:04:02.112544 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:02.112507    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c9nn\" (UniqueName: \"kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn\") pod \"network-check-target-927zg\" (UID: \"38ccf67f-4ed7-41ae-b793-29fd5ff3cebc\") " pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:04:02.112998 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:02.112553    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs\") pod \"network-metrics-daemon-4wwgl\" (UID: \"ff9a3f79-f4da-491d-abb3-8acc9ff17877\") " pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:04:02.112998 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:02.112688    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 21:04:02.112998 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:02.112711    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 21:04:02.112998 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:02.112736    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 21:04:02.112998 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:02.112749    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4c9nn for pod openshift-network-diagnostics/network-check-target-927zg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 21:04:02.112998 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:02.112753    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs podName:ff9a3f79-f4da-491d-abb3-8acc9ff17877 nodeName:}" failed. No retries permitted until 2026-07-29 21:04:34.112733686 +0000 UTC m=+66.118257047 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs") pod "network-metrics-daemon-4wwgl" (UID: "ff9a3f79-f4da-491d-abb3-8acc9ff17877") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 21:04:02.112998 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:02.112817    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn podName:38ccf67f-4ed7-41ae-b793-29fd5ff3cebc nodeName:}" failed. No retries permitted until 2026-07-29 21:04:34.112797813 +0000 UTC m=+66.118321173 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4c9nn" (UniqueName: "kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn") pod "network-check-target-927zg" (UID: "38ccf67f-4ed7-41ae-b793-29fd5ff3cebc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 21:04:02.213091 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:02.213052    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret\") pod \"global-pull-secret-syncer-lhv4n\" (UID: \"091fbbf5-b287-4969-bdbf-b84d4981c4f3\") " pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:04:02.213259 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:02.213210    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 21:04:02.213320 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:02.213288    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret podName:091fbbf5-b287-4969-bdbf-b84d4981c4f3 nodeName:}" failed. No retries permitted until 2026-07-29 21:04:34.21326674 +0000 UTC m=+66.218790087 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret") pod "global-pull-secret-syncer-lhv4n" (UID: "091fbbf5-b287-4969-bdbf-b84d4981c4f3") : object "kube-system"/"original-pull-secret" not registered
Jul 29 21:04:02.476879 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:02.476802    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:04:02.477036 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:02.476802    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:04:02.477036 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:02.476932    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:04:02.477036 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:02.476992    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:04:02.477196 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:02.477086    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-927zg" podUID="38ccf67f-4ed7-41ae-b793-29fd5ff3cebc"
Jul 29 21:04:02.477196 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:02.477161    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhv4n" podUID="091fbbf5-b287-4969-bdbf-b84d4981c4f3"
Jul 29 21:04:03.874455 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.874281    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-66.ec2.internal" event="NodeReady"
Jul 29 21:04:03.874798 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.874570    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 21:04:03.908525 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.908501    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"]
Jul 29 21:04:03.920812 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.920788    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7687fddd6d-dvwnt"]
Jul 29 21:04:03.920939 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.920918    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:04:03.923680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.923478    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jkhlj\""
Jul 29 21:04:03.923680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.923491    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 29 21:04:03.923680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.923633    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 29 21:04:03.932850 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.932828    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"]
Jul 29 21:04:03.932964 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.932864    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l42z5"]
Jul 29 21:04:03.932964 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.932944    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:03.936023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.935992    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n9ncd\""
Jul 29 21:04:03.936023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.936008    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 21:04:03.936171 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.935998    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 21:04:03.936171 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.936045    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 21:04:03.942366 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.942321    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 21:04:03.956873 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.956854    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7687fddd6d-dvwnt"]
Jul 29 21:04:03.956975 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.956883    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8xb9c"]
Jul 29 21:04:03.957033 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.956982    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:03.960702 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.960473    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 21:04:03.960702 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.960560    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5hxhk\""
Jul 29 21:04:03.961161 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.961146    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 21:04:03.973029 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.973007    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l42z5"]
Jul 29 21:04:03.973113 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.973048    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8xb9c"]
Jul 29 21:04:03.973113 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.973106    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8xb9c"
Jul 29 21:04:03.976861 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.976844    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 21:04:03.976967 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.976886    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 21:04:03.977118 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.977104    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tnkqz\""
Jul 29 21:04:03.977179 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:03.977156    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 21:04:04.026874 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.026848    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86593cfc-07e7-476a-921d-85ed51cedccc-installation-pull-secrets\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.026985 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.026878    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86593cfc-07e7-476a-921d-85ed51cedccc-registry-certificates\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.026985 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.026900    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2kvq\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-kube-api-access-m2kvq\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.026985 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.026950    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86593cfc-07e7-476a-921d-85ed51cedccc-trusted-ca\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.026985 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.026979    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-bound-sa-token\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.027148 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.027024    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9sxm\" (UID: \"fb657a40-9774-42ab-974f-2ff4345acc3c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:04:04.027148 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.027053    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86593cfc-07e7-476a-921d-85ed51cedccc-ca-trust-extracted\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.027148 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.027087    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86593cfc-07e7-476a-921d-85ed51cedccc-image-registry-private-configuration\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.027148 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.027107    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb657a40-9774-42ab-974f-2ff4345acc3c-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-s9sxm\" (UID: \"fb657a40-9774-42ab-974f-2ff4345acc3c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:04:04.027148 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.027129    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.128249 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128183    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86593cfc-07e7-476a-921d-85ed51cedccc-trusted-ca\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.128249 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128219    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/163ef3df-3eb2-44e3-ad92-0665dbe66343-tmp-dir\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:04.128249 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-bound-sa-token\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.128522 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128312    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgpxs\" (UniqueName: \"kubernetes.io/projected/ce278890-ad21-445b-adb0-27a807a79f86-kube-api-access-xgpxs\") pod \"ingress-canary-8xb9c\" (UID: \"ce278890-ad21-445b-adb0-27a807a79f86\") " pod="openshift-ingress-canary/ingress-canary-8xb9c"
Jul 29 21:04:04.128522 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9sxm\" (UID: \"fb657a40-9774-42ab-974f-2ff4345acc3c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:04:04.128522 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:04.128522 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htkdh\" (UniqueName: \"kubernetes.io/projected/163ef3df-3eb2-44e3-ad92-0665dbe66343-kube-api-access-htkdh\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:04.128522 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:04.128500    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 21:04:04.128720 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128503    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86593cfc-07e7-476a-921d-85ed51cedccc-ca-trust-extracted\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.128720 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:04.128569    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert podName:fb657a40-9774-42ab-974f-2ff4345acc3c nodeName:}" failed. No retries permitted until 2026-07-29 21:04:04.628552657 +0000 UTC m=+36.634076003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9sxm" (UID: "fb657a40-9774-42ab-974f-2ff4345acc3c") : secret "networking-console-plugin-cert" not found
Jul 29 21:04:04.128720 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128619    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86593cfc-07e7-476a-921d-85ed51cedccc-image-registry-private-configuration\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.128720 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128639    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb657a40-9774-42ab-974f-2ff4345acc3c-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-s9sxm\" (UID: \"fb657a40-9774-42ab-974f-2ff4345acc3c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:04:04.128720 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.128720 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128679    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce278890-ad21-445b-adb0-27a807a79f86-cert\") pod \"ingress-canary-8xb9c\" (UID: \"ce278890-ad21-445b-adb0-27a807a79f86\") " pod="openshift-ingress-canary/ingress-canary-8xb9c"
Jul 29 21:04:04.129017 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:04.128765    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 21:04:04.129017 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:04.128781    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7687fddd6d-dvwnt: secret "image-registry-tls" not found
Jul 29 21:04:04.129017 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128795    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86593cfc-07e7-476a-921d-85ed51cedccc-installation-pull-secrets\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.129017 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128831    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86593cfc-07e7-476a-921d-85ed51cedccc-registry-certificates\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.129017 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:04.128847    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls podName:86593cfc-07e7-476a-921d-85ed51cedccc nodeName:}" failed. No retries permitted until 2026-07-29 21:04:04.628828808 +0000 UTC m=+36.634352158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls") pod "image-registry-7687fddd6d-dvwnt" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc") : secret "image-registry-tls" not found
Jul 29 21:04:04.129017 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128873    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/163ef3df-3eb2-44e3-ad92-0665dbe66343-config-volume\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:04.129017 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128907    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2kvq\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-kube-api-access-m2kvq\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.129017 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.128935    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86593cfc-07e7-476a-921d-85ed51cedccc-ca-trust-extracted\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.129430 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.129313    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86593cfc-07e7-476a-921d-85ed51cedccc-registry-certificates\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.129430 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.129395    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb657a40-9774-42ab-974f-2ff4345acc3c-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-s9sxm\" (UID: \"fb657a40-9774-42ab-974f-2ff4345acc3c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:04:04.129628 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.129610    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86593cfc-07e7-476a-921d-85ed51cedccc-trusted-ca\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.132692 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.132674    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86593cfc-07e7-476a-921d-85ed51cedccc-installation-pull-secrets\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.141365 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.141338    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86593cfc-07e7-476a-921d-85ed51cedccc-image-registry-private-configuration\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.142891 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.142870    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-bound-sa-token\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.143127 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.143108    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2kvq\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-kube-api-access-m2kvq\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.229574 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.229544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/163ef3df-3eb2-44e3-ad92-0665dbe66343-tmp-dir\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:04.229683 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.229600    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgpxs\" (UniqueName: \"kubernetes.io/projected/ce278890-ad21-445b-adb0-27a807a79f86-kube-api-access-xgpxs\") pod \"ingress-canary-8xb9c\" (UID: \"ce278890-ad21-445b-adb0-27a807a79f86\") " pod="openshift-ingress-canary/ingress-canary-8xb9c"
Jul 29 21:04:04.229683 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.229652    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:04.229683 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.229672    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htkdh\" (UniqueName: \"kubernetes.io/projected/163ef3df-3eb2-44e3-ad92-0665dbe66343-kube-api-access-htkdh\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:04.229842 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.229729    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce278890-ad21-445b-adb0-27a807a79f86-cert\") pod \"ingress-canary-8xb9c\" (UID: \"ce278890-ad21-445b-adb0-27a807a79f86\") " pod="openshift-ingress-canary/ingress-canary-8xb9c"
Jul 29 21:04:04.229842 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:04.229755    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 21:04:04.229842 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.229764    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/163ef3df-3eb2-44e3-ad92-0665dbe66343-config-volume\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:04.229842 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:04.229825    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls podName:163ef3df-3eb2-44e3-ad92-0665dbe66343 nodeName:}" failed. No retries permitted until 2026-07-29 21:04:04.729805531 +0000 UTC m=+36.735328891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls") pod "dns-default-l42z5" (UID: "163ef3df-3eb2-44e3-ad92-0665dbe66343") : secret "dns-default-metrics-tls" not found
Jul 29 21:04:04.230038 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.229922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/163ef3df-3eb2-44e3-ad92-0665dbe66343-tmp-dir\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:04.230308 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.230284    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/163ef3df-3eb2-44e3-ad92-0665dbe66343-config-volume\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:04.232411 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.232384    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce278890-ad21-445b-adb0-27a807a79f86-cert\") pod \"ingress-canary-8xb9c\" (UID: \"ce278890-ad21-445b-adb0-27a807a79f86\") " pod="openshift-ingress-canary/ingress-canary-8xb9c"
Jul 29 21:04:04.241372 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.241345    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htkdh\" (UniqueName: \"kubernetes.io/projected/163ef3df-3eb2-44e3-ad92-0665dbe66343-kube-api-access-htkdh\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:04.241490 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.241375    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgpxs\" (UniqueName: \"kubernetes.io/projected/ce278890-ad21-445b-adb0-27a807a79f86-kube-api-access-xgpxs\") pod \"ingress-canary-8xb9c\" (UID: \"ce278890-ad21-445b-adb0-27a807a79f86\") " pod="openshift-ingress-canary/ingress-canary-8xb9c"
Jul 29 21:04:04.281768 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.281749    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8xb9c"
Jul 29 21:04:04.465973 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.465942    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8xb9c"]
Jul 29 21:04:04.471709 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:04:04.471680    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce278890_ad21_445b_adb0_27a807a79f86.slice/crio-dc8fbcd565778264bea26ac2d5b26989023e490b642475f55767ff1d8d6b2bff WatchSource:0}: Error finding container dc8fbcd565778264bea26ac2d5b26989023e490b642475f55767ff1d8d6b2bff: Status 404 returned error can't find the container with id dc8fbcd565778264bea26ac2d5b26989023e490b642475f55767ff1d8d6b2bff
Jul 29 21:04:04.476515 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.476495    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:04:04.476593 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.476511    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:04:04.476705 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.476688    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:04:04.479386 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.479365    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 21:04:04.479486 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.479365    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-82zmz\""
Jul 29 21:04:04.479486 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.479416    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 21:04:04.479613 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.479389    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 21:04:04.479613 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.479507    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 21:04:04.482440 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.482418    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cnnw5\""
Jul 29 21:04:04.611830 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.611566    2575 generic.go:356] "Generic (PLEG): container finished" podID="0b2b7b29-9225-48c9-966d-1e90a3b431a8" containerID="3fec5376de8552b899e6fd4fad6c1d8e4bee6f5e8e232155f7fcf8c727963ee2" exitCode=0
Jul 29 21:04:04.611944 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.611649    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttp4q" event={"ID":"0b2b7b29-9225-48c9-966d-1e90a3b431a8","Type":"ContainerDied","Data":"3fec5376de8552b899e6fd4fad6c1d8e4bee6f5e8e232155f7fcf8c727963ee2"}
Jul 29 21:04:04.613008 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.612989    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8xb9c" event={"ID":"ce278890-ad21-445b-adb0-27a807a79f86","Type":"ContainerStarted","Data":"dc8fbcd565778264bea26ac2d5b26989023e490b642475f55767ff1d8d6b2bff"}
Jul 29 21:04:04.632520 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.632499    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9sxm\" (UID: \"fb657a40-9774-42ab-974f-2ff4345acc3c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:04:04.632632 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.632546    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:04.632694 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:04.632663    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 21:04:04.632694 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:04.632674    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7687fddd6d-dvwnt: secret "image-registry-tls" not found
Jul 29 21:04:04.632694 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:04.632670    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 21:04:04.632841 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:04.632732    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls podName:86593cfc-07e7-476a-921d-85ed51cedccc nodeName:}" failed. No retries permitted until 2026-07-29 21:04:05.632698982 +0000 UTC m=+37.638222331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls") pod "image-registry-7687fddd6d-dvwnt" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc") : secret "image-registry-tls" not found
Jul 29 21:04:04.632841 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:04.632745    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert podName:fb657a40-9774-42ab-974f-2ff4345acc3c nodeName:}" failed. No retries permitted until 2026-07-29 21:04:05.632739293 +0000 UTC m=+37.638262638 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9sxm" (UID: "fb657a40-9774-42ab-974f-2ff4345acc3c") : secret "networking-console-plugin-cert" not found
Jul 29 21:04:04.734080 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:04.734050    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:04.734230 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:04.734213    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 21:04:04.734306 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:04.734281    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls podName:163ef3df-3eb2-44e3-ad92-0665dbe66343 nodeName:}" failed. No retries permitted until 2026-07-29 21:04:05.734257784 +0000 UTC m=+37.739781131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls") pod "dns-default-l42z5" (UID: "163ef3df-3eb2-44e3-ad92-0665dbe66343") : secret "dns-default-metrics-tls" not found
Jul 29 21:04:05.619966 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:05.619934    2575 generic.go:356] "Generic (PLEG): container finished" podID="0b2b7b29-9225-48c9-966d-1e90a3b431a8" containerID="df284bdb22d3ae2565de701fd0f9304e637a5ebad89c79e11c5b827df232f1e8" exitCode=0
Jul 29 21:04:05.620785 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:05.619991    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttp4q" event={"ID":"0b2b7b29-9225-48c9-966d-1e90a3b431a8","Type":"ContainerDied","Data":"df284bdb22d3ae2565de701fd0f9304e637a5ebad89c79e11c5b827df232f1e8"}
Jul 29 21:04:05.643215 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:05.642538    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:05.643215 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:05.642677    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9sxm\" (UID: \"fb657a40-9774-42ab-974f-2ff4345acc3c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:04:05.643215 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:05.642717    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 21:04:05.643215 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:05.642739    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7687fddd6d-dvwnt: secret "image-registry-tls" not found
Jul 29 21:04:05.643215 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:05.642800    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls podName:86593cfc-07e7-476a-921d-85ed51cedccc nodeName:}" failed. No retries permitted until 2026-07-29 21:04:07.642778929 +0000 UTC m=+39.648302299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls") pod "image-registry-7687fddd6d-dvwnt" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc") : secret "image-registry-tls" not found
Jul 29 21:04:05.643215 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:05.642817    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 21:04:05.643215 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:05.642892    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert podName:fb657a40-9774-42ab-974f-2ff4345acc3c nodeName:}" failed. No retries permitted until 2026-07-29 21:04:07.642875124 +0000 UTC m=+39.648398495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9sxm" (UID: "fb657a40-9774-42ab-974f-2ff4345acc3c") : secret "networking-console-plugin-cert" not found
Jul 29 21:04:05.744039 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:05.744008    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:05.744193 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:05.744172    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 21:04:05.744267 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:05.744240    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls podName:163ef3df-3eb2-44e3-ad92-0665dbe66343 nodeName:}" failed. No retries permitted until 2026-07-29 21:04:07.744217949 +0000 UTC m=+39.749741313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls") pod "dns-default-l42z5" (UID: "163ef3df-3eb2-44e3-ad92-0665dbe66343") : secret "dns-default-metrics-tls" not found
Jul 29 21:04:06.626851 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:06.626816    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttp4q" event={"ID":"0b2b7b29-9225-48c9-966d-1e90a3b431a8","Type":"ContainerStarted","Data":"b07840b54f02d1b1b57a66400899fafaa5569e3123c4136bc9111c5d2a1dcfaf"}
Jul 29 21:04:06.653012 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:06.652954    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ttp4q" podStartSLOduration=8.849907955 podStartE2EDuration="38.652938661s" totalImagesPullingTime="29.803030706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 21:03:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:04:06.650929874 +0000 UTC m=+38.656453252" watchObservedRunningTime="2026-07-29 21:04:06.652938661 +0000 UTC m=+38.658462029"
Jul 29 21:04:06.805260 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:06.805226    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:06.890711 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:06.890679    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:07.630815 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:07.630773    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8xb9c" event={"ID":"ce278890-ad21-445b-adb0-27a807a79f86","Type":"ContainerStarted","Data":"bf448e13e2951c5948fa16a11ee5463ee7ca23f72c3e8f1dccb37812825339c7"}
Jul 29 21:04:07.658599 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:07.658566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9sxm\" (UID: \"fb657a40-9774-42ab-974f-2ff4345acc3c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:04:07.658752 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:07.658629    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:07.658752 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:07.658698    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 21:04:07.658752 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:07.658736    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 21:04:07.658752 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:07.658748    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7687fddd6d-dvwnt: secret "image-registry-tls" not found
Jul 29 21:04:07.658904 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:07.658751    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert podName:fb657a40-9774-42ab-974f-2ff4345acc3c nodeName:}" failed. No retries permitted until 2026-07-29 21:04:11.658737495 +0000 UTC m=+43.664260845 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9sxm" (UID: "fb657a40-9774-42ab-974f-2ff4345acc3c") : secret "networking-console-plugin-cert" not found
Jul 29 21:04:07.658904 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:07.658803    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls podName:86593cfc-07e7-476a-921d-85ed51cedccc nodeName:}" failed. No retries permitted until 2026-07-29 21:04:11.658787958 +0000 UTC m=+43.664311308 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls") pod "image-registry-7687fddd6d-dvwnt" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc") : secret "image-registry-tls" not found
Jul 29 21:04:07.664859 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:07.664818    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8xb9c" podStartSLOduration=2.073025505 podStartE2EDuration="4.664805721s" totalImagesPullingTime="2.591780216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:04:07.664468656 +0000 UTC m=+39.669992023" watchObservedRunningTime="2026-07-29 21:04:07.664805721 +0000 UTC m=+39.670329087"
Jul 29 21:04:07.759737 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:07.759703    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:07.759867 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:07.759807    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 21:04:07.759867 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:07.759860    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls podName:163ef3df-3eb2-44e3-ad92-0665dbe66343 nodeName:}" failed. No retries permitted until 2026-07-29 21:04:11.759844386 +0000 UTC m=+43.765367735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls") pod "dns-default-l42z5" (UID: "163ef3df-3eb2-44e3-ad92-0665dbe66343") : secret "dns-default-metrics-tls" not found
Jul 29 21:04:09.203228 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:09.203175    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:09.291929 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:09.291893    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:09.388885 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:09.388852    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:09.480864 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:09.480777    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:09.556916 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:09.556875    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:09.659042 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:09.659000    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:10.171001 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:10.170968    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:10.270900 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:10.270869    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:10.569044 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:10.568994    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:10.693828 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:10.693786    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:11.372676 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:11.372641    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:11.429387 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:11.429355    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:11.689359 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:11.689278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:11.689359 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:11.689352    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9sxm\" (UID: \"fb657a40-9774-42ab-974f-2ff4345acc3c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:04:11.689578 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:11.689425    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 21:04:11.689578 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:11.689462    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7687fddd6d-dvwnt: secret "image-registry-tls" not found
Jul 29 21:04:11.689578 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:11.689511    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls podName:86593cfc-07e7-476a-921d-85ed51cedccc nodeName:}" failed. No retries permitted until 2026-07-29 21:04:19.689496725 +0000 UTC m=+51.695020071 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls") pod "image-registry-7687fddd6d-dvwnt" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc") : secret "image-registry-tls" not found
Jul 29 21:04:11.689578 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:11.689431    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 21:04:11.689578 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:11.689573    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert podName:fb657a40-9774-42ab-974f-2ff4345acc3c nodeName:}" failed. No retries permitted until 2026-07-29 21:04:19.689561355 +0000 UTC m=+51.695084701 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9sxm" (UID: "fb657a40-9774-42ab-974f-2ff4345acc3c") : secret "networking-console-plugin-cert" not found
Jul 29 21:04:11.768971 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:11.768928    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:11.790196 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:11.790168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:11.790308 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:11.790294    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 21:04:11.790361 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:11.790351    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls podName:163ef3df-3eb2-44e3-ad92-0665dbe66343 nodeName:}" failed. No retries permitted until 2026-07-29 21:04:19.790336645 +0000 UTC m=+51.795860013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls") pod "dns-default-l42z5" (UID: "163ef3df-3eb2-44e3-ad92-0665dbe66343") : secret "dns-default-metrics-tls" not found
Jul 29 21:04:11.865463 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:11.865424    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:13.774983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:13.774935    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:13.833405 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:13.833374    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:16.906647 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:16.906616    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:16.957954 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:16.957932    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:19.747014 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:19.746975    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9sxm\" (UID: \"fb657a40-9774-42ab-974f-2ff4345acc3c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:04:19.747407 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:19.747030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:19.747407 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:19.747120    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 21:04:19.747407 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:19.747121    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 21:04:19.747407 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:19.747195    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert podName:fb657a40-9774-42ab-974f-2ff4345acc3c nodeName:}" failed. No retries permitted until 2026-07-29 21:04:35.747178492 +0000 UTC m=+67.752701855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9sxm" (UID: "fb657a40-9774-42ab-974f-2ff4345acc3c") : secret "networking-console-plugin-cert" not found
Jul 29 21:04:19.747407 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:19.747131    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7687fddd6d-dvwnt: secret "image-registry-tls" not found
Jul 29 21:04:19.747407 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:19.747259    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls podName:86593cfc-07e7-476a-921d-85ed51cedccc nodeName:}" failed. No retries permitted until 2026-07-29 21:04:35.747247024 +0000 UTC m=+67.752770370 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls") pod "image-registry-7687fddd6d-dvwnt" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc") : secret "image-registry-tls" not found
Jul 29 21:04:19.847472 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:19.847415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:19.847614 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:19.847564    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 21:04:19.847655 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:19.847631    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls podName:163ef3df-3eb2-44e3-ad92-0665dbe66343 nodeName:}" failed. No retries permitted until 2026-07-29 21:04:35.847616532 +0000 UTC m=+67.853139877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls") pod "dns-default-l42z5" (UID: "163ef3df-3eb2-44e3-ad92-0665dbe66343") : secret "dns-default-metrics-tls" not found
Jul 29 21:04:27.600912 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:27.600882    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmhhp"
Jul 29 21:04:27.751180 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:27.751150    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:27.810347 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:27.810285    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:30.060047 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:30.060008    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:30.156236 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:30.156207    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:31.026943 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:31.026910    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:31.146418 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:31.146388    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:31.245727 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:31.245695    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:34.149241 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.149205    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c9nn\" (UniqueName: \"kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn\") pod \"network-check-target-927zg\" (UID: \"38ccf67f-4ed7-41ae-b793-29fd5ff3cebc\") " pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:04:34.149820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.149268    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs\") pod \"network-metrics-daemon-4wwgl\" (UID: \"ff9a3f79-f4da-491d-abb3-8acc9ff17877\") " pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:04:34.152225 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.152203    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 21:04:34.152277 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.152236    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 21:04:34.160232 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:34.160214    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 21:04:34.160301 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:34.160273    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs podName:ff9a3f79-f4da-491d-abb3-8acc9ff17877 nodeName:}" failed. No retries permitted until 2026-07-29 21:05:38.1602574 +0000 UTC m=+130.165780746 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs") pod "network-metrics-daemon-4wwgl" (UID: "ff9a3f79-f4da-491d-abb3-8acc9ff17877") : secret "metrics-daemon-secret" not found
Jul 29 21:04:34.162705 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.162689    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 21:04:34.174025 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.174002    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c9nn\" (UniqueName: \"kubernetes.io/projected/38ccf67f-4ed7-41ae-b793-29fd5ff3cebc-kube-api-access-4c9nn\") pod \"network-check-target-927zg\" (UID: \"38ccf67f-4ed7-41ae-b793-29fd5ff3cebc\") " pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:04:34.190634 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.190617    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cnnw5\""
Jul 29 21:04:34.198958 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.198939    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:04:34.249890 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.249862    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret\") pod \"global-pull-secret-syncer-lhv4n\" (UID: \"091fbbf5-b287-4969-bdbf-b84d4981c4f3\") " pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:04:34.253219 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.253200    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 21:04:34.263594 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.263407    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091fbbf5-b287-4969-bdbf-b84d4981c4f3-original-pull-secret\") pod \"global-pull-secret-syncer-lhv4n\" (UID: \"091fbbf5-b287-4969-bdbf-b84d4981c4f3\") " pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:04:34.318501 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.318470    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-927zg"]
Jul 29 21:04:34.322308 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:04:34.322284    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ccf67f_4ed7_41ae_b793_29fd5ff3cebc.slice/crio-23928edaf3288ddafdbd2c7e1dfd3723c8270205e22ef3e4c3a6241bd8d77eb3 WatchSource:0}: Error finding container 23928edaf3288ddafdbd2c7e1dfd3723c8270205e22ef3e4c3a6241bd8d77eb3: Status 404 returned error can't find the container with id 23928edaf3288ddafdbd2c7e1dfd3723c8270205e22ef3e4c3a6241bd8d77eb3
Jul 29 21:04:34.494320 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.494237    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhv4n"
Jul 29 21:04:34.598185 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.598160    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:34.636736 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.636707    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lhv4n"]
Jul 29 21:04:34.639794 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:04:34.639765    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod091fbbf5_b287_4969_bdbf_b84d4981c4f3.slice/crio-6d53cf2d6b651ba0ce92c7d04a65caaaf5846df71aaa30c2b7f5db544a29f11c WatchSource:0}: Error finding container 6d53cf2d6b651ba0ce92c7d04a65caaaf5846df71aaa30c2b7f5db544a29f11c: Status 404 returned error can't find the container with id 6d53cf2d6b651ba0ce92c7d04a65caaaf5846df71aaa30c2b7f5db544a29f11c
Jul 29 21:04:34.693629 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.693587    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lhv4n" event={"ID":"091fbbf5-b287-4969-bdbf-b84d4981c4f3","Type":"ContainerStarted","Data":"6d53cf2d6b651ba0ce92c7d04a65caaaf5846df71aaa30c2b7f5db544a29f11c"}
Jul 29 21:04:34.694658 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.694634    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-927zg" event={"ID":"38ccf67f-4ed7-41ae-b793-29fd5ff3cebc","Type":"ContainerStarted","Data":"23928edaf3288ddafdbd2c7e1dfd3723c8270205e22ef3e4c3a6241bd8d77eb3"}
Jul 29 21:04:34.697550 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.697526    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:34.799130 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:34.799099    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:35.761684 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:35.761648    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9sxm\" (UID: \"fb657a40-9774-42ab-974f-2ff4345acc3c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:04:35.762161 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:35.761801    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:04:35.762161 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:35.761822    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 21:04:35.762161 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:35.761903    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert podName:fb657a40-9774-42ab-974f-2ff4345acc3c nodeName:}" failed. No retries permitted until 2026-07-29 21:05:07.761879472 +0000 UTC m=+99.767402823 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9sxm" (UID: "fb657a40-9774-42ab-974f-2ff4345acc3c") : secret "networking-console-plugin-cert" not found
Jul 29 21:04:35.762161 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:35.761950    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 21:04:35.762161 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:35.761965    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7687fddd6d-dvwnt: secret "image-registry-tls" not found
Jul 29 21:04:35.762161 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:35.762014    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls podName:86593cfc-07e7-476a-921d-85ed51cedccc nodeName:}" failed. No retries permitted until 2026-07-29 21:05:07.761996656 +0000 UTC m=+99.767520018 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls") pod "image-registry-7687fddd6d-dvwnt" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc") : secret "image-registry-tls" not found
Jul 29 21:04:35.863142 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:35.863112    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:04:35.863306 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:35.863288    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 21:04:35.863379 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:04:35.863366    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls podName:163ef3df-3eb2-44e3-ad92-0665dbe66343 nodeName:}" failed. No retries permitted until 2026-07-29 21:05:07.863345564 +0000 UTC m=+99.868868911 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls") pod "dns-default-l42z5" (UID: "163ef3df-3eb2-44e3-ad92-0665dbe66343") : secret "dns-default-metrics-tls" not found
Jul 29 21:04:39.709265 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:39.709227    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lhv4n" event={"ID":"091fbbf5-b287-4969-bdbf-b84d4981c4f3","Type":"ContainerStarted","Data":"99d10868008a7987efbad42f3c8f70189d562f5be59f4367646266f7af90ea92"}
Jul 29 21:04:39.710742 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:39.710717    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-927zg" event={"ID":"38ccf67f-4ed7-41ae-b793-29fd5ff3cebc","Type":"ContainerStarted","Data":"a7b75e4c82c7ab084dfd59c1f5047fafb80f286af9c0ba0de6dc989cf35d388c"}
Jul 29 21:04:39.710849 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:39.710768    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:04:39.737645 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:39.737592    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lhv4n" podStartSLOduration=67.071150777 podStartE2EDuration="1m11.737575451s" totalImagesPullingTime="4.666424674s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 21:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:04:39.723771992 +0000 UTC m=+71.729295360" watchObservedRunningTime="2026-07-29 21:04:39.737575451 +0000 UTC m=+71.743098802"
Jul 29 21:04:39.738137 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:39.738107    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-927zg" podStartSLOduration=66.791438022 podStartE2EDuration="1m11.738098656s" totalImagesPullingTime="4.946660634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:04:39.737691881 +0000 UTC m=+71.743215249" watchObservedRunningTime="2026-07-29 21:04:39.738098656 +0000 UTC m=+71.743622002"
Jul 29 21:04:41.605751 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:41.605716    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:41.705832 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:41.705800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:47.649092 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:47.649058    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:47.745978 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:47.745943    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:49.168965 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:49.168927    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:04:49.230991 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:04:49.230963    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:05:07.790368 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:05:07.790329    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:05:07.790776 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:05:07.790395    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9sxm\" (UID: \"fb657a40-9774-42ab-974f-2ff4345acc3c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:05:07.790776 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:05:07.790502    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 21:05:07.790776 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:05:07.790526    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7687fddd6d-dvwnt: secret "image-registry-tls" not found
Jul 29 21:05:07.790776 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:05:07.790578    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls podName:86593cfc-07e7-476a-921d-85ed51cedccc nodeName:}" failed. No retries permitted until 2026-07-29 21:06:11.790562499 +0000 UTC m=+163.796085858 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls") pod "image-registry-7687fddd6d-dvwnt" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc") : secret "image-registry-tls" not found
Jul 29 21:05:07.790776 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:05:07.790499    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 21:05:07.790776 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:05:07.790647    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert podName:fb657a40-9774-42ab-974f-2ff4345acc3c nodeName:}" failed. No retries permitted until 2026-07-29 21:06:11.790634905 +0000 UTC m=+163.796158250 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9sxm" (UID: "fb657a40-9774-42ab-974f-2ff4345acc3c") : secret "networking-console-plugin-cert" not found
Jul 29 21:05:07.891651 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:05:07.891610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:05:07.891779 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:05:07.891756    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 21:05:07.891831 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:05:07.891821    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls podName:163ef3df-3eb2-44e3-ad92-0665dbe66343 nodeName:}" failed. No retries permitted until 2026-07-29 21:06:11.891807231 +0000 UTC m=+163.897330577 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls") pod "dns-default-l42z5" (UID: "163ef3df-3eb2-44e3-ad92-0665dbe66343") : secret "dns-default-metrics-tls" not found
Jul 29 21:05:09.109558 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:05:09.109525    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:05:09.166463 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:05:09.166424    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:05:10.715206 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:05:10.715179    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-927zg"
Jul 29 21:05:38.202626 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:05:38.202573    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs\") pod \"network-metrics-daemon-4wwgl\" (UID: \"ff9a3f79-f4da-491d-abb3-8acc9ff17877\") " pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:05:38.203091 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:05:38.202719    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 21:05:38.203091 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:05:38.202794    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs podName:ff9a3f79-f4da-491d-abb3-8acc9ff17877 nodeName:}" failed. No retries permitted until 2026-07-29 21:07:40.20277948 +0000 UTC m=+252.208302826 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs") pod "network-metrics-daemon-4wwgl" (UID: "ff9a3f79-f4da-491d-abb3-8acc9ff17877") : secret "metrics-daemon-secret" not found
Jul 29 21:06:06.932179 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:06:06.932138    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm" podUID="fb657a40-9774-42ab-974f-2ff4345acc3c"
Jul 29 21:06:06.942319 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:06:06.942290    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt" podUID="86593cfc-07e7-476a-921d-85ed51cedccc"
Jul 29 21:06:06.968456 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:06:06.968417    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-l42z5" podUID="163ef3df-3eb2-44e3-ad92-0665dbe66343"
Jul 29 21:06:07.498966 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:06:07.498922    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:06:07.912923 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:06:07.912895    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:06:07.912923 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:06:07.912895    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:06:07.913128 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:06:07.912895    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l42z5"
Jul 29 21:06:11.828680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:06:11.828642    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9sxm\" (UID: \"fb657a40-9774-42ab-974f-2ff4345acc3c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:06:11.829194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:06:11.828712    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:06:11.829194 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:06:11.828783    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 21:06:11.829194 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:06:11.828847    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 21:06:11.829194 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:06:11.828858    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert podName:fb657a40-9774-42ab-974f-2ff4345acc3c nodeName:}" failed. No retries permitted until 2026-07-29 21:08:13.828841635 +0000 UTC m=+285.834364980 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9sxm" (UID: "fb657a40-9774-42ab-974f-2ff4345acc3c") : secret "networking-console-plugin-cert" not found
Jul 29 21:06:11.829194 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:06:11.828861    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7687fddd6d-dvwnt: secret "image-registry-tls" not found
Jul 29 21:06:11.829194 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:06:11.828910    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls podName:86593cfc-07e7-476a-921d-85ed51cedccc nodeName:}" failed. No retries permitted until 2026-07-29 21:08:13.828892587 +0000 UTC m=+285.834415946 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls") pod "image-registry-7687fddd6d-dvwnt" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc") : secret "image-registry-tls" not found
Jul 29 21:06:11.929473 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:06:11.929432    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:06:11.929621 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:06:11.929582    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 21:06:11.929661 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:06:11.929638    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls podName:163ef3df-3eb2-44e3-ad92-0665dbe66343 nodeName:}" failed. No retries permitted until 2026-07-29 21:08:13.929624064 +0000 UTC m=+285.935147410 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls") pod "dns-default-l42z5" (UID: "163ef3df-3eb2-44e3-ad92-0665dbe66343") : secret "dns-default-metrics-tls" not found
Jul 29 21:06:18.478262 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:06:18.478227    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:07:08.681307 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:08.681277    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:39.379273 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.379241    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh"]
Jul 29 21:07:39.381578 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.381550    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh"
Jul 29 21:07:39.382961 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.382943    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"]
Jul 29 21:07:39.384206 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.384187    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 29 21:07:39.384401 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.384380    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-q8k8v\""
Jul 29 21:07:39.384521 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.384481    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 29 21:07:39.384521 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.384488    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 29 21:07:39.384755 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.384739    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d8mb5"]
Jul 29 21:07:39.384860 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.384847    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:07:39.386418 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.386401    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-5mbkm"]
Jul 29 21:07:39.386513 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.386499    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d8mb5"
Jul 29 21:07:39.387457 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.387431    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 21:07:39.387556 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.387543    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 29 21:07:39.388259 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.388246    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5mbkm"
Jul 29 21:07:39.389551 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.389533    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 29 21:07:39.389638 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.389556    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9qqd9\""
Jul 29 21:07:39.389700 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.389635    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 29 21:07:39.389700 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.389641    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 21:07:39.389812 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.389792    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-m9zpr\""
Jul 29 21:07:39.389912 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.389818    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 29 21:07:39.390957 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.390943    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nnnvc\""
Jul 29 21:07:39.400313 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.400290    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh"]
Jul 29 21:07:39.401395 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.401344    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-5mbkm"]
Jul 29 21:07:39.402176 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.402159    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d8mb5"]
Jul 29 21:07:39.413913 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.413890    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"]
Jul 29 21:07:39.420650 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.420628    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f86fh\" (UID: \"064c1131-16b4-4e00-8f45-22c402fadf9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh"
Jul 29 21:07:39.420745 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.420668    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c69f337b-af28-45b8-aed8-7c3be7ac0755-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-kdw9d\" (UID: \"c69f337b-af28-45b8-aed8-7c3be7ac0755\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:07:39.420787 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.420763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqmhl\" (UniqueName: \"kubernetes.io/projected/3bb7b007-164f-4a96-bdf8-bb56016fdccf-kube-api-access-tqmhl\") pod \"volume-data-source-validator-549c6d54cf-d8mb5\" (UID: \"3bb7b007-164f-4a96-bdf8-bb56016fdccf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d8mb5"
Jul 29 21:07:39.420828 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.420796    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdw9d\" (UID: \"c69f337b-af28-45b8-aed8-7c3be7ac0755\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:07:39.420828 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.420820    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9cjv\" (UniqueName: \"kubernetes.io/projected/064c1131-16b4-4e00-8f45-22c402fadf9d-kube-api-access-g9cjv\") pod \"cluster-samples-operator-6748489656-f86fh\" (UID: \"064c1131-16b4-4e00-8f45-22c402fadf9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh"
Jul 29 21:07:39.420906 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.420861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6vcx\" (UniqueName: \"kubernetes.io/projected/7fdbee91-bebc-42cb-8081-332d5c1e4b7e-kube-api-access-l6vcx\") pod \"network-check-source-7d88cb55d8-5mbkm\" (UID: \"7fdbee91-bebc-42cb-8081-332d5c1e4b7e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5mbkm"
Jul 29 21:07:39.420944 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.420910    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp5b8\" (UniqueName: \"kubernetes.io/projected/c69f337b-af28-45b8-aed8-7c3be7ac0755-kube-api-access-jp5b8\") pod \"cluster-monitoring-operator-548b489cb8-kdw9d\" (UID: \"c69f337b-af28-45b8-aed8-7c3be7ac0755\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:07:39.480640 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.480613    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-smtxx"]
Jul 29 21:07:39.486441 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.486419    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.493292 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.493274    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 29 21:07:39.493524 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.493508    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 29 21:07:39.494049 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.494030    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 21:07:39.494133 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.494069    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bttr7\""
Jul 29 21:07:39.495151 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.495133    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 21:07:39.517624 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.517601    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 29 21:07:39.519755 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.519726    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-smtxx"]
Jul 29 21:07:39.522106 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.522069    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f86fh\" (UID: \"064c1131-16b4-4e00-8f45-22c402fadf9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh"
Jul 29 21:07:39.522195 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.522107    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c69f337b-af28-45b8-aed8-7c3be7ac0755-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-kdw9d\" (UID: \"c69f337b-af28-45b8-aed8-7c3be7ac0755\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:07:39.522195 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.522139    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-serving-cert\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.522330 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:39.522302    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 21:07:39.522394 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.522324    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-tmp\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.522394 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.522354    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skj4q\" (UniqueName: \"kubernetes.io/projected/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-kube-api-access-skj4q\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.522394 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:39.522370    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls podName:064c1131-16b4-4e00-8f45-22c402fadf9d nodeName:}" failed. No retries permitted until 2026-07-29 21:07:40.022354628 +0000 UTC m=+252.027877977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls") pod "cluster-samples-operator-6748489656-f86fh" (UID: "064c1131-16b4-4e00-8f45-22c402fadf9d") : secret "samples-operator-tls" not found
Jul 29 21:07:39.522553 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.522498    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-snapshots\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.522553 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.522529    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.522656 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.522565    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqmhl\" (UniqueName: \"kubernetes.io/projected/3bb7b007-164f-4a96-bdf8-bb56016fdccf-kube-api-access-tqmhl\") pod \"volume-data-source-validator-549c6d54cf-d8mb5\" (UID: \"3bb7b007-164f-4a96-bdf8-bb56016fdccf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d8mb5"
Jul 29 21:07:39.522709 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.522659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdw9d\" (UID: \"c69f337b-af28-45b8-aed8-7c3be7ac0755\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:07:39.522762 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.522714    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9cjv\" (UniqueName: \"kubernetes.io/projected/064c1131-16b4-4e00-8f45-22c402fadf9d-kube-api-access-g9cjv\") pod \"cluster-samples-operator-6748489656-f86fh\" (UID: \"064c1131-16b4-4e00-8f45-22c402fadf9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh"
Jul 29 21:07:39.522762 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.522742    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6vcx\" (UniqueName: \"kubernetes.io/projected/7fdbee91-bebc-42cb-8081-332d5c1e4b7e-kube-api-access-l6vcx\") pod \"network-check-source-7d88cb55d8-5mbkm\" (UID: \"7fdbee91-bebc-42cb-8081-332d5c1e4b7e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5mbkm"
Jul 29 21:07:39.522859 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.522773    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp5b8\" (UniqueName: \"kubernetes.io/projected/c69f337b-af28-45b8-aed8-7c3be7ac0755-kube-api-access-jp5b8\") pod \"cluster-monitoring-operator-548b489cb8-kdw9d\" (UID: \"c69f337b-af28-45b8-aed8-7c3be7ac0755\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:07:39.522859 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.522801    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-service-ca-bundle\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.522859 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:39.522814    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 21:07:39.523001 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:39.522879    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls podName:c69f337b-af28-45b8-aed8-7c3be7ac0755 nodeName:}" failed. No retries permitted until 2026-07-29 21:07:40.022863717 +0000 UTC m=+252.028387081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-kdw9d" (UID: "c69f337b-af28-45b8-aed8-7c3be7ac0755") : secret "cluster-monitoring-operator-tls" not found
Jul 29 21:07:39.523001 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.522909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c69f337b-af28-45b8-aed8-7c3be7ac0755-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-kdw9d\" (UID: \"c69f337b-af28-45b8-aed8-7c3be7ac0755\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:07:39.545408 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.545383    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqmhl\" (UniqueName: \"kubernetes.io/projected/3bb7b007-164f-4a96-bdf8-bb56016fdccf-kube-api-access-tqmhl\") pod \"volume-data-source-validator-549c6d54cf-d8mb5\" (UID: \"3bb7b007-164f-4a96-bdf8-bb56016fdccf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d8mb5"
Jul 29 21:07:39.545518 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.545459    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9cjv\" (UniqueName: \"kubernetes.io/projected/064c1131-16b4-4e00-8f45-22c402fadf9d-kube-api-access-g9cjv\") pod \"cluster-samples-operator-6748489656-f86fh\" (UID: \"064c1131-16b4-4e00-8f45-22c402fadf9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh"
Jul 29 21:07:39.545588 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.545518    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp5b8\" (UniqueName: \"kubernetes.io/projected/c69f337b-af28-45b8-aed8-7c3be7ac0755-kube-api-access-jp5b8\") pod \"cluster-monitoring-operator-548b489cb8-kdw9d\" (UID: \"c69f337b-af28-45b8-aed8-7c3be7ac0755\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:07:39.565017 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.564995    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6vcx\" (UniqueName: \"kubernetes.io/projected/7fdbee91-bebc-42cb-8081-332d5c1e4b7e-kube-api-access-l6vcx\") pod \"network-check-source-7d88cb55d8-5mbkm\" (UID: \"7fdbee91-bebc-42cb-8081-332d5c1e4b7e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5mbkm"
Jul 29 21:07:39.623461 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.623422    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-snapshots\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.623595 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.623475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.623595 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.623542    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-service-ca-bundle\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.623595 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.623571    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-serving-cert\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.623595 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.623586    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-tmp\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.623821 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.623609    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skj4q\" (UniqueName: \"kubernetes.io/projected/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-kube-api-access-skj4q\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.624106 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.624078    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-service-ca-bundle\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.624181 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.624124    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-tmp\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.624181 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.624123    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-snapshots\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.624338 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.624315    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.625634 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.625613    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-serving-cert\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.631772 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.631721    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skj4q\" (UniqueName: \"kubernetes.io/projected/28d35bea-1e86-45a5-99f2-1cd1e51dbfed-kube-api-access-skj4q\") pod \"insights-operator-5885fdb759-smtxx\" (UID: \"28d35bea-1e86-45a5-99f2-1cd1e51dbfed\") " pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.667670 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.667641    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:39.704792 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.704769    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d8mb5"
Jul 29 21:07:39.709518 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.709503    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5mbkm"
Jul 29 21:07:39.770629 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.770598    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:39.794741 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.794717    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-smtxx"
Jul 29 21:07:39.834860 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.834595    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d8mb5"]
Jul 29 21:07:39.837412 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:07:39.837385    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb7b007_164f_4a96_bdf8_bb56016fdccf.slice/crio-679b092385ade06572b0d2c47aca652a065901912a5da7d79816a52a2ef761e6 WatchSource:0}: Error finding container 679b092385ade06572b0d2c47aca652a065901912a5da7d79816a52a2ef761e6: Status 404 returned error can't find the container with id 679b092385ade06572b0d2c47aca652a065901912a5da7d79816a52a2ef761e6
Jul 29 21:07:39.851324 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.851245    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-5mbkm"]
Jul 29 21:07:39.854871 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:07:39.854847    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fdbee91_bebc_42cb_8081_332d5c1e4b7e.slice/crio-eaf9acea7bbec158d295010d0671967baaf9830fde0c9eec2fed0b30c4bbd1c6 WatchSource:0}: Error finding container eaf9acea7bbec158d295010d0671967baaf9830fde0c9eec2fed0b30c4bbd1c6: Status 404 returned error can't find the container with id eaf9acea7bbec158d295010d0671967baaf9830fde0c9eec2fed0b30c4bbd1c6
Jul 29 21:07:39.920633 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:39.920610    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-smtxx"]
Jul 29 21:07:39.923339 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:07:39.923313    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28d35bea_1e86_45a5_99f2_1cd1e51dbfed.slice/crio-99f56f8cf34ff91fbc19f172b4b4a01a6ddcb02895df45be7b63de8519da6b3d WatchSource:0}: Error finding container 99f56f8cf34ff91fbc19f172b4b4a01a6ddcb02895df45be7b63de8519da6b3d: Status 404 returned error can't find the container with id 99f56f8cf34ff91fbc19f172b4b4a01a6ddcb02895df45be7b63de8519da6b3d
Jul 29 21:07:40.027074 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:40.027035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdw9d\" (UID: \"c69f337b-af28-45b8-aed8-7c3be7ac0755\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:07:40.027216 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:40.027102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f86fh\" (UID: \"064c1131-16b4-4e00-8f45-22c402fadf9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh"
Jul 29 21:07:40.027216 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:40.027178    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 21:07:40.027314 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:40.027233    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 21:07:40.027314 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:40.027248    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls podName:c69f337b-af28-45b8-aed8-7c3be7ac0755 nodeName:}" failed. No retries permitted until 2026-07-29 21:07:41.027231728 +0000 UTC m=+253.032755075 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-kdw9d" (UID: "c69f337b-af28-45b8-aed8-7c3be7ac0755") : secret "cluster-monitoring-operator-tls" not found
Jul 29 21:07:40.027314 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:40.027280    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls podName:064c1131-16b4-4e00-8f45-22c402fadf9d nodeName:}" failed. No retries permitted until 2026-07-29 21:07:41.027266923 +0000 UTC m=+253.032790269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls") pod "cluster-samples-operator-6748489656-f86fh" (UID: "064c1131-16b4-4e00-8f45-22c402fadf9d") : secret "samples-operator-tls" not found
Jul 29 21:07:40.123069 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:40.123032    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5mbkm" event={"ID":"7fdbee91-bebc-42cb-8081-332d5c1e4b7e","Type":"ContainerStarted","Data":"c27c5b6eeb7df72d59601436714322c1796f59006ff4941f12697c19bf0f3974"}
Jul 29 21:07:40.123404 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:40.123099    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5mbkm" event={"ID":"7fdbee91-bebc-42cb-8081-332d5c1e4b7e","Type":"ContainerStarted","Data":"eaf9acea7bbec158d295010d0671967baaf9830fde0c9eec2fed0b30c4bbd1c6"}
Jul 29 21:07:40.124267 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:40.124240    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-smtxx" event={"ID":"28d35bea-1e86-45a5-99f2-1cd1e51dbfed","Type":"ContainerStarted","Data":"99f56f8cf34ff91fbc19f172b4b4a01a6ddcb02895df45be7b63de8519da6b3d"}
Jul 29 21:07:40.125282 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:40.125257    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d8mb5" event={"ID":"3bb7b007-164f-4a96-bdf8-bb56016fdccf","Type":"ContainerStarted","Data":"679b092385ade06572b0d2c47aca652a065901912a5da7d79816a52a2ef761e6"}
Jul 29 21:07:40.139954 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:40.139912    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5mbkm" podStartSLOduration=1.139899982 podStartE2EDuration="1.139899982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:07:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:07:40.138872788 +0000 UTC m=+252.144396157" watchObservedRunningTime="2026-07-29 21:07:40.139899982 +0000 UTC m=+252.145423350"
Jul 29 21:07:40.228857 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:40.228756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs\") pod \"network-metrics-daemon-4wwgl\" (UID: \"ff9a3f79-f4da-491d-abb3-8acc9ff17877\") " pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:07:40.229034 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:40.228887    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 21:07:40.229034 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:40.228946    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs podName:ff9a3f79-f4da-491d-abb3-8acc9ff17877 nodeName:}" failed. No retries permitted until 2026-07-29 21:09:42.228932874 +0000 UTC m=+374.234456224 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs") pod "network-metrics-daemon-4wwgl" (UID: "ff9a3f79-f4da-491d-abb3-8acc9ff17877") : secret "metrics-daemon-secret" not found
Jul 29 21:07:41.034799 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:41.034756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f86fh\" (UID: \"064c1131-16b4-4e00-8f45-22c402fadf9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh"
Jul 29 21:07:41.035264 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:41.034984    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 21:07:41.035264 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:41.035023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdw9d\" (UID: \"c69f337b-af28-45b8-aed8-7c3be7ac0755\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:07:41.035264 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:41.035057    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls podName:064c1131-16b4-4e00-8f45-22c402fadf9d nodeName:}" failed. No retries permitted until 2026-07-29 21:07:43.035035628 +0000 UTC m=+255.040558974 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls") pod "cluster-samples-operator-6748489656-f86fh" (UID: "064c1131-16b4-4e00-8f45-22c402fadf9d") : secret "samples-operator-tls" not found
Jul 29 21:07:41.035264 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:41.035131    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 21:07:41.035264 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:41.035193    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls podName:c69f337b-af28-45b8-aed8-7c3be7ac0755 nodeName:}" failed. No retries permitted until 2026-07-29 21:07:43.035173714 +0000 UTC m=+255.040697067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-kdw9d" (UID: "c69f337b-af28-45b8-aed8-7c3be7ac0755") : secret "cluster-monitoring-operator-tls" not found
Jul 29 21:07:42.133195 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:42.133149    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d8mb5" event={"ID":"3bb7b007-164f-4a96-bdf8-bb56016fdccf","Type":"ContainerStarted","Data":"e05f7e034aff4242c9a4ef340e0636b32c835b1915d574e8547f6daf9b5798d3"}
Jul 29 21:07:42.149761 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:42.149716    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d8mb5" podStartSLOduration=1.816195161 podStartE2EDuration="3.149699836s" totalImagesPullingTime="1.333504675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:07:42.148952371 +0000 UTC m=+254.154475739" watchObservedRunningTime="2026-07-29 21:07:42.149699836 +0000 UTC m=+254.155223204"
Jul 29 21:07:42.232712 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:42.232680    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:43.052066 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.052035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdw9d\" (UID: \"c69f337b-af28-45b8-aed8-7c3be7ac0755\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:07:43.052225 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.052082    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f86fh\" (UID: \"064c1131-16b4-4e00-8f45-22c402fadf9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh"
Jul 29 21:07:43.052225 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:43.052189    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 21:07:43.052295 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:43.052226    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 21:07:43.052295 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:43.052256    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls podName:c69f337b-af28-45b8-aed8-7c3be7ac0755 nodeName:}" failed. No retries permitted until 2026-07-29 21:07:47.052241176 +0000 UTC m=+259.057764523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-kdw9d" (UID: "c69f337b-af28-45b8-aed8-7c3be7ac0755") : secret "cluster-monitoring-operator-tls" not found
Jul 29 21:07:43.052295 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:43.052270    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls podName:064c1131-16b4-4e00-8f45-22c402fadf9d nodeName:}" failed. No retries permitted until 2026-07-29 21:07:47.052264389 +0000 UTC m=+259.057787735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls") pod "cluster-samples-operator-6748489656-f86fh" (UID: "064c1131-16b4-4e00-8f45-22c402fadf9d") : secret "samples-operator-tls" not found
Jul 29 21:07:43.143913 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.143880    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-smtxx" event={"ID":"28d35bea-1e86-45a5-99f2-1cd1e51dbfed","Type":"ContainerStarted","Data":"edaed1abff2268ac4b0ef0d65d5c6ad3d5ce6f843b35b1f18a5ae7ef38aefd73"}
Jul 29 21:07:43.161206 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.161160    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-smtxx" podStartSLOduration=1.773547616 podStartE2EDuration="4.161144651s" totalImagesPullingTime="2.387597035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:07:43.160604374 +0000 UTC m=+255.166127741" watchObservedRunningTime="2026-07-29 21:07:43.161144651 +0000 UTC m=+255.166668018"
Jul 29 21:07:43.325401 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.325304    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hpz5z"]
Jul 29 21:07:43.327716 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.327700    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:43.331883 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.331862    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 21:07:43.331994 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.331899    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 21:07:43.332156 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.332139    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qz6qg\""
Jul 29 21:07:43.340907 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.340885    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hpz5z"]
Jul 29 21:07:43.356164 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.356135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:43.356264 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.356178    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0298cd0-9c41-44cb-80ce-a8a2665ad445-crio-socket\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:43.356264 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.356225    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0298cd0-9c41-44cb-80ce-a8a2665ad445-data-volume\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:43.356264 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.356247    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:43.356381 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.356268    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psj49\" (UniqueName: \"kubernetes.io/projected/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-api-access-psj49\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:43.364671 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.364650    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:43.419627 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.419601    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:43.456711 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.456689    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0298cd0-9c41-44cb-80ce-a8a2665ad445-crio-socket\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:43.456808 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.456733    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0298cd0-9c41-44cb-80ce-a8a2665ad445-data-volume\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:43.456808 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.456751    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:43.456910 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:43.456807    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 21:07:43.456910 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.456814    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0298cd0-9c41-44cb-80ce-a8a2665ad445-crio-socket\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:43.456910 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.456829    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psj49\" (UniqueName: \"kubernetes.io/projected/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-api-access-psj49\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:43.456910 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:43.456866    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm podName:a0298cd0-9c41-44cb-80ce-a8a2665ad445 nodeName:}" failed. No retries permitted until 2026-07-29 21:07:43.956850648 +0000 UTC m=+255.962374006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hpz5z" (UID: "a0298cd0-9c41-44cb-80ce-a8a2665ad445") : configmap "kube-rbac-proxy" not found
Jul 29 21:07:43.457040 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.456964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:43.457078 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.457037    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0298cd0-9c41-44cb-80ce-a8a2665ad445-data-volume\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:43.457078 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:43.457053    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 21:07:43.457142 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:43.457085    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls podName:a0298cd0-9c41-44cb-80ce-a8a2665ad445 nodeName:}" failed. No retries permitted until 2026-07-29 21:07:43.957077431 +0000 UTC m=+255.962600778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hpz5z" (UID: "a0298cd0-9c41-44cb-80ce-a8a2665ad445") : secret "insights-runtime-extractor-tls" not found
Jul 29 21:07:43.467281 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.467258    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psj49\" (UniqueName: \"kubernetes.io/projected/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-api-access-psj49\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:43.960575 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.960537    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:43.960738 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:43.960609    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:43.960738 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:43.960695    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 21:07:43.960738 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:43.960727    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 21:07:43.960837 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:43.960769    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls podName:a0298cd0-9c41-44cb-80ce-a8a2665ad445 nodeName:}" failed. No retries permitted until 2026-07-29 21:07:44.960752723 +0000 UTC m=+256.966276083 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hpz5z" (UID: "a0298cd0-9c41-44cb-80ce-a8a2665ad445") : secret "insights-runtime-extractor-tls" not found
Jul 29 21:07:43.960837 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:43.960790    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm podName:a0298cd0-9c41-44cb-80ce-a8a2665ad445 nodeName:}" failed. No retries permitted until 2026-07-29 21:07:44.960776044 +0000 UTC m=+256.966299391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hpz5z" (UID: "a0298cd0-9c41-44cb-80ce-a8a2665ad445") : configmap "kube-rbac-proxy" not found
Jul 29 21:07:44.226272 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.226188    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:44.257668 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.257639    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-xknth"]
Jul 29 21:07:44.259798 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.259778    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xknth"
Jul 29 21:07:44.262460 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.262414    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 29 21:07:44.262575 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.262422    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lxvv7\""
Jul 29 21:07:44.262575 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.262462    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 29 21:07:44.268831 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.268802    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-xknth"]
Jul 29 21:07:44.322005 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.321973    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:44.364029 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.364003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctpv6\" (UniqueName: \"kubernetes.io/projected/579b63d3-9205-49b5-8f5c-8eb6f4c22bbb-kube-api-access-ctpv6\") pod \"migrator-6865c9967-xknth\" (UID: \"579b63d3-9205-49b5-8f5c-8eb6f4c22bbb\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xknth"
Jul 29 21:07:44.422767 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.422739    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:44.464474 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.464432    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctpv6\" (UniqueName: \"kubernetes.io/projected/579b63d3-9205-49b5-8f5c-8eb6f4c22bbb-kube-api-access-ctpv6\") pod \"migrator-6865c9967-xknth\" (UID: \"579b63d3-9205-49b5-8f5c-8eb6f4c22bbb\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xknth"
Jul 29 21:07:44.473241 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.473214    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctpv6\" (UniqueName: \"kubernetes.io/projected/579b63d3-9205-49b5-8f5c-8eb6f4c22bbb-kube-api-access-ctpv6\") pod \"migrator-6865c9967-xknth\" (UID: \"579b63d3-9205-49b5-8f5c-8eb6f4c22bbb\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xknth"
Jul 29 21:07:44.497185 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.497121    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:44.557871 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.557846    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:44.568907 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.568888    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xknth"
Jul 29 21:07:44.686517 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.686495    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-xknth"]
Jul 29 21:07:44.688652 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:07:44.688626    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod579b63d3_9205_49b5_8f5c_8eb6f4c22bbb.slice/crio-46e0cddda0cb055b45ba20eca23d45a66e39e1d2b23f67745260bb31a113d9aa WatchSource:0}: Error finding container 46e0cddda0cb055b45ba20eca23d45a66e39e1d2b23f67745260bb31a113d9aa: Status 404 returned error can't find the container with id 46e0cddda0cb055b45ba20eca23d45a66e39e1d2b23f67745260bb31a113d9aa
Jul 29 21:07:44.968573 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.968542    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:44.968755 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:44.968598    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:44.968755 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:44.968693    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 21:07:44.968755 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:44.968753    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls podName:a0298cd0-9c41-44cb-80ce-a8a2665ad445 nodeName:}" failed. No retries permitted until 2026-07-29 21:07:46.968738005 +0000 UTC m=+258.974261364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hpz5z" (UID: "a0298cd0-9c41-44cb-80ce-a8a2665ad445") : secret "insights-runtime-extractor-tls" not found
Jul 29 21:07:44.968879 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:44.968700    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 21:07:44.968879 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:44.968830    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm podName:a0298cd0-9c41-44cb-80ce-a8a2665ad445 nodeName:}" failed. No retries permitted until 2026-07-29 21:07:46.968814101 +0000 UTC m=+258.974337448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hpz5z" (UID: "a0298cd0-9c41-44cb-80ce-a8a2665ad445") : configmap "kube-rbac-proxy" not found
Jul 29 21:07:45.104430 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:45.104398    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5kmcr_78fa3b29-d371-437e-ab96-47269879af94/dns-node-resolver/0.log"
Jul 29 21:07:45.152482 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:45.152436    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xknth" event={"ID":"579b63d3-9205-49b5-8f5c-8eb6f4c22bbb","Type":"ContainerStarted","Data":"46e0cddda0cb055b45ba20eca23d45a66e39e1d2b23f67745260bb31a113d9aa"}
Jul 29 21:07:45.182809 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:45.182783    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:45.281024 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:45.280951    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:46.160483 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.159115    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xknth" event={"ID":"579b63d3-9205-49b5-8f5c-8eb6f4c22bbb","Type":"ContainerStarted","Data":"6a880d78174321c2af1d244a4d476a6fc694676b729247f26413190c9fa20ed2"}
Jul 29 21:07:46.160483 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.159231    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xknth" event={"ID":"579b63d3-9205-49b5-8f5c-8eb6f4c22bbb","Type":"ContainerStarted","Data":"f089a38954b41cc31199c0f0ca0424ac0ea0acb5c1264107225ebb8ccdd1a170"}
Jul 29 21:07:46.303425 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.303404    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-696n2_df3cf440-cfee-44f5-b194-82f00a6a4c44/node-ca/0.log"
Jul 29 21:07:46.318914 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.318889    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:46.378212 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.378183    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:46.778215 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.778116    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xknth" podStartSLOduration=1.512837653 podStartE2EDuration="2.778096752s" totalImagesPullingTime="1.265259099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:07:46.200577745 +0000 UTC m=+258.206101113" watchObservedRunningTime="2026-07-29 21:07:46.778096752 +0000 UTC m=+258.783620175"
Jul 29 21:07:46.778361 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.778228    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-n8rhf"]
Jul 29 21:07:46.781015 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.781000    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-n8rhf"
Jul 29 21:07:46.784023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.784001    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-sq4nd\""
Jul 29 21:07:46.784153 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.784047    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 29 21:07:46.785187 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.785171    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 29 21:07:46.785391 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.785375    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 29 21:07:46.785487 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.785385    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 29 21:07:46.789203 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.789183    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-n8rhf"]
Jul 29 21:07:46.812974 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.812946    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:46.884288 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.884258    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/701ef465-be22-4f6f-93ef-9abb98d01171-signing-cabundle\") pod \"service-ca-658d7b7c78-n8rhf\" (UID: \"701ef465-be22-4f6f-93ef-9abb98d01171\") " pod="openshift-service-ca/service-ca-658d7b7c78-n8rhf"
Jul 29 21:07:46.884413 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.884395    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/701ef465-be22-4f6f-93ef-9abb98d01171-signing-key\") pod \"service-ca-658d7b7c78-n8rhf\" (UID: \"701ef465-be22-4f6f-93ef-9abb98d01171\") " pod="openshift-service-ca/service-ca-658d7b7c78-n8rhf"
Jul 29 21:07:46.884506 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.884426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs49h\" (UniqueName: \"kubernetes.io/projected/701ef465-be22-4f6f-93ef-9abb98d01171-kube-api-access-qs49h\") pod \"service-ca-658d7b7c78-n8rhf\" (UID: \"701ef465-be22-4f6f-93ef-9abb98d01171\") " pod="openshift-service-ca/service-ca-658d7b7c78-n8rhf"
Jul 29 21:07:46.903665 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.903643    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8xb9c_ce278890-ad21-445b-adb0-27a807a79f86/serve-healthcheck-canary/0.log"
Jul 29 21:07:46.954813 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.954787    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:46.985687 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.985664    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:46.985758 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.985705    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/701ef465-be22-4f6f-93ef-9abb98d01171-signing-key\") pod \"service-ca-658d7b7c78-n8rhf\" (UID: \"701ef465-be22-4f6f-93ef-9abb98d01171\") " pod="openshift-service-ca/service-ca-658d7b7c78-n8rhf"
Jul 29 21:07:46.985758 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.985723    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs49h\" (UniqueName: \"kubernetes.io/projected/701ef465-be22-4f6f-93ef-9abb98d01171-kube-api-access-qs49h\") pod \"service-ca-658d7b7c78-n8rhf\" (UID: \"701ef465-be22-4f6f-93ef-9abb98d01171\") " pod="openshift-service-ca/service-ca-658d7b7c78-n8rhf"
Jul 29 21:07:46.985829 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:46.985799    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 21:07:46.985874 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.985848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:46.985874 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:46.985863    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls podName:a0298cd0-9c41-44cb-80ce-a8a2665ad445 nodeName:}" failed. No retries permitted until 2026-07-29 21:07:50.985849601 +0000 UTC m=+262.991372946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hpz5z" (UID: "a0298cd0-9c41-44cb-80ce-a8a2665ad445") : secret "insights-runtime-extractor-tls" not found
Jul 29 21:07:46.985965 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.985943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/701ef465-be22-4f6f-93ef-9abb98d01171-signing-cabundle\") pod \"service-ca-658d7b7c78-n8rhf\" (UID: \"701ef465-be22-4f6f-93ef-9abb98d01171\") " pod="openshift-service-ca/service-ca-658d7b7c78-n8rhf"
Jul 29 21:07:46.986009 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:46.985963    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 21:07:46.986045 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:46.986016    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm podName:a0298cd0-9c41-44cb-80ce-a8a2665ad445 nodeName:}" failed. No retries permitted until 2026-07-29 21:07:50.986003239 +0000 UTC m=+262.991526600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hpz5z" (UID: "a0298cd0-9c41-44cb-80ce-a8a2665ad445") : configmap "kube-rbac-proxy" not found
Jul 29 21:07:46.986536 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.986518    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/701ef465-be22-4f6f-93ef-9abb98d01171-signing-cabundle\") pod \"service-ca-658d7b7c78-n8rhf\" (UID: \"701ef465-be22-4f6f-93ef-9abb98d01171\") " pod="openshift-service-ca/service-ca-658d7b7c78-n8rhf"
Jul 29 21:07:46.988142 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.988108    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/701ef465-be22-4f6f-93ef-9abb98d01171-signing-key\") pod \"service-ca-658d7b7c78-n8rhf\" (UID: \"701ef465-be22-4f6f-93ef-9abb98d01171\") " pod="openshift-service-ca/service-ca-658d7b7c78-n8rhf"
Jul 29 21:07:46.993947 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:46.993920    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs49h\" (UniqueName: \"kubernetes.io/projected/701ef465-be22-4f6f-93ef-9abb98d01171-kube-api-access-qs49h\") pod \"service-ca-658d7b7c78-n8rhf\" (UID: \"701ef465-be22-4f6f-93ef-9abb98d01171\") " pod="openshift-service-ca/service-ca-658d7b7c78-n8rhf"
Jul 29 21:07:47.087063 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:47.087032    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f86fh\" (UID: \"064c1131-16b4-4e00-8f45-22c402fadf9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh"
Jul 29 21:07:47.087196 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:47.087161    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdw9d\" (UID: \"c69f337b-af28-45b8-aed8-7c3be7ac0755\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:07:47.087196 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:47.087167    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 21:07:47.087334 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:47.087223    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls podName:064c1131-16b4-4e00-8f45-22c402fadf9d nodeName:}" failed. No retries permitted until 2026-07-29 21:07:55.087205799 +0000 UTC m=+267.092729145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls") pod "cluster-samples-operator-6748489656-f86fh" (UID: "064c1131-16b4-4e00-8f45-22c402fadf9d") : secret "samples-operator-tls" not found
Jul 29 21:07:47.087334 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:47.087282    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 21:07:47.087440 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:47.087385    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls podName:c69f337b-af28-45b8-aed8-7c3be7ac0755 nodeName:}" failed. No retries permitted until 2026-07-29 21:07:55.087368407 +0000 UTC m=+267.092891757 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-kdw9d" (UID: "c69f337b-af28-45b8-aed8-7c3be7ac0755") : secret "cluster-monitoring-operator-tls" not found
Jul 29 21:07:47.090012 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:47.089994    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-n8rhf"
Jul 29 21:07:47.210306 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:47.210274    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-n8rhf"]
Jul 29 21:07:47.212783 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:07:47.212752    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod701ef465_be22_4f6f_93ef_9abb98d01171.slice/crio-ccb3c3f7e2ed4ece0edb52911d9eac36c16b0c17b8111e8ed144279ab7b74a27 WatchSource:0}: Error finding container ccb3c3f7e2ed4ece0edb52911d9eac36c16b0c17b8111e8ed144279ab7b74a27: Status 404 returned error can't find the container with id ccb3c3f7e2ed4ece0edb52911d9eac36c16b0c17b8111e8ed144279ab7b74a27
Jul 29 21:07:47.707524 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:47.707484    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:48.166152 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:48.166110    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-n8rhf" event={"ID":"701ef465-be22-4f6f-93ef-9abb98d01171","Type":"ContainerStarted","Data":"ccb3c3f7e2ed4ece0edb52911d9eac36c16b0c17b8111e8ed144279ab7b74a27"}
Jul 29 21:07:49.170386 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:49.170350    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-n8rhf" event={"ID":"701ef465-be22-4f6f-93ef-9abb98d01171","Type":"ContainerStarted","Data":"60ea04f1e1f6067826b3bb055b4dcbb194127707088c386b10cb3e0f2c8d0d50"}
Jul 29 21:07:49.186569 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:49.186523    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-n8rhf" podStartSLOduration=1.3121162800000001 podStartE2EDuration="3.186503484s" totalImagesPullingTime="1.874387204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:07:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:07:49.186355409 +0000 UTC m=+261.191878779" watchObservedRunningTime="2026-07-29 21:07:49.186503484 +0000 UTC m=+261.192026851"
Jul 29 21:07:50.226963 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:50.226873    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:50.397044 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:50.397002    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:50.536270 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:50.536167    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:50.671652 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:50.671617    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:50.862391 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:50.862360    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:50.965679 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:50.965640    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:51.026630 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:51.026590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:51.026805 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:51.026736    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 21:07:51.026805 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:51.026753    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:51.026805 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:51.026805    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls podName:a0298cd0-9c41-44cb-80ce-a8a2665ad445 nodeName:}" failed. No retries permitted until 2026-07-29 21:07:59.026789674 +0000 UTC m=+271.032313043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hpz5z" (UID: "a0298cd0-9c41-44cb-80ce-a8a2665ad445") : secret "insights-runtime-extractor-tls" not found
Jul 29 21:07:51.026948 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:51.026832    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 21:07:51.026948 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:51.026904    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm podName:a0298cd0-9c41-44cb-80ce-a8a2665ad445 nodeName:}" failed. No retries permitted until 2026-07-29 21:07:59.026886798 +0000 UTC m=+271.032410144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hpz5z" (UID: "a0298cd0-9c41-44cb-80ce-a8a2665ad445") : configmap "kube-rbac-proxy" not found
Jul 29 21:07:51.070872 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:51.070843    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:51.170805 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:51.170730    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:52.110330 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:52.110294    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:52.501209 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:52.501133    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:52.706354 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:52.706322    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:52.901374 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:52.901343    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:53.107869 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:53.107819    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:53.848316 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:53.848259    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:54.107801 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:54.107696    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:54.334415 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:54.334377    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:54.425541 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:54.425471    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:54.515352 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:54.515324    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:54.704044 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:54.703963    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:54.931827 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:54.931798    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:55.105348 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:55.105315    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:55.161592 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:55.161561    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdw9d\" (UID: \"c69f337b-af28-45b8-aed8-7c3be7ac0755\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:07:55.161718 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:55.161632    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f86fh\" (UID: \"064c1131-16b4-4e00-8f45-22c402fadf9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh"
Jul 29 21:07:55.161774 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:55.161720    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 21:07:55.161838 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:55.161798    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls podName:c69f337b-af28-45b8-aed8-7c3be7ac0755 nodeName:}" failed. No retries permitted until 2026-07-29 21:08:11.161777635 +0000 UTC m=+283.167300982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-kdw9d" (UID: "c69f337b-af28-45b8-aed8-7c3be7ac0755") : secret "cluster-monitoring-operator-tls" not found
Jul 29 21:07:55.164110 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:55.164080    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/064c1131-16b4-4e00-8f45-22c402fadf9d-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f86fh\" (UID: \"064c1131-16b4-4e00-8f45-22c402fadf9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh"
Jul 29 21:07:55.292495 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:55.292470    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh"
Jul 29 21:07:55.416839 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:55.416814    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh"]
Jul 29 21:07:55.975278 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:55.975239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:56.194128 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:56.194089    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh" event={"ID":"064c1131-16b4-4e00-8f45-22c402fadf9d","Type":"ContainerStarted","Data":"bb52c5430ff2fe1712b32e172fef6108fce1ae5006d194e47d931ba961634e4f"}
Jul 29 21:07:56.301418 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:56.301386    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:56.494948 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:56.494917    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:56.609775 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:56.609673    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:56.899276 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:56.899196    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:56.999517 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:56.999484    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:57.498037 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:57.497921    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:58.093669 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:58.093632    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:58.201725 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:58.201693    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh" event={"ID":"064c1131-16b4-4e00-8f45-22c402fadf9d","Type":"ContainerStarted","Data":"829c50321dc8f1665fd580d7000e900f16ce58900786d23617a130180a8476a4"}
Jul 29 21:07:58.201880 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:58.201766    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh" event={"ID":"064c1131-16b4-4e00-8f45-22c402fadf9d","Type":"ContainerStarted","Data":"6132778ef21e3f04af77c6cb86f3dce8a8fb9436f93fc15e688b56a992ff28bd"}
Jul 29 21:07:58.218648 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:58.218605    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f86fh" podStartSLOduration=17.317996623 podStartE2EDuration="19.218590586s" totalImagesPullingTime="1.900593963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:07:58.217593437 +0000 UTC m=+270.223116807" watchObservedRunningTime="2026-07-29 21:07:58.218590586 +0000 UTC m=+270.224113994"
Jul 29 21:07:58.298615 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:58.298566    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:58.709990 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:58.709934    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:58.937662 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:58.937609    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:59.093966 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:59.093929    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:59.094401 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:59.093982    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:59.094401 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:59.094105    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 21:07:59.094401 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:07:59.094183    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls podName:a0298cd0-9c41-44cb-80ce-a8a2665ad445 nodeName:}" failed. No retries permitted until 2026-07-29 21:08:15.094161937 +0000 UTC m=+287.099685297 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hpz5z" (UID: "a0298cd0-9c41-44cb-80ce-a8a2665ad445") : secret "insights-runtime-extractor-tls" not found
Jul 29 21:07:59.094401 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:59.094399    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0298cd0-9c41-44cb-80ce-a8a2665ad445-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:07:59.298392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:59.298359    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:07:59.892634 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:07:59.892598    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:00.494424 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:00.494378    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:00.739433 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:00.739395    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:00.893776 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:00.893741    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:01.097112 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:01.097076    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:01.904614 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:01.904582    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:01.973903 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:01.973868    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:05.318192 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:05.318154    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:05.378767 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:05.378723    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:06.133329 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:06.133277    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:06.233700 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:06.233668    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:10.914035 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:08:10.913997    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm" podUID="fb657a40-9774-42ab-974f-2ff4345acc3c"
Jul 29 21:08:10.914035 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:08:10.913999    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt" podUID="86593cfc-07e7-476a-921d-85ed51cedccc"
Jul 29 21:08:10.914617 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:08:10.913997    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-l42z5" podUID="163ef3df-3eb2-44e3-ad92-0665dbe66343"
Jul 29 21:08:11.190930 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:11.190847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdw9d\" (UID: \"c69f337b-af28-45b8-aed8-7c3be7ac0755\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:08:11.193218 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:11.193197    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c69f337b-af28-45b8-aed8-7c3be7ac0755-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdw9d\" (UID: \"c69f337b-af28-45b8-aed8-7c3be7ac0755\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:08:11.198102 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:11.198084    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"
Jul 29 21:08:11.238319 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:11.238293    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:08:11.238410 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:11.238293    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l42z5"
Jul 29 21:08:11.238474 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:11.238293    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:08:11.364240 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:11.364212    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d"]
Jul 29 21:08:11.369705 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:08:11.369677    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69f337b_af28_45b8_aed8_7c3be7ac0755.slice/crio-5980702ed9a3bb9d54aeef2dab97379ee24bd09ff19a65c57d721ca471abada5 WatchSource:0}: Error finding container 5980702ed9a3bb9d54aeef2dab97379ee24bd09ff19a65c57d721ca471abada5: Status 404 returned error can't find the container with id 5980702ed9a3bb9d54aeef2dab97379ee24bd09ff19a65c57d721ca471abada5
Jul 29 21:08:12.242462 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:12.242417    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d" event={"ID":"c69f337b-af28-45b8-aed8-7c3be7ac0755","Type":"ContainerStarted","Data":"5980702ed9a3bb9d54aeef2dab97379ee24bd09ff19a65c57d721ca471abada5"}
Jul 29 21:08:13.247965 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.247922    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d" event={"ID":"c69f337b-af28-45b8-aed8-7c3be7ac0755","Type":"ContainerStarted","Data":"e41d1f5153a8233780abdea5e48f1ec5d4e187509ca0408cf71083d3ff6238da"}
Jul 29 21:08:13.264799 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.264749    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdw9d" podStartSLOduration=32.536971008 podStartE2EDuration="34.264730514s" totalImagesPullingTime="1.727759506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:08:13.263926597 +0000 UTC m=+285.269449966" watchObservedRunningTime="2026-07-29 21:08:13.264730514 +0000 UTC m=+285.270253886"
Jul 29 21:08:13.405930 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.405845    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:13.503116 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.503078    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:13.557906 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.557878    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55ndz"]
Jul 29 21:08:13.559973 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.559952    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55ndz"
Jul 29 21:08:13.562588 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.562567    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-l4kfb\""
Jul 29 21:08:13.562682 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.562605    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 29 21:08:13.571686 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.571665    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55ndz"]
Jul 29 21:08:13.579256 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.579231    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:13.712383 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.712297    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/354becda-fc82-4cf6-8169-bf5ec03d4ee1-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-55ndz\" (UID: \"354becda-fc82-4cf6-8169-bf5ec03d4ee1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55ndz"
Jul 29 21:08:13.812932 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.812898    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/354becda-fc82-4cf6-8169-bf5ec03d4ee1-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-55ndz\" (UID: \"354becda-fc82-4cf6-8169-bf5ec03d4ee1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55ndz"
Jul 29 21:08:13.813063 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:08:13.813008    2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 21:08:13.813109 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:08:13.813068    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354becda-fc82-4cf6-8169-bf5ec03d4ee1-tls-certificates podName:354becda-fc82-4cf6-8169-bf5ec03d4ee1 nodeName:}" failed. No retries permitted until 2026-07-29 21:08:14.313054779 +0000 UTC m=+286.318578125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/354becda-fc82-4cf6-8169-bf5ec03d4ee1-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-55ndz" (UID: "354becda-fc82-4cf6-8169-bf5ec03d4ee1") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 21:08:13.913867 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.913835    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9sxm\" (UID: \"fb657a40-9774-42ab-974f-2ff4345acc3c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:08:13.913996 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.913894    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:08:13.916353 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.916327    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb657a40-9774-42ab-974f-2ff4345acc3c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9sxm\" (UID: \"fb657a40-9774-42ab-974f-2ff4345acc3c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:08:13.916470 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.916434    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls\") pod \"image-registry-7687fddd6d-dvwnt\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") " pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:08:13.942184 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.942158    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jkhlj\""
Jul 29 21:08:13.942284 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.942246    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n9ncd\""
Jul 29 21:08:13.950344 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.950326    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"
Jul 29 21:08:13.950426 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:13.950350    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:08:14.015308 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.014788    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:08:14.022875 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.022817    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/163ef3df-3eb2-44e3-ad92-0665dbe66343-metrics-tls\") pod \"dns-default-l42z5\" (UID: \"163ef3df-3eb2-44e3-ad92-0665dbe66343\") " pod="openshift-dns/dns-default-l42z5"
Jul 29 21:08:14.093326 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.093294    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm"]
Jul 29 21:08:14.096030 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:08:14.096005    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb657a40_9774_42ab_974f_2ff4345acc3c.slice/crio-526a5496c68843915b1206c8dbeac97ab51d6e737cb0374cd7f02f9fb2ba71be WatchSource:0}: Error finding container 526a5496c68843915b1206c8dbeac97ab51d6e737cb0374cd7f02f9fb2ba71be: Status 404 returned error can't find the container with id 526a5496c68843915b1206c8dbeac97ab51d6e737cb0374cd7f02f9fb2ba71be
Jul 29 21:08:14.109517 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.109496    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7687fddd6d-dvwnt"]
Jul 29 21:08:14.110708 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.110680    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:14.111834 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:08:14.111804    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86593cfc_07e7_476a_921d_85ed51cedccc.slice/crio-1109b7a7f0b3b83730f53ff5b8ad7a991c65dc94bbfc1bc9ee9a4c7ba6c94cc0 WatchSource:0}: Error finding container 1109b7a7f0b3b83730f53ff5b8ad7a991c65dc94bbfc1bc9ee9a4c7ba6c94cc0: Status 404 returned error can't find the container with id 1109b7a7f0b3b83730f53ff5b8ad7a991c65dc94bbfc1bc9ee9a4c7ba6c94cc0
Jul 29 21:08:14.242525 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.242429    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5hxhk\""
Jul 29 21:08:14.249760 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.249730    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l42z5"
Jul 29 21:08:14.253434 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.253399    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt" event={"ID":"86593cfc-07e7-476a-921d-85ed51cedccc","Type":"ContainerStarted","Data":"f0567a1f90cf9bc90df34cabfc94624566ed8c526b5f190db988273a8db0929a"}
Jul 29 21:08:14.253568 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.253519    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:08:14.253568 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.253549    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt" event={"ID":"86593cfc-07e7-476a-921d-85ed51cedccc","Type":"ContainerStarted","Data":"1109b7a7f0b3b83730f53ff5b8ad7a991c65dc94bbfc1bc9ee9a4c7ba6c94cc0"}
Jul 29 21:08:14.254573 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.254549    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm" event={"ID":"fb657a40-9774-42ab-974f-2ff4345acc3c","Type":"ContainerStarted","Data":"526a5496c68843915b1206c8dbeac97ab51d6e737cb0374cd7f02f9fb2ba71be"}
Jul 29 21:08:14.273889 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.273836    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt" podStartSLOduration=286.273820276 podStartE2EDuration="4m46.273820276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:03:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:08:14.27277921 +0000 UTC m=+286.278302579" watchObservedRunningTime="2026-07-29 21:08:14.273820276 +0000 UTC m=+286.279343645"
Jul 29 21:08:14.317297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.317255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/354becda-fc82-4cf6-8169-bf5ec03d4ee1-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-55ndz\" (UID: \"354becda-fc82-4cf6-8169-bf5ec03d4ee1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55ndz"
Jul 29 21:08:14.320461 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.320412    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/354becda-fc82-4cf6-8169-bf5ec03d4ee1-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-55ndz\" (UID: \"354becda-fc82-4cf6-8169-bf5ec03d4ee1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55ndz"
Jul 29 21:08:14.383859 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.383694    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l42z5"]
Jul 29 21:08:14.386220 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:08:14.386188    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod163ef3df_3eb2_44e3_ad92_0665dbe66343.slice/crio-511c10c490cb519b5b4f2c6b5fe1e4e31483f888a84f8e6562244a8c7288d697 WatchSource:0}: Error finding container 511c10c490cb519b5b4f2c6b5fe1e4e31483f888a84f8e6562244a8c7288d697: Status 404 returned error can't find the container with id 511c10c490cb519b5b4f2c6b5fe1e4e31483f888a84f8e6562244a8c7288d697
Jul 29 21:08:14.468792 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.468758    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55ndz"
Jul 29 21:08:14.592873 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:14.592835    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55ndz"]
Jul 29 21:08:14.595598 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:08:14.595572    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354becda_fc82_4cf6_8169_bf5ec03d4ee1.slice/crio-3c0a531d41c44f00e0e9ca029fbdd1943f316c82057c39bd3fdcb612732fed55 WatchSource:0}: Error finding container 3c0a531d41c44f00e0e9ca029fbdd1943f316c82057c39bd3fdcb612732fed55: Status 404 returned error can't find the container with id 3c0a531d41c44f00e0e9ca029fbdd1943f316c82057c39bd3fdcb612732fed55
Jul 29 21:08:15.126351 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:15.126302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:08:15.129386 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:15.129358    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0298cd0-9c41-44cb-80ce-a8a2665ad445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hpz5z\" (UID: \"a0298cd0-9c41-44cb-80ce-a8a2665ad445\") " pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:08:15.137237 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:15.137213    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hpz5z"
Jul 29 21:08:15.260791 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:15.260742    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55ndz" event={"ID":"354becda-fc82-4cf6-8169-bf5ec03d4ee1","Type":"ContainerStarted","Data":"3c0a531d41c44f00e0e9ca029fbdd1943f316c82057c39bd3fdcb612732fed55"}
Jul 29 21:08:15.262179 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:15.262138    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l42z5" event={"ID":"163ef3df-3eb2-44e3-ad92-0665dbe66343","Type":"ContainerStarted","Data":"511c10c490cb519b5b4f2c6b5fe1e4e31483f888a84f8e6562244a8c7288d697"}
Jul 29 21:08:15.525773 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:15.525742    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hpz5z"]
Jul 29 21:08:15.529242 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:08:15.529217    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0298cd0_9c41_44cb_80ce_a8a2665ad445.slice/crio-d31cb786eec3948a20d087a5c3a72e6b0b77442691916f120ff95d44f8f4c7a4 WatchSource:0}: Error finding container d31cb786eec3948a20d087a5c3a72e6b0b77442691916f120ff95d44f8f4c7a4: Status 404 returned error can't find the container with id d31cb786eec3948a20d087a5c3a72e6b0b77442691916f120ff95d44f8f4c7a4
Jul 29 21:08:16.270626 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:16.269934    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55ndz" event={"ID":"354becda-fc82-4cf6-8169-bf5ec03d4ee1","Type":"ContainerStarted","Data":"cb66323813c958f2478d2327223a58fe68ee75ad44495ce0536cc64068b85e56"}
Jul 29 21:08:16.270626 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:16.270388    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55ndz"
Jul 29 21:08:16.276170 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:16.276138    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm" event={"ID":"fb657a40-9774-42ab-974f-2ff4345acc3c","Type":"ContainerStarted","Data":"4c6bdd1a35481b9093724cc6bb4f37e060abc3412ec6784ece1d56eb9d5c7a6d"}
Jul 29 21:08:16.277545 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:16.277522    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55ndz"
Jul 29 21:08:16.278851 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:16.278828    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hpz5z" event={"ID":"a0298cd0-9c41-44cb-80ce-a8a2665ad445","Type":"ContainerStarted","Data":"d31cb786eec3948a20d087a5c3a72e6b0b77442691916f120ff95d44f8f4c7a4"}
Jul 29 21:08:16.288456 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:16.288400    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55ndz" podStartSLOduration=2.042347103 podStartE2EDuration="3.288385292s" totalImagesPullingTime="1.246038189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:08:16.287228762 +0000 UTC m=+288.292752131" watchObservedRunningTime="2026-07-29 21:08:16.288385292 +0000 UTC m=+288.293908651"
Jul 29 21:08:16.303342 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:16.303288    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9sxm" podStartSLOduration=279.998089328 podStartE2EDuration="4m41.303268972s" totalImagesPullingTime="1.305179644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:03:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:08:16.30220233 +0000 UTC m=+288.307725703" watchObservedRunningTime="2026-07-29 21:08:16.303268972 +0000 UTC m=+288.308792342"
Jul 29 21:08:16.411820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:16.411780    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:16.471150 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:16.471060    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:16.594462 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:16.594409    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:16.686922 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:16.686885    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:16.747248 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:16.747214    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:17.285576 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:17.285484    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l42z5" event={"ID":"163ef3df-3eb2-44e3-ad92-0665dbe66343","Type":"ContainerStarted","Data":"9b8b2e6f8702b51b26348fecb3b3a533565a32e573029d2597c60337e82092ea"}
Jul 29 21:08:17.285576 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:17.285547    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l42z5" event={"ID":"163ef3df-3eb2-44e3-ad92-0665dbe66343","Type":"ContainerStarted","Data":"500cf5c4b21be8089cb897a21e9226f198fb26186d80c837e0e504aff21ed30c"}
Jul 29 21:08:17.286057 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:17.285820    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l42z5"
Jul 29 21:08:17.325936 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:17.325883    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l42z5" podStartSLOduration=251.957768077 podStartE2EDuration="4m14.325863295s" totalImagesPullingTime="2.368095218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:08:17.325327286 +0000 UTC m=+289.330850656" watchObservedRunningTime="2026-07-29 21:08:17.325863295 +0000 UTC m=+289.331386664"
Jul 29 21:08:21.302239 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:21.302161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hpz5z" event={"ID":"a0298cd0-9c41-44cb-80ce-a8a2665ad445","Type":"ContainerStarted","Data":"0aa409e6b85801c29464965b61597966dbc882f2d66cbaaeaf03245633fc4a13"}
Jul 29 21:08:21.322508 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:21.322425    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:21.478907 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:08:21.478862    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4wwgl" podUID="ff9a3f79-f4da-491d-abb3-8acc9ff17877"
Jul 29 21:08:22.725318 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:22.725281    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:22.784538 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:22.784504    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:22.840546 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:22.840511    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:23.742040 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:23.742009    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:23.942708 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:23.942663    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:23.968821 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:23.968793    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"]
Jul 29 21:08:23.972540 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:23.972521    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"
Jul 29 21:08:23.976331 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:23.976309    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 29 21:08:23.976865 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:23.976821    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nk6v8\""
Jul 29 21:08:23.976865 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:23.976825    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 29 21:08:23.977728 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:23.977582    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 21:08:23.981748 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:23.981725    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6wd6j"]
Jul 29 21:08:23.985181 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:23.985164    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:23.988411 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:23.988001    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 21:08:23.988411 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:23.988154    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 21:08:23.988411 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:23.988262    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 21:08:23.988411 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:23.988384    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cjm7d\""
Jul 29 21:08:23.989135 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:23.989116    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"]
Jul 29 21:08:24.045233 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.045201    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:24.105283 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.105253    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a356676-2383-4d47-a211-bed0a7bbfa56-node-exporter-wtmp\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.105283 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.105287    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0293bdb3-2a31-480b-8726-faed9e243c1c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-9fkpn\" (UID: \"0293bdb3-2a31-480b-8726-faed9e243c1c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"
Jul 29 21:08:24.105531 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.105310    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a356676-2383-4d47-a211-bed0a7bbfa56-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.105531 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.105361    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a356676-2383-4d47-a211-bed0a7bbfa56-root\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.105531 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.105388    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8xvf\" (UniqueName: \"kubernetes.io/projected/0293bdb3-2a31-480b-8726-faed9e243c1c-kube-api-access-n8xvf\") pod \"openshift-state-metrics-b8f49f5c6-9fkpn\" (UID: \"0293bdb3-2a31-480b-8726-faed9e243c1c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"
Jul 29 21:08:24.105531 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.105462    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khs6b\" (UniqueName: \"kubernetes.io/projected/1a356676-2383-4d47-a211-bed0a7bbfa56-kube-api-access-khs6b\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.105531 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.105483    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0293bdb3-2a31-480b-8726-faed9e243c1c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-9fkpn\" (UID: \"0293bdb3-2a31-480b-8726-faed9e243c1c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"
Jul 29 21:08:24.105531 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.105531    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a356676-2383-4d47-a211-bed0a7bbfa56-node-exporter-textfile\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.105729 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.105546    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a356676-2383-4d47-a211-bed0a7bbfa56-node-exporter-accelerators-collector-config\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.105729 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.105577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0293bdb3-2a31-480b-8726-faed9e243c1c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-9fkpn\" (UID: \"0293bdb3-2a31-480b-8726-faed9e243c1c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"
Jul 29 21:08:24.105729 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.105604    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a356676-2383-4d47-a211-bed0a7bbfa56-sys\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.105729 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.105621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a356676-2383-4d47-a211-bed0a7bbfa56-node-exporter-tls\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.105729 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.105687    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a356676-2383-4d47-a211-bed0a7bbfa56-metrics-client-ca\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.112604 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.112541    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:24.206783 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.206747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a356676-2383-4d47-a211-bed0a7bbfa56-metrics-client-ca\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.206941 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.206808    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a356676-2383-4d47-a211-bed0a7bbfa56-node-exporter-wtmp\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.206941 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.206836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0293bdb3-2a31-480b-8726-faed9e243c1c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-9fkpn\" (UID: \"0293bdb3-2a31-480b-8726-faed9e243c1c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"
Jul 29 21:08:24.206941 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.206868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a356676-2383-4d47-a211-bed0a7bbfa56-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.206941 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.206898    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a356676-2383-4d47-a211-bed0a7bbfa56-root\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.206941 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.206924    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8xvf\" (UniqueName: \"kubernetes.io/projected/0293bdb3-2a31-480b-8726-faed9e243c1c-kube-api-access-n8xvf\") pod \"openshift-state-metrics-b8f49f5c6-9fkpn\" (UID: \"0293bdb3-2a31-480b-8726-faed9e243c1c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"
Jul 29 21:08:24.207166 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.206968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khs6b\" (UniqueName: \"kubernetes.io/projected/1a356676-2383-4d47-a211-bed0a7bbfa56-kube-api-access-khs6b\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.207166 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.206991    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0293bdb3-2a31-480b-8726-faed9e243c1c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-9fkpn\" (UID: \"0293bdb3-2a31-480b-8726-faed9e243c1c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"
Jul 29 21:08:24.207166 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.207045    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a356676-2383-4d47-a211-bed0a7bbfa56-node-exporter-textfile\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.207166 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.207044    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a356676-2383-4d47-a211-bed0a7bbfa56-node-exporter-wtmp\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.207166 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.207069    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a356676-2383-4d47-a211-bed0a7bbfa56-node-exporter-accelerators-collector-config\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.207166 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.207103    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0293bdb3-2a31-480b-8726-faed9e243c1c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-9fkpn\" (UID: \"0293bdb3-2a31-480b-8726-faed9e243c1c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"
Jul 29 21:08:24.207166 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.207141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a356676-2383-4d47-a211-bed0a7bbfa56-sys\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.207166 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.207165    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a356676-2383-4d47-a211-bed0a7bbfa56-node-exporter-tls\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.207432 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.207390    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a356676-2383-4d47-a211-bed0a7bbfa56-metrics-client-ca\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.207432 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:08:24.207411    2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 29 21:08:24.207556 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:08:24.207493    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0293bdb3-2a31-480b-8726-faed9e243c1c-openshift-state-metrics-tls podName:0293bdb3-2a31-480b-8726-faed9e243c1c nodeName:}" failed. No retries permitted until 2026-07-29 21:08:24.707474496 +0000 UTC m=+296.712997856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0293bdb3-2a31-480b-8726-faed9e243c1c-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-9fkpn" (UID: "0293bdb3-2a31-480b-8726-faed9e243c1c") : secret "openshift-state-metrics-tls" not found
Jul 29 21:08:24.207767 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.207743    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a356676-2383-4d47-a211-bed0a7bbfa56-node-exporter-textfile\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.209311 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.209104    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a356676-2383-4d47-a211-bed0a7bbfa56-node-exporter-accelerators-collector-config\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.211943 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.207866    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a356676-2383-4d47-a211-bed0a7bbfa56-sys\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.211943 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.211859    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a356676-2383-4d47-a211-bed0a7bbfa56-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.211943 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.211886    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a356676-2383-4d47-a211-bed0a7bbfa56-root\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.211943 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.211935    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0293bdb3-2a31-480b-8726-faed9e243c1c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-9fkpn\" (UID: \"0293bdb3-2a31-480b-8726-faed9e243c1c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"
Jul 29 21:08:24.213959 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.212603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0293bdb3-2a31-480b-8726-faed9e243c1c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-9fkpn\" (UID: \"0293bdb3-2a31-480b-8726-faed9e243c1c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"
Jul 29 21:08:24.214727 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.214377    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a356676-2383-4d47-a211-bed0a7bbfa56-node-exporter-tls\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.218479 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.216342    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:24.218479 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.217247    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8xvf\" (UniqueName: \"kubernetes.io/projected/0293bdb3-2a31-480b-8726-faed9e243c1c-kube-api-access-n8xvf\") pod \"openshift-state-metrics-b8f49f5c6-9fkpn\" (UID: \"0293bdb3-2a31-480b-8726-faed9e243c1c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"
Jul 29 21:08:24.220980 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.220622    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khs6b\" (UniqueName: \"kubernetes.io/projected/1a356676-2383-4d47-a211-bed0a7bbfa56-kube-api-access-khs6b\") pod \"node-exporter-6wd6j\" (UID: \"1a356676-2383-4d47-a211-bed0a7bbfa56\") " pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.297038 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.297016    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6wd6j"
Jul 29 21:08:24.309915 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:08:24.309887    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a356676_2383_4d47_a211_bed0a7bbfa56.slice/crio-8d4b50ff2516959dffaa0206d8c16b9335a6804a18b80d5192a5a5df323cb650 WatchSource:0}: Error finding container 8d4b50ff2516959dffaa0206d8c16b9335a6804a18b80d5192a5a5df323cb650: Status 404 returned error can't find the container with id 8d4b50ff2516959dffaa0206d8c16b9335a6804a18b80d5192a5a5df323cb650
Jul 29 21:08:24.314726 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.314699    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:24.316657 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.316634    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hpz5z" event={"ID":"a0298cd0-9c41-44cb-80ce-a8a2665ad445","Type":"ContainerStarted","Data":"7dedb35b7d52051d8dfccf5f44b2a096129f6aae1311f792c38c65ae4f0f469c"}
Jul 29 21:08:24.711829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.711679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0293bdb3-2a31-480b-8726-faed9e243c1c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-9fkpn\" (UID: \"0293bdb3-2a31-480b-8726-faed9e243c1c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"
Jul 29 21:08:24.714876 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.714853    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0293bdb3-2a31-480b-8726-faed9e243c1c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-9fkpn\" (UID: \"0293bdb3-2a31-480b-8726-faed9e243c1c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"
Jul 29 21:08:24.757135 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.757099    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:24.856469 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.856392    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:24.883255 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.883227    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"
Jul 29 21:08:24.969721 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:24.969568    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:25.062582 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.062496    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:25.075008 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.074924    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn"]
Jul 29 21:08:25.085441 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:08:25.080286    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0293bdb3_2a31_480b_8726_faed9e243c1c.slice/crio-6f0d70e3a6692e11dcb0d1c68e042d7b4178083173346ce782268db87b68e3e9 WatchSource:0}: Error finding container 6f0d70e3a6692e11dcb0d1c68e042d7b4178083173346ce782268db87b68e3e9: Status 404 returned error can't find the container with id 6f0d70e3a6692e11dcb0d1c68e042d7b4178083173346ce782268db87b68e3e9
Jul 29 21:08:25.105892 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.105863    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 21:08:25.111337 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.111309    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.120887 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.120683    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 29 21:08:25.120887 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.120720    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 29 21:08:25.120887 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.120806    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 29 21:08:25.121092 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.120928    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 29 21:08:25.121092 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.121001    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 29 21:08:25.121092 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.120726    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7gv4c\""
Jul 29 21:08:25.121092 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.120928    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 29 21:08:25.121277 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.121152    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 29 21:08:25.121335 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.121313    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 29 21:08:25.121384 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.121339    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 29 21:08:25.134764 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.134711    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 21:08:25.200019 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.199956    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:25.218642 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.218612    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.218806 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.218654    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.218806 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.218687    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.218806 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.218721    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40ca69e6-d778-4ccd-8bd0-f17cf1088082-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.218806 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.218764    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-web-config\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.218806 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.218785    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-config-volume\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.219063 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.218806    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ca69e6-d778-4ccd-8bd0-f17cf1088082-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.219063 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.218843    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.219063 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.218871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40ca69e6-d778-4ccd-8bd0-f17cf1088082-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.219063 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.218916    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40ca69e6-d778-4ccd-8bd0-f17cf1088082-config-out\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.219063 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.218968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40ca69e6-d778-4ccd-8bd0-f17cf1088082-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.219063 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.218998    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mdgs\" (UniqueName: \"kubernetes.io/projected/40ca69e6-d778-4ccd-8bd0-f17cf1088082-kube-api-access-6mdgs\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.219063 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.219033    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.320889 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.320056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.320889 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.320104    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.320889 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.320131    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.320889 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.320163    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.320889 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.320192    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40ca69e6-d778-4ccd-8bd0-f17cf1088082-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.320889 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.320230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-web-config\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.320889 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.320252    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-config-volume\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.320889 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.320276    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ca69e6-d778-4ccd-8bd0-f17cf1088082-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.320889 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.320307    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.320889 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.320334    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40ca69e6-d778-4ccd-8bd0-f17cf1088082-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.320889 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.320372    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40ca69e6-d778-4ccd-8bd0-f17cf1088082-config-out\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.320889 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.320411    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40ca69e6-d778-4ccd-8bd0-f17cf1088082-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.320889 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.320474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mdgs\" (UniqueName: \"kubernetes.io/projected/40ca69e6-d778-4ccd-8bd0-f17cf1088082-kube-api-access-6mdgs\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.322628 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.322600    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40ca69e6-d778-4ccd-8bd0-f17cf1088082-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.323554 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.323098    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ca69e6-d778-4ccd-8bd0-f17cf1088082-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.323669 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.323615    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40ca69e6-d778-4ccd-8bd0-f17cf1088082-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.325098 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.324973    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn" event={"ID":"0293bdb3-2a31-480b-8726-faed9e243c1c","Type":"ContainerStarted","Data":"4d1f906bafab233c80c827310be2dce13afbe56e0bf9d27e8f95d0788d48cec0"}
Jul 29 21:08:25.325098 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.325041    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn" event={"ID":"0293bdb3-2a31-480b-8726-faed9e243c1c","Type":"ContainerStarted","Data":"6f0d70e3a6692e11dcb0d1c68e042d7b4178083173346ce782268db87b68e3e9"}
Jul 29 21:08:25.326669 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.326634    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6wd6j" event={"ID":"1a356676-2383-4d47-a211-bed0a7bbfa56","Type":"ContainerStarted","Data":"8d4b50ff2516959dffaa0206d8c16b9335a6804a18b80d5192a5a5df323cb650"}
Jul 29 21:08:25.327641 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.327561    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.327893 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.327865    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.329158 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.328194    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-config-volume\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.329158 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.328573    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.329158 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.328903    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.329158 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.329128    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40ca69e6-d778-4ccd-8bd0-f17cf1088082-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.329388 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.329179    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40ca69e6-d778-4ccd-8bd0-f17cf1088082-config-out\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.330560 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.330528    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mdgs\" (UniqueName: \"kubernetes.io/projected/40ca69e6-d778-4ccd-8bd0-f17cf1088082-kube-api-access-6mdgs\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.330859 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.330839    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.331015 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.330931    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-web-config\") pod \"alertmanager-main-0\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.380949 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.380905    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:25.441655 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.441628    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:08:25.638720 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:25.638692    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 21:08:25.641219 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:08:25.641187    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ca69e6_d778_4ccd_8bd0_f17cf1088082.slice/crio-d349bb323007eafb3cd16a586925c26b8ecb8ac7bee238e3d10731a32b8cfbb1 WatchSource:0}: Error finding container d349bb323007eafb3cd16a586925c26b8ecb8ac7bee238e3d10731a32b8cfbb1: Status 404 returned error can't find the container with id d349bb323007eafb3cd16a586925c26b8ecb8ac7bee238e3d10731a32b8cfbb1
Jul 29 21:08:26.332395 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:26.332362    2575 generic.go:356] "Generic (PLEG): container finished" podID="1a356676-2383-4d47-a211-bed0a7bbfa56" containerID="89688cc93b111f3e2bd9ff7eb4eb358b92548cf1b365734cb1d11bcfe4a194e2" exitCode=0
Jul 29 21:08:26.332879 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:26.332479    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6wd6j" event={"ID":"1a356676-2383-4d47-a211-bed0a7bbfa56","Type":"ContainerDied","Data":"89688cc93b111f3e2bd9ff7eb4eb358b92548cf1b365734cb1d11bcfe4a194e2"}
Jul 29 21:08:26.334671 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:26.334639    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn" event={"ID":"0293bdb3-2a31-480b-8726-faed9e243c1c","Type":"ContainerStarted","Data":"c7e9cbe9eb5cbfcf2d070ef3672903b593c3396e5436c23b4f23c3f0f8538078"}
Jul 29 21:08:26.335918 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:26.335885    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40ca69e6-d778-4ccd-8bd0-f17cf1088082","Type":"ContainerStarted","Data":"d349bb323007eafb3cd16a586925c26b8ecb8ac7bee238e3d10731a32b8cfbb1"}
Jul 29 21:08:26.895284 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:26.895240    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:26.966944 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:26.966844    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:27.273322 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:27.273247    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:27.292213 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:27.292178    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l42z5"
Jul 29 21:08:27.433691 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:27.433650    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:27.534881 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:27.534782    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:27.635202 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:27.635172    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:27.742571 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:27.742534    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:28.347258 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.347172    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6wd6j" event={"ID":"1a356676-2383-4d47-a211-bed0a7bbfa56","Type":"ContainerStarted","Data":"71678345cf3f430eab679c1cd0d552a711a430148178368d2e1cb08a4efa2c89"}
Jul 29 21:08:28.347258 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.347234    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6wd6j" event={"ID":"1a356676-2383-4d47-a211-bed0a7bbfa56","Type":"ContainerStarted","Data":"71e59953f3f13ffe316e1aa66f90c5f2565e74e1ef1b49ff24b88dd0a2838555"}
Jul 29 21:08:28.349547 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.349513    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hpz5z" event={"ID":"a0298cd0-9c41-44cb-80ce-a8a2665ad445","Type":"ContainerStarted","Data":"638853a749038383888e602d23d7694fdb73c7da78374840a3284f5f6a6e35ae"}
Jul 29 21:08:28.351778 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.351750    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn" event={"ID":"0293bdb3-2a31-480b-8726-faed9e243c1c","Type":"ContainerStarted","Data":"e3969b3df999db0f877257a7b2a12903f13055c6c22f108bf9f072736e51c35b"}
Jul 29 21:08:28.369130 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.369080    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6wd6j" podStartSLOduration=4.122991958 podStartE2EDuration="5.369060669s" totalImagesPullingTime="1.161219692s" totalInitContainerRuntime="84.849019ms" isStatefulPod=true podCreationTimestamp="2026-07-29 21:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:08:28.366788092 +0000 UTC m=+300.372311470" watchObservedRunningTime="2026-07-29 21:08:28.369060669 +0000 UTC m=+300.374584092"
Jul 29 21:08:28.385710 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.385668    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-9fkpn" podStartSLOduration=2.787119819 podStartE2EDuration="5.385653238s" totalImagesPullingTime="2.598533419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:08:28.38477327 +0000 UTC m=+300.390296638" watchObservedRunningTime="2026-07-29 21:08:28.385653238 +0000 UTC m=+300.391176605"
Jul 29 21:08:28.403581 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.403532    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hpz5z" podStartSLOduration=32.966238457 podStartE2EDuration="45.403517549s" totalImagesPullingTime="12.437279092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 21:07:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:08:28.403119709 +0000 UTC m=+300.408643078" watchObservedRunningTime="2026-07-29 21:08:28.403517549 +0000 UTC m=+300.409040900"
Jul 29 21:08:28.533160 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.533010    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 21:08:28.739834 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.739799    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-llbz2"]
Jul 29 21:08:28.742964 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.742948    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llbz2"
Jul 29 21:08:28.745587 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.745564    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 29 21:08:28.745689 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.745572    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8qh24\""
Jul 29 21:08:28.748125 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.748098    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:28.751606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.751584    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2339936-1790-4e2a-97e8-85e7bce84f84-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-llbz2\" (UID: \"d2339936-1790-4e2a-97e8-85e7bce84f84\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llbz2"
Jul 29 21:08:28.751695 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.751614    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr2f4\" (UniqueName: \"kubernetes.io/projected/d2339936-1790-4e2a-97e8-85e7bce84f84-kube-api-access-pr2f4\") pod \"monitoring-plugin-68b7fc9574-llbz2\" (UID: \"d2339936-1790-4e2a-97e8-85e7bce84f84\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llbz2"
Jul 29 21:08:28.752275 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.752258    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-llbz2"]
Jul 29 21:08:28.852854 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.852820    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2339936-1790-4e2a-97e8-85e7bce84f84-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-llbz2\" (UID: \"d2339936-1790-4e2a-97e8-85e7bce84f84\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llbz2"
Jul 29 21:08:28.853007 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.852864    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr2f4\" (UniqueName: \"kubernetes.io/projected/d2339936-1790-4e2a-97e8-85e7bce84f84-kube-api-access-pr2f4\") pod \"monitoring-plugin-68b7fc9574-llbz2\" (UID: \"d2339936-1790-4e2a-97e8-85e7bce84f84\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llbz2"
Jul 29 21:08:28.855173 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.855150    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2339936-1790-4e2a-97e8-85e7bce84f84-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-llbz2\" (UID: \"d2339936-1790-4e2a-97e8-85e7bce84f84\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llbz2"
Jul 29 21:08:28.863098 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.863077    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr2f4\" (UniqueName: \"kubernetes.io/projected/d2339936-1790-4e2a-97e8-85e7bce84f84-kube-api-access-pr2f4\") pod \"monitoring-plugin-68b7fc9574-llbz2\" (UID: \"d2339936-1790-4e2a-97e8-85e7bce84f84\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llbz2"
Jul 29 21:08:28.908420 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:28.908360    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:29.052586 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.052556    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llbz2"
Jul 29 21:08:29.178368 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.178298    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-llbz2"]
Jul 29 21:08:29.181220 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:08:29.181181    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2339936_1790_4e2a_97e8_85e7bce84f84.slice/crio-dac363aa16b22faeb5dbc6311caa003597434ecdcf416de274fa1d62d507b850 WatchSource:0}: Error finding container dac363aa16b22faeb5dbc6311caa003597434ecdcf416de274fa1d62d507b850: Status 404 returned error can't find the container with id dac363aa16b22faeb5dbc6311caa003597434ecdcf416de274fa1d62d507b850
Jul 29 21:08:29.192357 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.192334    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"]
Jul 29 21:08:29.196987 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.196972    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.199742 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.199723    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 29 21:08:29.200011 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.199975    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 29 21:08:29.200114 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.200031    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 29 21:08:29.200114 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.200050    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 29 21:08:29.200114 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.200068    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 29 21:08:29.200401 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.200384    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rzhwn\""
Jul 29 21:08:29.206923 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.206906    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 29 21:08:29.208808 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.208787    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"]
Jul 29 21:08:29.255692 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.255668    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhdls\" (UniqueName: \"kubernetes.io/projected/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-kube-api-access-dhdls\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.255814 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.255700    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-secret-telemeter-client\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.255814 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.255725    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.255814 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.255774    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-federate-client-tls\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.255915 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.255838    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-serving-certs-ca-bundle\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.255915 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.255894    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.255979 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.255929    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-metrics-client-ca\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.255979 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.255956    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-telemeter-client-tls\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.356364 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.356328    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhdls\" (UniqueName: \"kubernetes.io/projected/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-kube-api-access-dhdls\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.356364 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.356364    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-secret-telemeter-client\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.356622 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.356393    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.356622 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.356417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-federate-client-tls\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.356622 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.356505    2575 generic.go:356] "Generic (PLEG): container finished" podID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerID="96da9615efd09c07f308810d2c3eda9d4f88c2eefc335aa1163a336ab422292c" exitCode=0
Jul 29 21:08:29.356773 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.356628    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40ca69e6-d778-4ccd-8bd0-f17cf1088082","Type":"ContainerDied","Data":"96da9615efd09c07f308810d2c3eda9d4f88c2eefc335aa1163a336ab422292c"}
Jul 29 21:08:29.356773 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.356724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-serving-certs-ca-bundle\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.356876 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.356811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.356876 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.356851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-metrics-client-ca\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.356972 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.356891    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-telemeter-client-tls\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.357515 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.357399    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.357825 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.357593    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-metrics-client-ca\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.357825 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.357619    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-serving-certs-ca-bundle\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.358937 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.358911    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llbz2" event={"ID":"d2339936-1790-4e2a-97e8-85e7bce84f84","Type":"ContainerStarted","Data":"dac363aa16b22faeb5dbc6311caa003597434ecdcf416de274fa1d62d507b850"}
Jul 29 21:08:29.359486 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.359430    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-secret-telemeter-client\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.359669 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.359647    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-federate-client-tls\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.359847 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.359826    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.359937 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.359918    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-telemeter-client-tls\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.365429 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.365400    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhdls\" (UniqueName: \"kubernetes.io/projected/bdc6bd12-69b5-4e8d-8e43-b39ece5200c4-kube-api-access-dhdls\") pod \"telemeter-client-54dc7fbb4-24tv4\" (UID: \"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4\") " pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.507376 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.507304    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"
Jul 29 21:08:29.637482 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.637436    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-54dc7fbb4-24tv4"]
Jul 29 21:08:29.642055 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:08:29.642023    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc6bd12_69b5_4e8d_8e43_b39ece5200c4.slice/crio-152c425113e9b930bacde53a1df9d0918471c7010ef15d1047f3fb25a729d3a1 WatchSource:0}: Error finding container 152c425113e9b930bacde53a1df9d0918471c7010ef15d1047f3fb25a729d3a1: Status 404 returned error can't find the container with id 152c425113e9b930bacde53a1df9d0918471c7010ef15d1047f3fb25a729d3a1
Jul 29 21:08:29.643980 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:29.643963    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 21:08:30.224070 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.224025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:30.229963 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.229934    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 21:08:30.234380 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.234359    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.237606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.237568    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d9g561ciocn06\""
Jul 29 21:08:30.237606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.237592    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 29 21:08:30.237807 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.237786    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 29 21:08:30.237939 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.237910    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 29 21:08:30.238002 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.237956    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 29 21:08:30.238064 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.237916    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 29 21:08:30.238177 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.238157    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 29 21:08:30.238462 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.238429    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 29 21:08:30.238566 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.238467    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 29 21:08:30.239107 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.238731    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 29 21:08:30.239107 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.238959    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 29 21:08:30.239107 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.238979    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-t55mz\""
Jul 29 21:08:30.239460 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.239424    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 29 21:08:30.239618 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.239600    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 29 21:08:30.239776 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.239747    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 29 21:08:30.251579 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.251556    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 29 21:08:30.252735 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.252712    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 29 21:08:30.254574 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.254555    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 21:08:30.267473 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.267427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.267569 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.267499    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.267569 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.267537    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.267569 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.267563    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.267725 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.267608    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/586caa69-5327-4e64-bc5b-57ea54ac3410-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.267725 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.267637    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.267725 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.267676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-config\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.267725 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.267700    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.267891 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.267723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-web-config\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.267891 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.267746    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl5hw\" (UniqueName: \"kubernetes.io/projected/586caa69-5327-4e64-bc5b-57ea54ac3410-kube-api-access-hl5hw\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.267891 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.267802    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.267891 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.267862    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.268071 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.267892    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.268071 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.267975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.268071 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.268010    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.268071 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.268054    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.268269 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.268090    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.268269 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.268120    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.268269 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.268140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/586caa69-5327-4e64-bc5b-57ea54ac3410-config-out\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.268269 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.268155    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.363855 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.363814    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4" event={"ID":"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4","Type":"ContainerStarted","Data":"152c425113e9b930bacde53a1df9d0918471c7010ef15d1047f3fb25a729d3a1"}
Jul 29 21:08:30.369318 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369293    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.369484 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369331    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.369484 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369358    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.369484 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.369484 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369410    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/586caa69-5327-4e64-bc5b-57ea54ac3410-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.369484 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369433    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.369772 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369488    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-config\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.369772 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369613    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.369772 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-web-config\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.369772 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369684    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl5hw\" (UniqueName: \"kubernetes.io/projected/586caa69-5327-4e64-bc5b-57ea54ac3410-kube-api-access-hl5hw\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.369772 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369715    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.369772 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369750    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.370095 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369780    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.370095 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369827    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.370095 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.370095 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.370095 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369935    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.370095 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.370095 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.369992    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/586caa69-5327-4e64-bc5b-57ea54ac3410-config-out\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.370095 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.370015    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.371635 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.370830    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.371635 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.371058    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.371635 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.371311    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.371635 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.371614    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.371908 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.371765    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.371970 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.371903    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.372955 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.372769    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.373994 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.373968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.374150 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.374125    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.374798 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.374776    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.375175 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.375140    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/586caa69-5327-4e64-bc5b-57ea54ac3410-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.375333 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.375290    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/586caa69-5327-4e64-bc5b-57ea54ac3410-config-out\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.375828 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.375785    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.375970 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.375947    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.376156 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.376120    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.376244 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.376227    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.376674 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.376650    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-config\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.376966 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.376934    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-web-config\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.377426 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.377398    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.388101 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.388006    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl5hw\" (UniqueName: \"kubernetes.io/projected/586caa69-5327-4e64-bc5b-57ea54ac3410-kube-api-access-hl5hw\") pod \"prometheus-k8s-0\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:30.551603 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:30.551559    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:31.371280 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:31.371248    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 21:08:31.372571 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:31.372542    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40ca69e6-d778-4ccd-8bd0-f17cf1088082","Type":"ContainerStarted","Data":"7caed4e56b1f53cf3aa1838200e31b66a3791f14e4b013c223167f83fd8b3252"}
Jul 29 21:08:31.374307 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:31.374250    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llbz2" event={"ID":"d2339936-1790-4e2a-97e8-85e7bce84f84","Type":"ContainerStarted","Data":"048cf5206885fdee943084c771967b5cfb337990b2938e2b2645c9d7d17322d3"}
Jul 29 21:08:31.374754 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:31.374675    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llbz2"
Jul 29 21:08:31.374910 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:08:31.374884    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586caa69_5327_4e64_bc5b_57ea54ac3410.slice/crio-a5a74ee58197d6b3aa3672cf66bc417df0f891fee65cce27ce024cf6a67844ed WatchSource:0}: Error finding container a5a74ee58197d6b3aa3672cf66bc417df0f891fee65cce27ce024cf6a67844ed: Status 404 returned error can't find the container with id a5a74ee58197d6b3aa3672cf66bc417df0f891fee65cce27ce024cf6a67844ed
Jul 29 21:08:31.380246 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:31.380222    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llbz2"
Jul 29 21:08:31.392423 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:31.392346    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llbz2" podStartSLOduration=1.360826225 podStartE2EDuration="3.392331539s" totalImagesPullingTime="2.031505314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:08:31.39081488 +0000 UTC m=+303.396338249" watchObservedRunningTime="2026-07-29 21:08:31.392331539 +0000 UTC m=+303.397854906"
Jul 29 21:08:32.380690 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:32.380659    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4" event={"ID":"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4","Type":"ContainerStarted","Data":"ae45c674dc7609680539d202e16524e972bc33837cd4d760623b5fd9623ece70"}
Jul 29 21:08:32.381141 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:32.380756    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4" event={"ID":"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4","Type":"ContainerStarted","Data":"cbde0c2fc325f5024dfae56f9e0a88cf3dc8abba10d2736788b9be3d00739059"}
Jul 29 21:08:32.382488 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:32.382454    2575 generic.go:356] "Generic (PLEG): container finished" podID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerID="b3f9b03821f9ac4cd9eb1260e7f8145881beca7f7d6be47d320b7ef749c7762a" exitCode=0
Jul 29 21:08:32.382608 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:32.382483    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"586caa69-5327-4e64-bc5b-57ea54ac3410","Type":"ContainerDied","Data":"b3f9b03821f9ac4cd9eb1260e7f8145881beca7f7d6be47d320b7ef749c7762a"}
Jul 29 21:08:32.382608 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:32.382558    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"586caa69-5327-4e64-bc5b-57ea54ac3410","Type":"ContainerStarted","Data":"a5a74ee58197d6b3aa3672cf66bc417df0f891fee65cce27ce024cf6a67844ed"}
Jul 29 21:08:32.386205 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:32.386179    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40ca69e6-d778-4ccd-8bd0-f17cf1088082","Type":"ContainerStarted","Data":"f544262bdd086ec9b6fe11e82cdc7e73f8f5f8a279f70d6ebcf8dfe07bdb43ce"}
Jul 29 21:08:32.386291 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:32.386253    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40ca69e6-d778-4ccd-8bd0-f17cf1088082","Type":"ContainerStarted","Data":"75b74c974a1df92439bb31213495122dcdad00df38b45fc58a4348830287fe9f"}
Jul 29 21:08:32.386355 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:32.386303    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40ca69e6-d778-4ccd-8bd0-f17cf1088082","Type":"ContainerStarted","Data":"2c30c8584df84df4cefbac35382837e0d97462046797cdd3aa38a78ae274e0b6"}
Jul 29 21:08:32.386411 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:32.386351    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40ca69e6-d778-4ccd-8bd0-f17cf1088082","Type":"ContainerStarted","Data":"6606bd40d65faddc5e622b71cdc38e9e6092c9bdbba55e2959dfbb7fd1433d66"}
Jul 29 21:08:33.393145 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:33.393065    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4" event={"ID":"bdc6bd12-69b5-4e8d-8e43-b39ece5200c4","Type":"ContainerStarted","Data":"47bce071c9530420c5fbd75889230fe7e17b8ec2ad9a47e36c4e1900896e1063"}
Jul 29 21:08:33.396820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:33.396788    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40ca69e6-d778-4ccd-8bd0-f17cf1088082","Type":"ContainerStarted","Data":"60a2174b0c286744344f23a7815298cd047cd58688f931c6501d5f1258d2d9fe"}
Jul 29 21:08:33.421844 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:33.421718    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-54dc7fbb4-24tv4" podStartSLOduration=1.841668903 podStartE2EDuration="4.421701771s" totalImagesPullingTime="2.580032868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:08:33.421053279 +0000 UTC m=+305.426576647" watchObservedRunningTime="2026-07-29 21:08:33.421701771 +0000 UTC m=+305.427225142"
Jul 29 21:08:33.454787 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:33.454742    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.7701975340000002 podStartE2EDuration="8.454726843s" totalImagesPullingTime="5.669093139s" totalInitContainerRuntime="15.43617ms" isStatefulPod=false podCreationTimestamp="2026-07-29 21:08:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:08:33.453356648 +0000 UTC m=+305.458880043" watchObservedRunningTime="2026-07-29 21:08:33.454726843 +0000 UTC m=+305.460250211"
Jul 29 21:08:33.956547 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:33.956508    2575 patch_prober.go:28] interesting pod/image-registry-7687fddd6d-dvwnt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 21:08:33.956732 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:33.956570    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt" podUID="86593cfc-07e7-476a-921d-85ed51cedccc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 21:08:34.476814 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:34.476780    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:08:35.269224 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:35.269194    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:08:35.549869 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:35.549827    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:36.414781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:36.414743    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"586caa69-5327-4e64-bc5b-57ea54ac3410","Type":"ContainerStarted","Data":"e9958da44849e6e8142e447f6a31eeeb9048257e5b7ae8bf997cd1d890c27b43"}
Jul 29 21:08:36.414969 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:36.414812    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"586caa69-5327-4e64-bc5b-57ea54ac3410","Type":"ContainerStarted","Data":"098a9d03ad5eab5a872fd42ad50321fceadd83a9e8f2da78a37ec98479747d4f"}
Jul 29 21:08:37.565717 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:37.565667    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:37.667301 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:37.667269    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:37.767787 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:37.767749    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:38.177869 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:38.177788    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7687fddd6d-dvwnt"]
Jul 29 21:08:38.274183 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:38.274153    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:38.347213 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:38.347182    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:38.420017 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:38.419988    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:38.425522 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:38.425496    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"586caa69-5327-4e64-bc5b-57ea54ac3410","Type":"ContainerStarted","Data":"5094cebf31bc8ecc2f125092e5a14debd5a5ccb4d3497f335f3c065813ae1baa"}
Jul 29 21:08:38.425640 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:38.425570    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"586caa69-5327-4e64-bc5b-57ea54ac3410","Type":"ContainerStarted","Data":"dba48a885cf49395e2beb0be1da7fd52e88bef2111bbf726f43c7d5a6805badc"}
Jul 29 21:08:38.425640 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:38.425612    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"586caa69-5327-4e64-bc5b-57ea54ac3410","Type":"ContainerStarted","Data":"a0e3858fc4a624fa4e3cab536ae63e7fcd129ed954ed5b6241987d4e7771b37a"}
Jul 29 21:08:38.425710 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:38.425652    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"586caa69-5327-4e64-bc5b-57ea54ac3410","Type":"ContainerStarted","Data":"297c640041cf437680b9d40634aa4cbf6c62d27adb78dae194b875fdafcb9369"}
Jul 29 21:08:38.460936 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:38.460836    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.258019705 podStartE2EDuration="8.46081568s" totalImagesPullingTime="5.17649724s" totalInitContainerRuntime="26.298735ms" isStatefulPod=false podCreationTimestamp="2026-07-29 21:08:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:08:38.460257047 +0000 UTC m=+310.465780416" watchObservedRunningTime="2026-07-29 21:08:38.46081568 +0000 UTC m=+310.466339050"
Jul 29 21:08:38.521346 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:38.521303    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:38.704072 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:38.704039    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:39.890534 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:39.890497    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:40.552205 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:40.552168    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:08:40.767287 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:40.767239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:40.828905 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:40.828832    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:43.125428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:43.125390    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:43.229496 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:43.229464    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:45.444618 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:45.444587    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:45.578431 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:45.578377    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:49.839761 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:49.839728    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:49.923984 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:49.923950    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:52.682235 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:52.682199    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:56.489922 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:56.489890    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:08:56.559053 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:08:56.558997    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:00.092574 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:00.092536    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:00.193727 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:00.193693    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:01.907244 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:01.907198    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:01.970154 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:01.970121    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:03.200668 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:03.200627    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt" podUID="86593cfc-07e7-476a-921d-85ed51cedccc" containerName="registry" containerID="cri-o://f0567a1f90cf9bc90df34cabfc94624566ed8c526b5f190db988273a8db0929a" gracePeriod=30
Jul 29 21:09:03.523743 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:03.523708    2575 generic.go:356] "Generic (PLEG): container finished" podID="86593cfc-07e7-476a-921d-85ed51cedccc" containerID="f0567a1f90cf9bc90df34cabfc94624566ed8c526b5f190db988273a8db0929a" exitCode=0
Jul 29 21:09:03.523873 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:03.523775    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt" event={"ID":"86593cfc-07e7-476a-921d-85ed51cedccc","Type":"ContainerDied","Data":"f0567a1f90cf9bc90df34cabfc94624566ed8c526b5f190db988273a8db0929a"}
Jul 29 21:09:03.952841 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:03.952811    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:09:04.077782 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.077707    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86593cfc-07e7-476a-921d-85ed51cedccc-trusted-ca\") pod \"86593cfc-07e7-476a-921d-85ed51cedccc\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") "
Jul 29 21:09:04.077782 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.077750    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls\") pod \"86593cfc-07e7-476a-921d-85ed51cedccc\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") "
Jul 29 21:09:04.077782 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.077771    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86593cfc-07e7-476a-921d-85ed51cedccc-installation-pull-secrets\") pod \"86593cfc-07e7-476a-921d-85ed51cedccc\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") "
Jul 29 21:09:04.078002 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.077905    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86593cfc-07e7-476a-921d-85ed51cedccc-ca-trust-extracted\") pod \"86593cfc-07e7-476a-921d-85ed51cedccc\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") "
Jul 29 21:09:04.078002 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.077951    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86593cfc-07e7-476a-921d-85ed51cedccc-registry-certificates\") pod \"86593cfc-07e7-476a-921d-85ed51cedccc\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") "
Jul 29 21:09:04.078091 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.078003    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-bound-sa-token\") pod \"86593cfc-07e7-476a-921d-85ed51cedccc\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") "
Jul 29 21:09:04.078091 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.078045    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86593cfc-07e7-476a-921d-85ed51cedccc-image-registry-private-configuration\") pod \"86593cfc-07e7-476a-921d-85ed51cedccc\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") "
Jul 29 21:09:04.078091 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.078079    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2kvq\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-kube-api-access-m2kvq\") pod \"86593cfc-07e7-476a-921d-85ed51cedccc\" (UID: \"86593cfc-07e7-476a-921d-85ed51cedccc\") "
Jul 29 21:09:04.078491 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.078323    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86593cfc-07e7-476a-921d-85ed51cedccc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "86593cfc-07e7-476a-921d-85ed51cedccc" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:09:04.078491 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.078423    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86593cfc-07e7-476a-921d-85ed51cedccc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "86593cfc-07e7-476a-921d-85ed51cedccc" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:09:04.078491 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.078441    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86593cfc-07e7-476a-921d-85ed51cedccc-trusted-ca\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:04.080621 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.080597    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86593cfc-07e7-476a-921d-85ed51cedccc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "86593cfc-07e7-476a-921d-85ed51cedccc" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:04.080753 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.080653    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "86593cfc-07e7-476a-921d-85ed51cedccc" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:09:04.080753 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.080649    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "86593cfc-07e7-476a-921d-85ed51cedccc" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:09:04.080753 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.080678    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86593cfc-07e7-476a-921d-85ed51cedccc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "86593cfc-07e7-476a-921d-85ed51cedccc" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:04.080753 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.080738    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-kube-api-access-m2kvq" (OuterVolumeSpecName: "kube-api-access-m2kvq") pod "86593cfc-07e7-476a-921d-85ed51cedccc" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc"). InnerVolumeSpecName "kube-api-access-m2kvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:09:04.088657 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.088627    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86593cfc-07e7-476a-921d-85ed51cedccc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "86593cfc-07e7-476a-921d-85ed51cedccc" (UID: "86593cfc-07e7-476a-921d-85ed51cedccc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:09:04.179930 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.179900    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-registry-tls\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:04.179930 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.179925    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86593cfc-07e7-476a-921d-85ed51cedccc-installation-pull-secrets\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:04.179930 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.179935    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86593cfc-07e7-476a-921d-85ed51cedccc-ca-trust-extracted\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:04.180134 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.179947    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86593cfc-07e7-476a-921d-85ed51cedccc-registry-certificates\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:04.180134 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.179959    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-bound-sa-token\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:04.180134 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.179968    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86593cfc-07e7-476a-921d-85ed51cedccc-image-registry-private-configuration\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:04.180134 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.179977    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2kvq\" (UniqueName: \"kubernetes.io/projected/86593cfc-07e7-476a-921d-85ed51cedccc-kube-api-access-m2kvq\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:04.529298 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.529274    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt"
Jul 29 21:09:04.529666 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.529313    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7687fddd6d-dvwnt" event={"ID":"86593cfc-07e7-476a-921d-85ed51cedccc","Type":"ContainerDied","Data":"1109b7a7f0b3b83730f53ff5b8ad7a991c65dc94bbfc1bc9ee9a4c7ba6c94cc0"}
Jul 29 21:09:04.529666 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.529375    2575 scope.go:117] "RemoveContainer" containerID="f0567a1f90cf9bc90df34cabfc94624566ed8c526b5f190db988273a8db0929a"
Jul 29 21:09:04.546765 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.546741    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7687fddd6d-dvwnt"]
Jul 29 21:09:04.550976 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:04.550955    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7687fddd6d-dvwnt"]
Jul 29 21:09:05.893240 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:05.893166    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:06.482064 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:06.482031    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86593cfc-07e7-476a-921d-85ed51cedccc" path="/var/lib/kubelet/pods/86593cfc-07e7-476a-921d-85ed51cedccc/volumes"
Jul 29 21:09:06.484775 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:06.484752    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:06.583968 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:06.583931    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:07.321041 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:07.321009    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:07.376815 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:07.376781    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:07.546542 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:07.546484    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:07.614979 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:07.614902    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:13.567563 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:13.567532    2575 generic.go:356] "Generic (PLEG): container finished" podID="28d35bea-1e86-45a5-99f2-1cd1e51dbfed" containerID="edaed1abff2268ac4b0ef0d65d5c6ad3d5ce6f843b35b1f18a5ae7ef38aefd73" exitCode=0
Jul 29 21:09:13.567945 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:13.567567    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-smtxx" event={"ID":"28d35bea-1e86-45a5-99f2-1cd1e51dbfed","Type":"ContainerDied","Data":"edaed1abff2268ac4b0ef0d65d5c6ad3d5ce6f843b35b1f18a5ae7ef38aefd73"}
Jul 29 21:09:13.567945 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:13.567885    2575 scope.go:117] "RemoveContainer" containerID="edaed1abff2268ac4b0ef0d65d5c6ad3d5ce6f843b35b1f18a5ae7ef38aefd73"
Jul 29 21:09:14.573651 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:14.573621    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-smtxx" event={"ID":"28d35bea-1e86-45a5-99f2-1cd1e51dbfed","Type":"ContainerStarted","Data":"1c5ca39df0f45d61dd567119a1bd17cd51175fa4c3928a77dbc1aff09045c791"}
Jul 29 21:09:16.907057 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:16.907023    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:16.963819 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:16.963786    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:18.956425 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:18.956335    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:30.552132 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:30.552098    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:30.571725 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:30.571691    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:30.661266 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:30.661239    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:31.126399 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:31.126368    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:31.197009 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:31.196979    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:40.070647 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:40.070607    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:40.171109 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:40.171076    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:41.204246 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:41.204186    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:41.264996 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:41.264969    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:42.312925 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:42.312895    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs\") pod \"network-metrics-daemon-4wwgl\" (UID: \"ff9a3f79-f4da-491d-abb3-8acc9ff17877\") " pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:09:42.315601 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:42.315570    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff9a3f79-f4da-491d-abb3-8acc9ff17877-metrics-certs\") pod \"network-metrics-daemon-4wwgl\" (UID: \"ff9a3f79-f4da-491d-abb3-8acc9ff17877\") " pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:09:42.580980 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:42.580901    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-82zmz\""
Jul 29 21:09:42.588900 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:42.588877    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wwgl"
Jul 29 21:09:42.715325 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:42.715296    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4wwgl"]
Jul 29 21:09:42.717814 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:09:42.717789    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff9a3f79_f4da_491d_abb3_8acc9ff17877.slice/crio-a3ec440475539ff3cf00fc63b13049a2576f3810ee5411e38a43172cc00d3945 WatchSource:0}: Error finding container a3ec440475539ff3cf00fc63b13049a2576f3810ee5411e38a43172cc00d3945: Status 404 returned error can't find the container with id a3ec440475539ff3cf00fc63b13049a2576f3810ee5411e38a43172cc00d3945
Jul 29 21:09:43.701044 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:43.701008    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4wwgl" event={"ID":"ff9a3f79-f4da-491d-abb3-8acc9ff17877","Type":"ContainerStarted","Data":"ee9ca4f5b52c533d8b4cb28636d09bcb73728d7221384c0b43788b0815f8c551"}
Jul 29 21:09:43.701363 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:43.701108    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4wwgl" event={"ID":"ff9a3f79-f4da-491d-abb3-8acc9ff17877","Type":"ContainerStarted","Data":"a3ec440475539ff3cf00fc63b13049a2576f3810ee5411e38a43172cc00d3945"}
Jul 29 21:09:44.344347 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.344312    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 21:09:44.344713 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.344662    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="alertmanager" containerID="cri-o://7caed4e56b1f53cf3aa1838200e31b66a3791f14e4b013c223167f83fd8b3252" gracePeriod=120
Jul 29 21:09:44.344876 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.344725    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="kube-rbac-proxy-metric" containerID="cri-o://f544262bdd086ec9b6fe11e82cdc7e73f8f5f8a279f70d6ebcf8dfe07bdb43ce" gracePeriod=120
Jul 29 21:09:44.344876 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.344748    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="kube-rbac-proxy-web" containerID="cri-o://2c30c8584df84df4cefbac35382837e0d97462046797cdd3aa38a78ae274e0b6" gracePeriod=120
Jul 29 21:09:44.344876 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.344776    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="kube-rbac-proxy" containerID="cri-o://75b74c974a1df92439bb31213495122dcdad00df38b45fc58a4348830287fe9f" gracePeriod=120
Jul 29 21:09:44.344876 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.344794    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="prom-label-proxy" containerID="cri-o://60a2174b0c286744344f23a7815298cd047cd58688f931c6501d5f1258d2d9fe" gracePeriod=120
Jul 29 21:09:44.344876 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.344819    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="config-reloader" containerID="cri-o://6606bd40d65faddc5e622b71cdc38e9e6092c9bdbba55e2959dfbb7fd1433d66" gracePeriod=120
Jul 29 21:09:44.708392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.708315    2575 generic.go:356] "Generic (PLEG): container finished" podID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerID="60a2174b0c286744344f23a7815298cd047cd58688f931c6501d5f1258d2d9fe" exitCode=0
Jul 29 21:09:44.708392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.708338    2575 generic.go:356] "Generic (PLEG): container finished" podID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerID="f544262bdd086ec9b6fe11e82cdc7e73f8f5f8a279f70d6ebcf8dfe07bdb43ce" exitCode=0
Jul 29 21:09:44.708392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.708344    2575 generic.go:356] "Generic (PLEG): container finished" podID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerID="75b74c974a1df92439bb31213495122dcdad00df38b45fc58a4348830287fe9f" exitCode=0
Jul 29 21:09:44.708392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.708350    2575 generic.go:356] "Generic (PLEG): container finished" podID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerID="6606bd40d65faddc5e622b71cdc38e9e6092c9bdbba55e2959dfbb7fd1433d66" exitCode=0
Jul 29 21:09:44.708392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.708355    2575 generic.go:356] "Generic (PLEG): container finished" podID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerID="7caed4e56b1f53cf3aa1838200e31b66a3791f14e4b013c223167f83fd8b3252" exitCode=0
Jul 29 21:09:44.708912 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.708387    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40ca69e6-d778-4ccd-8bd0-f17cf1088082","Type":"ContainerDied","Data":"60a2174b0c286744344f23a7815298cd047cd58688f931c6501d5f1258d2d9fe"}
Jul 29 21:09:44.708912 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.708477    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40ca69e6-d778-4ccd-8bd0-f17cf1088082","Type":"ContainerDied","Data":"f544262bdd086ec9b6fe11e82cdc7e73f8f5f8a279f70d6ebcf8dfe07bdb43ce"}
Jul 29 21:09:44.708912 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.708513    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40ca69e6-d778-4ccd-8bd0-f17cf1088082","Type":"ContainerDied","Data":"75b74c974a1df92439bb31213495122dcdad00df38b45fc58a4348830287fe9f"}
Jul 29 21:09:44.708912 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.708538    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40ca69e6-d778-4ccd-8bd0-f17cf1088082","Type":"ContainerDied","Data":"6606bd40d65faddc5e622b71cdc38e9e6092c9bdbba55e2959dfbb7fd1433d66"}
Jul 29 21:09:44.708912 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.708576    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40ca69e6-d778-4ccd-8bd0-f17cf1088082","Type":"ContainerDied","Data":"7caed4e56b1f53cf3aa1838200e31b66a3791f14e4b013c223167f83fd8b3252"}
Jul 29 21:09:44.710182 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.710161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4wwgl" event={"ID":"ff9a3f79-f4da-491d-abb3-8acc9ff17877","Type":"ContainerStarted","Data":"a80c6c6cf8e7499de5c68e2960bb27f102f83ca4a4103b2ed0fd609ca010622b"}
Jul 29 21:09:44.726674 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.726630    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4wwgl" podStartSLOduration=375.845016404 podStartE2EDuration="6m16.726615535s" totalImagesPullingTime="881.599131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:09:44.725765648 +0000 UTC m=+376.731289041" watchObservedRunningTime="2026-07-29 21:09:44.726615535 +0000 UTC m=+376.732138903"
Jul 29 21:09:44.823109 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.823077    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:44.924033 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.924001    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:44.982246 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:44.982173    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:45.596655 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.596625    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:45.716920 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.716842    2575 generic.go:356] "Generic (PLEG): container finished" podID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerID="2c30c8584df84df4cefbac35382837e0d97462046797cdd3aa38a78ae274e0b6" exitCode=0
Jul 29 21:09:45.716920 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.716899    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40ca69e6-d778-4ccd-8bd0-f17cf1088082","Type":"ContainerDied","Data":"2c30c8584df84df4cefbac35382837e0d97462046797cdd3aa38a78ae274e0b6"}
Jul 29 21:09:45.717347 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.716931    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:45.717347 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.716977    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40ca69e6-d778-4ccd-8bd0-f17cf1088082","Type":"ContainerDied","Data":"d349bb323007eafb3cd16a586925c26b8ecb8ac7bee238e3d10731a32b8cfbb1"}
Jul 29 21:09:45.717347 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.717017    2575 scope.go:117] "RemoveContainer" containerID="60a2174b0c286744344f23a7815298cd047cd58688f931c6501d5f1258d2d9fe"
Jul 29 21:09:45.724795 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.724777    2575 scope.go:117] "RemoveContainer" containerID="f544262bdd086ec9b6fe11e82cdc7e73f8f5f8a279f70d6ebcf8dfe07bdb43ce"
Jul 29 21:09:45.731715 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.731699    2575 scope.go:117] "RemoveContainer" containerID="75b74c974a1df92439bb31213495122dcdad00df38b45fc58a4348830287fe9f"
Jul 29 21:09:45.738370 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.738356    2575 scope.go:117] "RemoveContainer" containerID="2c30c8584df84df4cefbac35382837e0d97462046797cdd3aa38a78ae274e0b6"
Jul 29 21:09:45.741424 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.741406    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40ca69e6-d778-4ccd-8bd0-f17cf1088082-alertmanager-main-db\") pod \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") "
Jul 29 21:09:45.741532 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.741463    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-web-config\") pod \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") "
Jul 29 21:09:45.741532 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.741497    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40ca69e6-d778-4ccd-8bd0-f17cf1088082-metrics-client-ca\") pod \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") "
Jul 29 21:09:45.741638 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.741532    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-cluster-tls-config\") pod \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") "
Jul 29 21:09:45.741638 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.741584    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy-web\") pod \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") "
Jul 29 21:09:45.741638 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.741610    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-config-volume\") pod \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") "
Jul 29 21:09:45.741790 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.741656    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ca69e6-d778-4ccd-8bd0-f17cf1088082-alertmanager-trusted-ca-bundle\") pod \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") "
Jul 29 21:09:45.741790 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.741694    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-main-tls\") pod \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") "
Jul 29 21:09:45.741790 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.741719    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ca69e6-d778-4ccd-8bd0-f17cf1088082-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "40ca69e6-d778-4ccd-8bd0-f17cf1088082" (UID: "40ca69e6-d778-4ccd-8bd0-f17cf1088082"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:09:45.741790 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.741742    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy-metric\") pod \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") "
Jul 29 21:09:45.742035 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.741794    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mdgs\" (UniqueName: \"kubernetes.io/projected/40ca69e6-d778-4ccd-8bd0-f17cf1088082-kube-api-access-6mdgs\") pod \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") "
Jul 29 21:09:45.742035 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.741827    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40ca69e6-d778-4ccd-8bd0-f17cf1088082-config-out\") pod \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") "
Jul 29 21:09:45.742035 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.741855    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40ca69e6-d778-4ccd-8bd0-f17cf1088082-tls-assets\") pod \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") "
Jul 29 21:09:45.742035 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.741890    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy\") pod \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\" (UID: \"40ca69e6-d778-4ccd-8bd0-f17cf1088082\") "
Jul 29 21:09:45.742220 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.742151    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40ca69e6-d778-4ccd-8bd0-f17cf1088082-alertmanager-main-db\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:45.742220 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.742176    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40ca69e6-d778-4ccd-8bd0-f17cf1088082-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "40ca69e6-d778-4ccd-8bd0-f17cf1088082" (UID: "40ca69e6-d778-4ccd-8bd0-f17cf1088082"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:09:45.742612 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.742317    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40ca69e6-d778-4ccd-8bd0-f17cf1088082-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "40ca69e6-d778-4ccd-8bd0-f17cf1088082" (UID: "40ca69e6-d778-4ccd-8bd0-f17cf1088082"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:09:45.745396 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.745348    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "40ca69e6-d778-4ccd-8bd0-f17cf1088082" (UID: "40ca69e6-d778-4ccd-8bd0-f17cf1088082"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:45.745901 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.745849    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ca69e6-d778-4ccd-8bd0-f17cf1088082-config-out" (OuterVolumeSpecName: "config-out") pod "40ca69e6-d778-4ccd-8bd0-f17cf1088082" (UID: "40ca69e6-d778-4ccd-8bd0-f17cf1088082"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:09:45.745901 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.745855    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "40ca69e6-d778-4ccd-8bd0-f17cf1088082" (UID: "40ca69e6-d778-4ccd-8bd0-f17cf1088082"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:45.746058 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.746006    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-config-volume" (OuterVolumeSpecName: "config-volume") pod "40ca69e6-d778-4ccd-8bd0-f17cf1088082" (UID: "40ca69e6-d778-4ccd-8bd0-f17cf1088082"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:45.746058 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.746029    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "40ca69e6-d778-4ccd-8bd0-f17cf1088082" (UID: "40ca69e6-d778-4ccd-8bd0-f17cf1088082"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:45.746142 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.746054    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "40ca69e6-d778-4ccd-8bd0-f17cf1088082" (UID: "40ca69e6-d778-4ccd-8bd0-f17cf1088082"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:45.746312 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.746286    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ca69e6-d778-4ccd-8bd0-f17cf1088082-kube-api-access-6mdgs" (OuterVolumeSpecName: "kube-api-access-6mdgs") pod "40ca69e6-d778-4ccd-8bd0-f17cf1088082" (UID: "40ca69e6-d778-4ccd-8bd0-f17cf1088082"). InnerVolumeSpecName "kube-api-access-6mdgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:09:45.747486 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.747422    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ca69e6-d778-4ccd-8bd0-f17cf1088082-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "40ca69e6-d778-4ccd-8bd0-f17cf1088082" (UID: "40ca69e6-d778-4ccd-8bd0-f17cf1088082"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:09:45.747486 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.747430    2575 scope.go:117] "RemoveContainer" containerID="6606bd40d65faddc5e622b71cdc38e9e6092c9bdbba55e2959dfbb7fd1433d66"
Jul 29 21:09:45.750307 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.750284    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "40ca69e6-d778-4ccd-8bd0-f17cf1088082" (UID: "40ca69e6-d778-4ccd-8bd0-f17cf1088082"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:45.757119 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.757101    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-web-config" (OuterVolumeSpecName: "web-config") pod "40ca69e6-d778-4ccd-8bd0-f17cf1088082" (UID: "40ca69e6-d778-4ccd-8bd0-f17cf1088082"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:45.767936 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.767918    2575 scope.go:117] "RemoveContainer" containerID="7caed4e56b1f53cf3aa1838200e31b66a3791f14e4b013c223167f83fd8b3252"
Jul 29 21:09:45.774712 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.774697    2575 scope.go:117] "RemoveContainer" containerID="96da9615efd09c07f308810d2c3eda9d4f88c2eefc335aa1163a336ab422292c"
Jul 29 21:09:45.781091 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.781078    2575 scope.go:117] "RemoveContainer" containerID="60a2174b0c286744344f23a7815298cd047cd58688f931c6501d5f1258d2d9fe"
Jul 29 21:09:45.781340 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:09:45.781319    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60a2174b0c286744344f23a7815298cd047cd58688f931c6501d5f1258d2d9fe\": container with ID starting with 60a2174b0c286744344f23a7815298cd047cd58688f931c6501d5f1258d2d9fe not found: ID does not exist" containerID="60a2174b0c286744344f23a7815298cd047cd58688f931c6501d5f1258d2d9fe"
Jul 29 21:09:45.781387 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.781348    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a2174b0c286744344f23a7815298cd047cd58688f931c6501d5f1258d2d9fe"} err="failed to get container status \"60a2174b0c286744344f23a7815298cd047cd58688f931c6501d5f1258d2d9fe\": rpc error: code = NotFound desc = could not find container \"60a2174b0c286744344f23a7815298cd047cd58688f931c6501d5f1258d2d9fe\": container with ID starting with 60a2174b0c286744344f23a7815298cd047cd58688f931c6501d5f1258d2d9fe not found: ID does not exist"
Jul 29 21:09:45.781387 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.781381    2575 scope.go:117] "RemoveContainer" containerID="f544262bdd086ec9b6fe11e82cdc7e73f8f5f8a279f70d6ebcf8dfe07bdb43ce"
Jul 29 21:09:45.781639 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:09:45.781621    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f544262bdd086ec9b6fe11e82cdc7e73f8f5f8a279f70d6ebcf8dfe07bdb43ce\": container with ID starting with f544262bdd086ec9b6fe11e82cdc7e73f8f5f8a279f70d6ebcf8dfe07bdb43ce not found: ID does not exist" containerID="f544262bdd086ec9b6fe11e82cdc7e73f8f5f8a279f70d6ebcf8dfe07bdb43ce"
Jul 29 21:09:45.781683 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.781648    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f544262bdd086ec9b6fe11e82cdc7e73f8f5f8a279f70d6ebcf8dfe07bdb43ce"} err="failed to get container status \"f544262bdd086ec9b6fe11e82cdc7e73f8f5f8a279f70d6ebcf8dfe07bdb43ce\": rpc error: code = NotFound desc = could not find container \"f544262bdd086ec9b6fe11e82cdc7e73f8f5f8a279f70d6ebcf8dfe07bdb43ce\": container with ID starting with f544262bdd086ec9b6fe11e82cdc7e73f8f5f8a279f70d6ebcf8dfe07bdb43ce not found: ID does not exist"
Jul 29 21:09:45.781683 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.781664    2575 scope.go:117] "RemoveContainer" containerID="75b74c974a1df92439bb31213495122dcdad00df38b45fc58a4348830287fe9f"
Jul 29 21:09:45.781900 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:09:45.781884    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75b74c974a1df92439bb31213495122dcdad00df38b45fc58a4348830287fe9f\": container with ID starting with 75b74c974a1df92439bb31213495122dcdad00df38b45fc58a4348830287fe9f not found: ID does not exist" containerID="75b74c974a1df92439bb31213495122dcdad00df38b45fc58a4348830287fe9f"
Jul 29 21:09:45.781945 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.781904    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75b74c974a1df92439bb31213495122dcdad00df38b45fc58a4348830287fe9f"} err="failed to get container status \"75b74c974a1df92439bb31213495122dcdad00df38b45fc58a4348830287fe9f\": rpc error: code = NotFound desc = could not find container \"75b74c974a1df92439bb31213495122dcdad00df38b45fc58a4348830287fe9f\": container with ID starting with 75b74c974a1df92439bb31213495122dcdad00df38b45fc58a4348830287fe9f not found: ID does not exist"
Jul 29 21:09:45.781945 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.781926    2575 scope.go:117] "RemoveContainer" containerID="2c30c8584df84df4cefbac35382837e0d97462046797cdd3aa38a78ae274e0b6"
Jul 29 21:09:45.782140 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:09:45.782120    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c30c8584df84df4cefbac35382837e0d97462046797cdd3aa38a78ae274e0b6\": container with ID starting with 2c30c8584df84df4cefbac35382837e0d97462046797cdd3aa38a78ae274e0b6 not found: ID does not exist" containerID="2c30c8584df84df4cefbac35382837e0d97462046797cdd3aa38a78ae274e0b6"
Jul 29 21:09:45.782201 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.782147    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c30c8584df84df4cefbac35382837e0d97462046797cdd3aa38a78ae274e0b6"} err="failed to get container status \"2c30c8584df84df4cefbac35382837e0d97462046797cdd3aa38a78ae274e0b6\": rpc error: code = NotFound desc = could not find container \"2c30c8584df84df4cefbac35382837e0d97462046797cdd3aa38a78ae274e0b6\": container with ID starting with 2c30c8584df84df4cefbac35382837e0d97462046797cdd3aa38a78ae274e0b6 not found: ID does not exist"
Jul 29 21:09:45.782201 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.782169    2575 scope.go:117] "RemoveContainer" containerID="6606bd40d65faddc5e622b71cdc38e9e6092c9bdbba55e2959dfbb7fd1433d66"
Jul 29 21:09:45.782425 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:09:45.782410    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6606bd40d65faddc5e622b71cdc38e9e6092c9bdbba55e2959dfbb7fd1433d66\": container with ID starting with 6606bd40d65faddc5e622b71cdc38e9e6092c9bdbba55e2959dfbb7fd1433d66 not found: ID does not exist" containerID="6606bd40d65faddc5e622b71cdc38e9e6092c9bdbba55e2959dfbb7fd1433d66"
Jul 29 21:09:45.782495 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.782429    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6606bd40d65faddc5e622b71cdc38e9e6092c9bdbba55e2959dfbb7fd1433d66"} err="failed to get container status \"6606bd40d65faddc5e622b71cdc38e9e6092c9bdbba55e2959dfbb7fd1433d66\": rpc error: code = NotFound desc = could not find container \"6606bd40d65faddc5e622b71cdc38e9e6092c9bdbba55e2959dfbb7fd1433d66\": container with ID starting with 6606bd40d65faddc5e622b71cdc38e9e6092c9bdbba55e2959dfbb7fd1433d66 not found: ID does not exist"
Jul 29 21:09:45.782495 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.782464    2575 scope.go:117] "RemoveContainer" containerID="7caed4e56b1f53cf3aa1838200e31b66a3791f14e4b013c223167f83fd8b3252"
Jul 29 21:09:45.782682 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:09:45.782665    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7caed4e56b1f53cf3aa1838200e31b66a3791f14e4b013c223167f83fd8b3252\": container with ID starting with 7caed4e56b1f53cf3aa1838200e31b66a3791f14e4b013c223167f83fd8b3252 not found: ID does not exist" containerID="7caed4e56b1f53cf3aa1838200e31b66a3791f14e4b013c223167f83fd8b3252"
Jul 29 21:09:45.782724 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.782686    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7caed4e56b1f53cf3aa1838200e31b66a3791f14e4b013c223167f83fd8b3252"} err="failed to get container status \"7caed4e56b1f53cf3aa1838200e31b66a3791f14e4b013c223167f83fd8b3252\": rpc error: code = NotFound desc = could not find container \"7caed4e56b1f53cf3aa1838200e31b66a3791f14e4b013c223167f83fd8b3252\": container with ID starting with 7caed4e56b1f53cf3aa1838200e31b66a3791f14e4b013c223167f83fd8b3252 not found: ID does not exist"
Jul 29 21:09:45.782724 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.782700    2575 scope.go:117] "RemoveContainer" containerID="96da9615efd09c07f308810d2c3eda9d4f88c2eefc335aa1163a336ab422292c"
Jul 29 21:09:45.782917 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:09:45.782900    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96da9615efd09c07f308810d2c3eda9d4f88c2eefc335aa1163a336ab422292c\": container with ID starting with 96da9615efd09c07f308810d2c3eda9d4f88c2eefc335aa1163a336ab422292c not found: ID does not exist" containerID="96da9615efd09c07f308810d2c3eda9d4f88c2eefc335aa1163a336ab422292c"
Jul 29 21:09:45.782969 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.782923    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96da9615efd09c07f308810d2c3eda9d4f88c2eefc335aa1163a336ab422292c"} err="failed to get container status \"96da9615efd09c07f308810d2c3eda9d4f88c2eefc335aa1163a336ab422292c\": rpc error: code = NotFound desc = could not find container \"96da9615efd09c07f308810d2c3eda9d4f88c2eefc335aa1163a336ab422292c\": container with ID starting with 96da9615efd09c07f308810d2c3eda9d4f88c2eefc335aa1163a336ab422292c not found: ID does not exist"
Jul 29 21:09:45.843066 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.843040    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mdgs\" (UniqueName: \"kubernetes.io/projected/40ca69e6-d778-4ccd-8bd0-f17cf1088082-kube-api-access-6mdgs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:45.843164 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.843069    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40ca69e6-d778-4ccd-8bd0-f17cf1088082-config-out\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:45.843164 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.843083    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40ca69e6-d778-4ccd-8bd0-f17cf1088082-tls-assets\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:45.843164 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.843093    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:45.843164 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.843103    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-web-config\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:45.843164 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.843111    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40ca69e6-d778-4ccd-8bd0-f17cf1088082-metrics-client-ca\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:45.843164 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.843119    2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-cluster-tls-config\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:45.843164 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.843130    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:45.843164 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.843144    2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-config-volume\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:45.843164 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.843152    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ca69e6-d778-4ccd-8bd0-f17cf1088082-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:45.843164 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.843160    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-main-tls\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:45.843481 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:45.843169    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40ca69e6-d778-4ccd-8bd0-f17cf1088082-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:46.043680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.043648    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 21:09:46.048694 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.048666    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 21:09:46.083712 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.083683    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 21:09:46.084042 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084027    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="alertmanager"
Jul 29 21:09:46.084101 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084044    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="alertmanager"
Jul 29 21:09:46.084101 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084053    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="kube-rbac-proxy-web"
Jul 29 21:09:46.084101 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084059    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="kube-rbac-proxy-web"
Jul 29 21:09:46.084101 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084068    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="prom-label-proxy"
Jul 29 21:09:46.084101 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084074    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="prom-label-proxy"
Jul 29 21:09:46.084101 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084082    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86593cfc-07e7-476a-921d-85ed51cedccc" containerName="registry"
Jul 29 21:09:46.084101 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084088    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="86593cfc-07e7-476a-921d-85ed51cedccc" containerName="registry"
Jul 29 21:09:46.084101 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084095    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="config-reloader"
Jul 29 21:09:46.084101 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084100    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="config-reloader"
Jul 29 21:09:46.084356 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084106    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="kube-rbac-proxy-metric"
Jul 29 21:09:46.084356 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084112    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="kube-rbac-proxy-metric"
Jul 29 21:09:46.084356 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084121    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="kube-rbac-proxy"
Jul 29 21:09:46.084356 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084126    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="kube-rbac-proxy"
Jul 29 21:09:46.084356 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084133    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="init-config-reloader"
Jul 29 21:09:46.084356 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084139    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="init-config-reloader"
Jul 29 21:09:46.084356 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084192    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="config-reloader"
Jul 29 21:09:46.084356 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084201    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="kube-rbac-proxy"
Jul 29 21:09:46.084356 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084206    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="86593cfc-07e7-476a-921d-85ed51cedccc" containerName="registry"
Jul 29 21:09:46.084356 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084212    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="alertmanager"
Jul 29 21:09:46.084356 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084218    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="kube-rbac-proxy-web"
Jul 29 21:09:46.084356 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084223    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="prom-label-proxy"
Jul 29 21:09:46.084356 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.084229    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" containerName="kube-rbac-proxy-metric"
Jul 29 21:09:46.089595 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.089577    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.092464 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.092431    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 29 21:09:46.092568 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.092510    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 29 21:09:46.092613 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.092561    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7gv4c\""
Jul 29 21:09:46.092785 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.092764    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 29 21:09:46.092870 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.092798    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 29 21:09:46.093078 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.093064    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 29 21:09:46.093219 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.093205    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 29 21:09:46.093419 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.093403    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 29 21:09:46.094545 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.094524    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 29 21:09:46.097920 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.097904    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 29 21:09:46.107929 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.105125    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 21:09:46.245484 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.245435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f8eb66e-8113-45c3-805d-7188465bc594-config-out\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.245627 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.245491    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.245627 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.245518    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2f8eb66e-8113-45c3-805d-7188465bc594-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.245627 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.245562    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f8eb66e-8113-45c3-805d-7188465bc594-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.245627 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.245611    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-config-volume\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.245759 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.245627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx226\" (UniqueName: \"kubernetes.io/projected/2f8eb66e-8113-45c3-805d-7188465bc594-kube-api-access-tx226\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.245759 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.245665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.245759 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.245685    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f8eb66e-8113-45c3-805d-7188465bc594-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.245759 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.245710    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-web-config\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.245759 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.245724    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f8eb66e-8113-45c3-805d-7188465bc594-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.245903 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.245773    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.245903 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.245799    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.245903 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.245839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.346846 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.346817    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-web-config\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.346846 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.346849    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f8eb66e-8113-45c3-805d-7188465bc594-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.347055 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.346872    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.347055 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.346888    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.347055 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.346912    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.347055 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.347045    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f8eb66e-8113-45c3-805d-7188465bc594-config-out\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.347279 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.347095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.347279 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.347127    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2f8eb66e-8113-45c3-805d-7188465bc594-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.347279 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.347161    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f8eb66e-8113-45c3-805d-7188465bc594-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.347279 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.347215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-config-volume\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.347279 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.347237    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx226\" (UniqueName: \"kubernetes.io/projected/2f8eb66e-8113-45c3-805d-7188465bc594-kube-api-access-tx226\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.347279 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.347270    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.347623 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.347299    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f8eb66e-8113-45c3-805d-7188465bc594-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.347853 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.347680    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f8eb66e-8113-45c3-805d-7188465bc594-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.348329 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.348303    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f8eb66e-8113-45c3-805d-7188465bc594-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.349891 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.349867    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f8eb66e-8113-45c3-805d-7188465bc594-config-out\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.350331 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.350004    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.350331 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.350145    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.350331 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.350162    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f8eb66e-8113-45c3-805d-7188465bc594-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.350331 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.350227    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.350331 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.350279    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2f8eb66e-8113-45c3-805d-7188465bc594-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.350331 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.350316    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-web-config\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.350648 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.350546    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-config-volume\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.350804 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.350785    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.351787 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.351767    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f8eb66e-8113-45c3-805d-7188465bc594-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.357015 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.356999    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx226\" (UniqueName: \"kubernetes.io/projected/2f8eb66e-8113-45c3-805d-7188465bc594-kube-api-access-tx226\") pod \"alertmanager-main-0\" (UID: \"2f8eb66e-8113-45c3-805d-7188465bc594\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.399037 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.399013    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 21:09:46.482479 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.482428    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40ca69e6-d778-4ccd-8bd0-f17cf1088082" path="/var/lib/kubelet/pods/40ca69e6-d778-4ccd-8bd0-f17cf1088082/volumes"
Jul 29 21:09:46.538588 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.538381    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 21:09:46.541113 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:09:46.541086    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f8eb66e_8113_45c3_805d_7188465bc594.slice/crio-575257d43da80e88d3e49adae3043f10cb5316e841de6a7934f35bea74a11555 WatchSource:0}: Error finding container 575257d43da80e88d3e49adae3043f10cb5316e841de6a7934f35bea74a11555: Status 404 returned error can't find the container with id 575257d43da80e88d3e49adae3043f10cb5316e841de6a7934f35bea74a11555
Jul 29 21:09:46.722682 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.722656    2575 generic.go:356] "Generic (PLEG): container finished" podID="2f8eb66e-8113-45c3-805d-7188465bc594" containerID="47a087414e5f8c38123ecd835d81b2e1ef295a4cf398e817bebf775ad21bb39a" exitCode=0
Jul 29 21:09:46.723045 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.722740    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f8eb66e-8113-45c3-805d-7188465bc594","Type":"ContainerDied","Data":"47a087414e5f8c38123ecd835d81b2e1ef295a4cf398e817bebf775ad21bb39a"}
Jul 29 21:09:46.723045 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:46.722803    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f8eb66e-8113-45c3-805d-7188465bc594","Type":"ContainerStarted","Data":"575257d43da80e88d3e49adae3043f10cb5316e841de6a7934f35bea74a11555"}
Jul 29 21:09:47.731556 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:47.731521    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f8eb66e-8113-45c3-805d-7188465bc594","Type":"ContainerStarted","Data":"ed488107142fde534c0c0bbb2fc130b90e73088ca1d92ea53e2bd13ba57f3579"}
Jul 29 21:09:47.731974 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:47.731586    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f8eb66e-8113-45c3-805d-7188465bc594","Type":"ContainerStarted","Data":"f9a86f5f90b9ef2b89f543e776e72508049dcd8688739fa5bd1365ac92168d53"}
Jul 29 21:09:47.731974 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:47.731614    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f8eb66e-8113-45c3-805d-7188465bc594","Type":"ContainerStarted","Data":"2cc49f8ac582b51d9cc9b0ebdbfb310cd5f25da22f86cc1f261605e6e50179d5"}
Jul 29 21:09:47.731974 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:47.731639    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f8eb66e-8113-45c3-805d-7188465bc594","Type":"ContainerStarted","Data":"b3b1772723adc751f5d06e8e106bf885ea235a95837c9d7aaf75e12cf8b91d1b"}
Jul 29 21:09:47.731974 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:47.731668    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f8eb66e-8113-45c3-805d-7188465bc594","Type":"ContainerStarted","Data":"c7d7d0d65c3207f4266e42e138eaf1d22c913275af055a8e6d8fbaaf64d4b08f"}
Jul 29 21:09:47.731974 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:47.731692    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f8eb66e-8113-45c3-805d-7188465bc594","Type":"ContainerStarted","Data":"7a67c4bbb504b92f92d70745599220824ec393401e292e5624529c41adc39911"}
Jul 29 21:09:47.762462 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:47.762403    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.7479484379999999 podStartE2EDuration="1.762386081s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.437643ms" isStatefulPod=false podCreationTimestamp="2026-07-29 21:09:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:09:47.760874624 +0000 UTC m=+379.766398013" watchObservedRunningTime="2026-07-29 21:09:47.762386081 +0000 UTC m=+379.767909478"
Jul 29 21:09:48.568627 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.568589    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 21:09:48.568887 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.568839    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="prometheus" containerID="cri-o://098a9d03ad5eab5a872fd42ad50321fceadd83a9e8f2da78a37ec98479747d4f" gracePeriod=600
Jul 29 21:09:48.569046 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.568887    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="kube-rbac-proxy" containerID="cri-o://dba48a885cf49395e2beb0be1da7fd52e88bef2111bbf726f43c7d5a6805badc" gracePeriod=600
Jul 29 21:09:48.569046 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.568887    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="thanos-sidecar" containerID="cri-o://297c640041cf437680b9d40634aa4cbf6c62d27adb78dae194b875fdafcb9369" gracePeriod=600
Jul 29 21:09:48.569046 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.568932    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="kube-rbac-proxy-web" containerID="cri-o://a0e3858fc4a624fa4e3cab536ae63e7fcd129ed954ed5b6241987d4e7771b37a" gracePeriod=600
Jul 29 21:09:48.569046 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.568890    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="config-reloader" containerID="cri-o://e9958da44849e6e8142e447f6a31eeeb9048257e5b7ae8bf997cd1d890c27b43" gracePeriod=600
Jul 29 21:09:48.569046 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.568936    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5094cebf31bc8ecc2f125092e5a14debd5a5ccb4d3497f335f3c065813ae1baa" gracePeriod=600
Jul 29 21:09:48.739623 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.739600    2575 generic.go:356] "Generic (PLEG): container finished" podID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerID="5094cebf31bc8ecc2f125092e5a14debd5a5ccb4d3497f335f3c065813ae1baa" exitCode=0
Jul 29 21:09:48.739623 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.739621    2575 generic.go:356] "Generic (PLEG): container finished" podID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerID="dba48a885cf49395e2beb0be1da7fd52e88bef2111bbf726f43c7d5a6805badc" exitCode=0
Jul 29 21:09:48.739623 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.739627    2575 generic.go:356] "Generic (PLEG): container finished" podID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerID="297c640041cf437680b9d40634aa4cbf6c62d27adb78dae194b875fdafcb9369" exitCode=0
Jul 29 21:09:48.739983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.739633    2575 generic.go:356] "Generic (PLEG): container finished" podID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerID="e9958da44849e6e8142e447f6a31eeeb9048257e5b7ae8bf997cd1d890c27b43" exitCode=0
Jul 29 21:09:48.739983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.739638    2575 generic.go:356] "Generic (PLEG): container finished" podID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerID="098a9d03ad5eab5a872fd42ad50321fceadd83a9e8f2da78a37ec98479747d4f" exitCode=0
Jul 29 21:09:48.739983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.739673    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"586caa69-5327-4e64-bc5b-57ea54ac3410","Type":"ContainerDied","Data":"5094cebf31bc8ecc2f125092e5a14debd5a5ccb4d3497f335f3c065813ae1baa"}
Jul 29 21:09:48.739983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.739744    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"586caa69-5327-4e64-bc5b-57ea54ac3410","Type":"ContainerDied","Data":"dba48a885cf49395e2beb0be1da7fd52e88bef2111bbf726f43c7d5a6805badc"}
Jul 29 21:09:48.739983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.739774    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"586caa69-5327-4e64-bc5b-57ea54ac3410","Type":"ContainerDied","Data":"297c640041cf437680b9d40634aa4cbf6c62d27adb78dae194b875fdafcb9369"}
Jul 29 21:09:48.739983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.739798    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"586caa69-5327-4e64-bc5b-57ea54ac3410","Type":"ContainerDied","Data":"e9958da44849e6e8142e447f6a31eeeb9048257e5b7ae8bf997cd1d890c27b43"}
Jul 29 21:09:48.739983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:48.739822    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"586caa69-5327-4e64-bc5b-57ea54ac3410","Type":"ContainerDied","Data":"098a9d03ad5eab5a872fd42ad50321fceadd83a9e8f2da78a37ec98479747d4f"}
Jul 29 21:09:49.596627 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.596591    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:49.697458 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.697414    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:49.751328 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.751302    2575 generic.go:356] "Generic (PLEG): container finished" podID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerID="a0e3858fc4a624fa4e3cab536ae63e7fcd129ed954ed5b6241987d4e7771b37a" exitCode=0
Jul 29 21:09:49.751650 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.751333    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"586caa69-5327-4e64-bc5b-57ea54ac3410","Type":"ContainerDied","Data":"a0e3858fc4a624fa4e3cab536ae63e7fcd129ed954ed5b6241987d4e7771b37a"}
Jul 29 21:09:49.812753 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.812726    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:49.977036 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.976952    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-serving-certs-ca-bundle\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977036 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.976988    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-1\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977036 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977006    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977036 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977039    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-db\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977354 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977163    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-metrics-client-certs\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977354 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977205    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-config\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977354 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977233    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/586caa69-5327-4e64-bc5b-57ea54ac3410-config-out\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977354 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977270    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-2\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977354 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977311    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977354 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977338    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl5hw\" (UniqueName: \"kubernetes.io/projected/586caa69-5327-4e64-bc5b-57ea54ac3410-kube-api-access-hl5hw\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977361    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-web-config\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977375    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:09:49.977680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977392    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-thanos-prometheus-http-client-file\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977427    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-grpc-tls\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977436    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:09:49.977680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977489    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-metrics-client-ca\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977518    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-0\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977562    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-kube-rbac-proxy\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977598    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-trusted-ca-bundle\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977629    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-tls\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.977680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977662    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-kubelet-serving-ca-bundle\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.978202 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977690    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/586caa69-5327-4e64-bc5b-57ea54ac3410-tls-assets\") pod \"586caa69-5327-4e64-bc5b-57ea54ac3410\" (UID: \"586caa69-5327-4e64-bc5b-57ea54ac3410\") "
Jul 29 21:09:49.978202 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977860    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:09:49.978202 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.977987    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:49.978202 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.978007    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:49.978202 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.978022    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:49.978467 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.978321    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:09:49.980495 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.978841    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:09:49.980495 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.978969    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:09:49.980495 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.980078    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:49.980495 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.980172    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:09:49.980495 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.980438    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:09:49.981298 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.981192    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/586caa69-5327-4e64-bc5b-57ea54ac3410-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:09:49.981298 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.981265    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:49.981907 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.981881    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/586caa69-5327-4e64-bc5b-57ea54ac3410-kube-api-access-hl5hw" (OuterVolumeSpecName: "kube-api-access-hl5hw") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "kube-api-access-hl5hw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:09:49.982049 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.982027    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:49.982128 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.982061    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:49.982309 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.982285    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:49.982399 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.982334    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/586caa69-5327-4e64-bc5b-57ea54ac3410-config-out" (OuterVolumeSpecName: "config-out") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:09:49.982627 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.982602    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-config" (OuterVolumeSpecName: "config") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:49.982794 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.982760    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:49.982794 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.982778    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:49.992109 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:49.992087    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-web-config" (OuterVolumeSpecName: "web-config") pod "586caa69-5327-4e64-bc5b-57ea54ac3410" (UID: "586caa69-5327-4e64-bc5b-57ea54ac3410"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:09:50.079380 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079352    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.079380 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079377    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl5hw\" (UniqueName: \"kubernetes.io/projected/586caa69-5327-4e64-bc5b-57ea54ac3410-kube-api-access-hl5hw\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.079561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079389    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-web-config\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.079561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079399    2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.079561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079409    2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-grpc-tls\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.079561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079418    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-metrics-client-ca\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.079561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079425    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.079561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079433    2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-kube-rbac-proxy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.079561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079442    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.079561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079464    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.079561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079473    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/586caa69-5327-4e64-bc5b-57ea54ac3410-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.079561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079481    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/586caa69-5327-4e64-bc5b-57ea54ac3410-tls-assets\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.079561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079490    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.079561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079498    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/586caa69-5327-4e64-bc5b-57ea54ac3410-prometheus-k8s-db\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.079561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079506    2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-secret-metrics-client-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.079561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079513    2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/586caa69-5327-4e64-bc5b-57ea54ac3410-config\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.079561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.079521    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/586caa69-5327-4e64-bc5b-57ea54ac3410-config-out\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:09:50.758753 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.758672    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"586caa69-5327-4e64-bc5b-57ea54ac3410","Type":"ContainerDied","Data":"a5a74ee58197d6b3aa3672cf66bc417df0f891fee65cce27ce024cf6a67844ed"}
Jul 29 21:09:50.758753 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.758733    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.759172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.758764    2575 scope.go:117] "RemoveContainer" containerID="5094cebf31bc8ecc2f125092e5a14debd5a5ccb4d3497f335f3c065813ae1baa"
Jul 29 21:09:50.767335 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.767316    2575 scope.go:117] "RemoveContainer" containerID="dba48a885cf49395e2beb0be1da7fd52e88bef2111bbf726f43c7d5a6805badc"
Jul 29 21:09:50.777030 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.777011    2575 scope.go:117] "RemoveContainer" containerID="a0e3858fc4a624fa4e3cab536ae63e7fcd129ed954ed5b6241987d4e7771b37a"
Jul 29 21:09:50.783018 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.782997    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 21:09:50.785109 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.785083    2575 scope.go:117] "RemoveContainer" containerID="297c640041cf437680b9d40634aa4cbf6c62d27adb78dae194b875fdafcb9369"
Jul 29 21:09:50.790618 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.787713    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 21:09:50.796208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.796184    2575 scope.go:117] "RemoveContainer" containerID="e9958da44849e6e8142e447f6a31eeeb9048257e5b7ae8bf997cd1d890c27b43"
Jul 29 21:09:50.802942 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.802911    2575 scope.go:117] "RemoveContainer" containerID="098a9d03ad5eab5a872fd42ad50321fceadd83a9e8f2da78a37ec98479747d4f"
Jul 29 21:09:50.810025 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.810007    2575 scope.go:117] "RemoveContainer" containerID="b3f9b03821f9ac4cd9eb1260e7f8145881beca7f7d6be47d320b7ef749c7762a"
Jul 29 21:09:50.812529 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812507    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 21:09:50.812824 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812812    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="prometheus"
Jul 29 21:09:50.812861 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812826    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="prometheus"
Jul 29 21:09:50.812861 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812852    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="config-reloader"
Jul 29 21:09:50.812861 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812858    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="config-reloader"
Jul 29 21:09:50.812950 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812864    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="thanos-sidecar"
Jul 29 21:09:50.812950 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812870    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="thanos-sidecar"
Jul 29 21:09:50.812950 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812879    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="kube-rbac-proxy-thanos"
Jul 29 21:09:50.812950 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812891    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="kube-rbac-proxy-thanos"
Jul 29 21:09:50.812950 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812902    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="kube-rbac-proxy"
Jul 29 21:09:50.812950 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812908    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="kube-rbac-proxy"
Jul 29 21:09:50.812950 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812918    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="init-config-reloader"
Jul 29 21:09:50.812950 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812923    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="init-config-reloader"
Jul 29 21:09:50.812950 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812929    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="kube-rbac-proxy-web"
Jul 29 21:09:50.812950 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812934    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="kube-rbac-proxy-web"
Jul 29 21:09:50.813275 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812982    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="config-reloader"
Jul 29 21:09:50.813275 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812989    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="thanos-sidecar"
Jul 29 21:09:50.813275 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.812994    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="prometheus"
Jul 29 21:09:50.813275 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.813002    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="kube-rbac-proxy"
Jul 29 21:09:50.813275 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.813008    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="kube-rbac-proxy-web"
Jul 29 21:09:50.813275 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.813014    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" containerName="kube-rbac-proxy-thanos"
Jul 29 21:09:50.818254 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.818238    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.821139 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.821121    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 29 21:09:50.821221 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.821144    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d9g561ciocn06\""
Jul 29 21:09:50.821221 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.821168    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 29 21:09:50.821297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.821244    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 29 21:09:50.821723 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.821701    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 29 21:09:50.821814 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.821722    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 29 21:09:50.821814 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.821767    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 29 21:09:50.822038 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.822025    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 29 21:09:50.822238 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.822222    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-t55mz\""
Jul 29 21:09:50.822299 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.822267    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 29 21:09:50.822348 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.822301    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 29 21:09:50.822509 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.822493    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 29 21:09:50.822643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.822526    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 29 21:09:50.822643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.822529    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 29 21:09:50.823831 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.823814    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 29 21:09:50.825798 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.825776    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 29 21:09:50.828024 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.828002    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 29 21:09:50.833553 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.833532    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 21:09:50.985419 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985372    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da187a43-e8fe-4228-ae44-2d89de6a5506-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.985419 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.985655 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.985655 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985542    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.985655 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.985655 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985602    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.985655 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.985883 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985660    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-web-config\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.985883 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985683    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.985883 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985717    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.985883 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985743    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.985883 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985780    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.985883 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.985883 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.985883 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-config\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.985883 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985866    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da187a43-e8fe-4228-ae44-2d89de6a5506-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.985883 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985886    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.986213 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985917    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da187a43-e8fe-4228-ae44-2d89de6a5506-config-out\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.986213 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985950    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:50.986213 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:50.985971    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msftb\" (UniqueName: \"kubernetes.io/projected/da187a43-e8fe-4228-ae44-2d89de6a5506-kube-api-access-msftb\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.087189 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da187a43-e8fe-4228-ae44-2d89de6a5506-config-out\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.087319 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087199    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.087319 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087226    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msftb\" (UniqueName: \"kubernetes.io/projected/da187a43-e8fe-4228-ae44-2d89de6a5506-kube-api-access-msftb\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.087319 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087260    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da187a43-e8fe-4228-ae44-2d89de6a5506-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.087319 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087287    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.087319 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087314    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.087580 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087345    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.087580 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087379    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.087580 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087397    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.087580 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087420    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.087580 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087463    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-web-config\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.087580 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087486    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.087580 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.087580 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087551    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.088041 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087586    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.088041 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087613    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.088041 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087652    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.088041 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-config\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.088041 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087705    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da187a43-e8fe-4228-ae44-2d89de6a5506-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.088041 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087757    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.088041 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.088041 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.087909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.088430 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.088127    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.088549 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.088527    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.088873 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.088849    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.090346 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.090322    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.090491 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.090468    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da187a43-e8fe-4228-ae44-2d89de6a5506-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.090667 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.090642    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.091585 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.090933    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da187a43-e8fe-4228-ae44-2d89de6a5506-config-out\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.091585 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.091169    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.091585 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.091286    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.091585 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.091405    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.091585 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.091481    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.091585 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.091575    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da187a43-e8fe-4228-ae44-2d89de6a5506-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.092560 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.092531    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da187a43-e8fe-4228-ae44-2d89de6a5506-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.092710 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.092695    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-config\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.093143 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.093126    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-web-config\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.093467 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.093432    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.093602 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.093584    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da187a43-e8fe-4228-ae44-2d89de6a5506-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.096669 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.096648    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msftb\" (UniqueName: \"kubernetes.io/projected/da187a43-e8fe-4228-ae44-2d89de6a5506-kube-api-access-msftb\") pod \"prometheus-k8s-0\" (UID: \"da187a43-e8fe-4228-ae44-2d89de6a5506\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.128704 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.128682    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:09:51.266657 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.266625    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 21:09:51.269768 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:09:51.269740    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda187a43_e8fe_4228_ae44_2d89de6a5506.slice/crio-392c3bf7c9f223d387564a50731768b54c6b87923af35ffdf0a03cdc75bdab88 WatchSource:0}: Error finding container 392c3bf7c9f223d387564a50731768b54c6b87923af35ffdf0a03cdc75bdab88: Status 404 returned error can't find the container with id 392c3bf7c9f223d387564a50731768b54c6b87923af35ffdf0a03cdc75bdab88
Jul 29 21:09:51.765475 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.765376    2575 generic.go:356] "Generic (PLEG): container finished" podID="da187a43-e8fe-4228-ae44-2d89de6a5506" containerID="8d4024a52cda071c7b345f78eca5a2b789227b04d49dd92da76b0a83a713c4dd" exitCode=0
Jul 29 21:09:51.765814 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.765481    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da187a43-e8fe-4228-ae44-2d89de6a5506","Type":"ContainerDied","Data":"8d4024a52cda071c7b345f78eca5a2b789227b04d49dd92da76b0a83a713c4dd"}
Jul 29 21:09:51.765814 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:51.765559    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da187a43-e8fe-4228-ae44-2d89de6a5506","Type":"ContainerStarted","Data":"392c3bf7c9f223d387564a50731768b54c6b87923af35ffdf0a03cdc75bdab88"}
Jul 29 21:09:52.202505 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:52.202437    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:52.268591 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:52.268550    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:52.325851 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:52.325826    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:52.404567 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:52.404536    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:09:52.481122 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:52.481099    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="586caa69-5327-4e64-bc5b-57ea54ac3410" path="/var/lib/kubelet/pods/586caa69-5327-4e64-bc5b-57ea54ac3410/volumes"
Jul 29 21:09:52.773194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:52.773115    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da187a43-e8fe-4228-ae44-2d89de6a5506","Type":"ContainerStarted","Data":"90e3c9723d56b0c07b13b77fa0357119b8412ecbbf0634b33b6f48cae9f6fead"}
Jul 29 21:09:52.773535 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:52.773194    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da187a43-e8fe-4228-ae44-2d89de6a5506","Type":"ContainerStarted","Data":"a80292aa31d029ff043d65b35dbc84b08e17a2f3fb91883cc9adb1300e7ef0c6"}
Jul 29 21:09:52.773535 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:52.773236    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da187a43-e8fe-4228-ae44-2d89de6a5506","Type":"ContainerStarted","Data":"369614bf4fe0216c877302c6dad8321e15491c7fdda01788875f9f05483648fe"}
Jul 29 21:09:52.773535 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:52.773276    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da187a43-e8fe-4228-ae44-2d89de6a5506","Type":"ContainerStarted","Data":"beb8b3eb74caa5dcdf15eeea876d7de95a60d5a04abe76929bded12bed862c1b"}
Jul 29 21:09:52.773535 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:52.773317    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da187a43-e8fe-4228-ae44-2d89de6a5506","Type":"ContainerStarted","Data":"c8b2941cc9e92dacb791ee92051a5ce57b1378c92c4ceec60e2142b59e8e7d1d"}
Jul 29 21:09:52.773535 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:52.773354    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da187a43-e8fe-4228-ae44-2d89de6a5506","Type":"ContainerStarted","Data":"93ba81b23094b34af813d498051bb4e794f68988451821b4a81932e9ab52739e"}
Jul 29 21:09:52.803490 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:52.803418    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.784208351 podStartE2EDuration="2.803398484s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.190133ms" isStatefulPod=false podCreationTimestamp="2026-07-29 21:09:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:09:52.802295957 +0000 UTC m=+384.807819363" watchObservedRunningTime="2026-07-29 21:09:52.803398484 +0000 UTC m=+384.808921852"
Jul 29 21:09:56.129032 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:09:56.128997    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:10:01.927570 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:10:01.927535    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:10:02.044927 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:10:02.044886    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:10:21.460826 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:10:21.460786    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:10:21.559688 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:10:21.559654    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:10:37.522117 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:10:37.522084    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:10:44.359191 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:10:44.359156    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:10:44.416956 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:10:44.416898    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:10:46.345024 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:10:46.344994    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:10:46.441280 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:10:46.441247    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:10:51.129633 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:10:51.129553    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:10:51.145078 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:10:51.145047    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:10:52.028481 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:10:52.028433    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 21:11:12.988340 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:12.988305    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:14.379748 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:14.379708    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:16.590433 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:16.590404    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:16.645203 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:16.645170    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:18.323693 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:18.323659    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:18.410925 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:18.410892    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:18.821212 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:18.821177    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:18.928095 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:18.928021    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:20.328151 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:20.328121    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:20.719143 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:20.719061    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:23.582250 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:23.582214    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:23.645879 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:23.645846    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:25.786890 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:25.786855    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:25.889653 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:25.889619    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:28.930633 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:28.930592    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:29.016168 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:29.016139    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d2x46"]
Jul 29 21:11:29.019360 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:29.019343    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-d2x46"
Jul 29 21:11:29.022119 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:29.022095    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 21:11:29.022245 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:29.022102    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 21:11:29.023348 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:29.023331    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kn7gc\""
Jul 29 21:11:29.028952 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:29.028930    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d2x46"]
Jul 29 21:11:29.083713 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:29.083686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndfz4\" (UniqueName: \"kubernetes.io/projected/a90e2f26-ff97-4f51-a182-e7e4344bc6c2-kube-api-access-ndfz4\") pod \"cert-manager-55b4d954d5-d2x46\" (UID: \"a90e2f26-ff97-4f51-a182-e7e4344bc6c2\") " pod="cert-manager/cert-manager-55b4d954d5-d2x46"
Jul 29 21:11:29.083837 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:29.083768    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a90e2f26-ff97-4f51-a182-e7e4344bc6c2-bound-sa-token\") pod \"cert-manager-55b4d954d5-d2x46\" (UID: \"a90e2f26-ff97-4f51-a182-e7e4344bc6c2\") " pod="cert-manager/cert-manager-55b4d954d5-d2x46"
Jul 29 21:11:29.184185 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:29.184114    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a90e2f26-ff97-4f51-a182-e7e4344bc6c2-bound-sa-token\") pod \"cert-manager-55b4d954d5-d2x46\" (UID: \"a90e2f26-ff97-4f51-a182-e7e4344bc6c2\") " pod="cert-manager/cert-manager-55b4d954d5-d2x46"
Jul 29 21:11:29.184185 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:29.184181    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndfz4\" (UniqueName: \"kubernetes.io/projected/a90e2f26-ff97-4f51-a182-e7e4344bc6c2-kube-api-access-ndfz4\") pod \"cert-manager-55b4d954d5-d2x46\" (UID: \"a90e2f26-ff97-4f51-a182-e7e4344bc6c2\") " pod="cert-manager/cert-manager-55b4d954d5-d2x46"
Jul 29 21:11:29.192123 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:29.192100    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a90e2f26-ff97-4f51-a182-e7e4344bc6c2-bound-sa-token\") pod \"cert-manager-55b4d954d5-d2x46\" (UID: \"a90e2f26-ff97-4f51-a182-e7e4344bc6c2\") " pod="cert-manager/cert-manager-55b4d954d5-d2x46"
Jul 29 21:11:29.192288 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:29.192271    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndfz4\" (UniqueName: \"kubernetes.io/projected/a90e2f26-ff97-4f51-a182-e7e4344bc6c2-kube-api-access-ndfz4\") pod \"cert-manager-55b4d954d5-d2x46\" (UID: \"a90e2f26-ff97-4f51-a182-e7e4344bc6c2\") " pod="cert-manager/cert-manager-55b4d954d5-d2x46"
Jul 29 21:11:29.343859 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:29.343829    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-d2x46"
Jul 29 21:11:29.468815 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:29.468756    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d2x46"]
Jul 29 21:11:29.471371 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:11:29.471341    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda90e2f26_ff97_4f51_a182_e7e4344bc6c2.slice/crio-47ffdef1fef907cfbf6b19fba984ceb729153cc4b7f8a3d3e7d892e15442ea53 WatchSource:0}: Error finding container 47ffdef1fef907cfbf6b19fba984ceb729153cc4b7f8a3d3e7d892e15442ea53: Status 404 returned error can't find the container with id 47ffdef1fef907cfbf6b19fba984ceb729153cc4b7f8a3d3e7d892e15442ea53
Jul 29 21:11:30.161944 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:30.161903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-d2x46" event={"ID":"a90e2f26-ff97-4f51-a182-e7e4344bc6c2","Type":"ContainerStarted","Data":"47ffdef1fef907cfbf6b19fba984ceb729153cc4b7f8a3d3e7d892e15442ea53"}
Jul 29 21:11:31.855384 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:31.855346    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:31.952292 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:31.952261    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:32.403094 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:32.403058    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:33.177629 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:33.177546    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-d2x46" event={"ID":"a90e2f26-ff97-4f51-a182-e7e4344bc6c2","Type":"ContainerStarted","Data":"87cfb4d1b2d58ce66f33e86cf32d2a497712cb8e26a645ba08a8da223960cc70"}
Jul 29 21:11:33.194141 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:33.194094    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-d2x46" podStartSLOduration=0.830852268 podStartE2EDuration="4.194079304s" totalImagesPullingTime="3.363227036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:11:33.193613773 +0000 UTC m=+485.199137141" watchObservedRunningTime="2026-07-29 21:11:33.194079304 +0000 UTC m=+485.199602668"
Jul 29 21:11:33.692470 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:33.692424    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mscrd"]
Jul 29 21:11:33.695960 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:33.695936    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mscrd"
Jul 29 21:11:33.698943 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:33.698917    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 21:11:33.698943 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:33.698929    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 21:11:33.700099 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:33.700082    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-nf66q\""
Jul 29 21:11:33.708078 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:33.708057    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mscrd"]
Jul 29 21:11:33.827239 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:33.827200    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6z8p\" (UniqueName: \"kubernetes.io/projected/97892046-0a99-4ee7-8aaf-80be9a987d81-kube-api-access-l6z8p\") pod \"openshift-lws-operator-fd8ccff4c-mscrd\" (UID: \"97892046-0a99-4ee7-8aaf-80be9a987d81\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mscrd"
Jul 29 21:11:33.827239 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:33.827239    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97892046-0a99-4ee7-8aaf-80be9a987d81-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mscrd\" (UID: \"97892046-0a99-4ee7-8aaf-80be9a987d81\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mscrd"
Jul 29 21:11:33.927944 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:33.927912    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6z8p\" (UniqueName: \"kubernetes.io/projected/97892046-0a99-4ee7-8aaf-80be9a987d81-kube-api-access-l6z8p\") pod \"openshift-lws-operator-fd8ccff4c-mscrd\" (UID: \"97892046-0a99-4ee7-8aaf-80be9a987d81\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mscrd"
Jul 29 21:11:33.927944 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:33.927945    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97892046-0a99-4ee7-8aaf-80be9a987d81-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mscrd\" (UID: \"97892046-0a99-4ee7-8aaf-80be9a987d81\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mscrd"
Jul 29 21:11:33.928347 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:33.928331    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97892046-0a99-4ee7-8aaf-80be9a987d81-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mscrd\" (UID: \"97892046-0a99-4ee7-8aaf-80be9a987d81\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mscrd"
Jul 29 21:11:33.937794 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:33.937761    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6z8p\" (UniqueName: \"kubernetes.io/projected/97892046-0a99-4ee7-8aaf-80be9a987d81-kube-api-access-l6z8p\") pod \"openshift-lws-operator-fd8ccff4c-mscrd\" (UID: \"97892046-0a99-4ee7-8aaf-80be9a987d81\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mscrd"
Jul 29 21:11:34.004769 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:34.004691    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mscrd"
Jul 29 21:11:34.134841 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:34.134817    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mscrd"]
Jul 29 21:11:34.137344 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:11:34.137292    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97892046_0a99_4ee7_8aaf_80be9a987d81.slice/crio-cbfc42bde89cebab1de83abdf477dd0331bdd95f14390d3ed5c172b87e737885 WatchSource:0}: Error finding container cbfc42bde89cebab1de83abdf477dd0331bdd95f14390d3ed5c172b87e737885: Status 404 returned error can't find the container with id cbfc42bde89cebab1de83abdf477dd0331bdd95f14390d3ed5c172b87e737885
Jul 29 21:11:34.183282 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:34.183250    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mscrd" event={"ID":"97892046-0a99-4ee7-8aaf-80be9a987d81","Type":"ContainerStarted","Data":"cbfc42bde89cebab1de83abdf477dd0331bdd95f14390d3ed5c172b87e737885"}
Jul 29 21:11:37.207357 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:37.207316    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mscrd" event={"ID":"97892046-0a99-4ee7-8aaf-80be9a987d81","Type":"ContainerStarted","Data":"133a359def5ca75d5a73b85ac096f035843a3e49cdf6ac76ea1e3ea631e17467"}
Jul 29 21:11:37.224456 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:37.224393    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mscrd" podStartSLOduration=1.742821163 podStartE2EDuration="4.224378782s" totalImagesPullingTime="2.481557619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:11:37.222735257 +0000 UTC m=+489.228258625" watchObservedRunningTime="2026-07-29 21:11:37.224378782 +0000 UTC m=+489.229902150"
Jul 29 21:11:37.954651 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:37.954614    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:38.056135 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:38.056103    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:39.536588 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:39.536551    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:56.033000 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:56.032967    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:56.145677 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:56.145647    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:56.614755 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:56.614722    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:56.819390 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:56.819354    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:56.935894 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:56.935823    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:57.005062 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.005029    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"]
Jul 29 21:11:57.012066 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.012045    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.014846 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.014826    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 21:11:57.014957 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.014865    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 21:11:57.015115 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.015099    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 21:11:57.015190 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.015167    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k9mx9\""
Jul 29 21:11:57.015300 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.015245    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 21:11:57.018902 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.018880    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48364292-ba6d-4420-b602-3fa234d29422-tmp\") pod \"opendatahub-operator-controller-manager-8446ffcd9c-72qt6\" (UID: \"48364292-ba6d-4420-b602-3fa234d29422\") " pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.019026 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.018940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/48364292-ba6d-4420-b602-3fa234d29422-manifests\") pod \"opendatahub-operator-controller-manager-8446ffcd9c-72qt6\" (UID: \"48364292-ba6d-4420-b602-3fa234d29422\") " pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.019026 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.018968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/48364292-ba6d-4420-b602-3fa234d29422-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8446ffcd9c-72qt6\" (UID: \"48364292-ba6d-4420-b602-3fa234d29422\") " pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.019440 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.019032    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48364292-ba6d-4420-b602-3fa234d29422-webhook-cert\") pod \"opendatahub-operator-controller-manager-8446ffcd9c-72qt6\" (UID: \"48364292-ba6d-4420-b602-3fa234d29422\") " pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.019440 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.019072    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncg6t\" (UniqueName: \"kubernetes.io/projected/48364292-ba6d-4420-b602-3fa234d29422-kube-api-access-ncg6t\") pod \"opendatahub-operator-controller-manager-8446ffcd9c-72qt6\" (UID: \"48364292-ba6d-4420-b602-3fa234d29422\") " pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.023518 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.023483    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"]
Jul 29 21:11:57.119478 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.119416    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:57.119864 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.119514    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48364292-ba6d-4420-b602-3fa234d29422-webhook-cert\") pod \"opendatahub-operator-controller-manager-8446ffcd9c-72qt6\" (UID: \"48364292-ba6d-4420-b602-3fa234d29422\") " pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.119864 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.119545    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncg6t\" (UniqueName: \"kubernetes.io/projected/48364292-ba6d-4420-b602-3fa234d29422-kube-api-access-ncg6t\") pod \"opendatahub-operator-controller-manager-8446ffcd9c-72qt6\" (UID: \"48364292-ba6d-4420-b602-3fa234d29422\") " pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.119864 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.119595    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48364292-ba6d-4420-b602-3fa234d29422-tmp\") pod \"opendatahub-operator-controller-manager-8446ffcd9c-72qt6\" (UID: \"48364292-ba6d-4420-b602-3fa234d29422\") " pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.119864 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.119646    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/48364292-ba6d-4420-b602-3fa234d29422-manifests\") pod \"opendatahub-operator-controller-manager-8446ffcd9c-72qt6\" (UID: \"48364292-ba6d-4420-b602-3fa234d29422\") " pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.119864 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.119668    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/48364292-ba6d-4420-b602-3fa234d29422-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8446ffcd9c-72qt6\" (UID: \"48364292-ba6d-4420-b602-3fa234d29422\") " pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.120110 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.120057    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/48364292-ba6d-4420-b602-3fa234d29422-manifests\") pod \"opendatahub-operator-controller-manager-8446ffcd9c-72qt6\" (UID: \"48364292-ba6d-4420-b602-3fa234d29422\") " pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.121852 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.121823    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48364292-ba6d-4420-b602-3fa234d29422-tmp\") pod \"opendatahub-operator-controller-manager-8446ffcd9c-72qt6\" (UID: \"48364292-ba6d-4420-b602-3fa234d29422\") " pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.122004 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.121989    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48364292-ba6d-4420-b602-3fa234d29422-webhook-cert\") pod \"opendatahub-operator-controller-manager-8446ffcd9c-72qt6\" (UID: \"48364292-ba6d-4420-b602-3fa234d29422\") " pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.122065 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.122049    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/48364292-ba6d-4420-b602-3fa234d29422-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8446ffcd9c-72qt6\" (UID: \"48364292-ba6d-4420-b602-3fa234d29422\") " pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.130918 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.130896    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncg6t\" (UniqueName: \"kubernetes.io/projected/48364292-ba6d-4420-b602-3fa234d29422-kube-api-access-ncg6t\") pod \"opendatahub-operator-controller-manager-8446ffcd9c-72qt6\" (UID: \"48364292-ba6d-4420-b602-3fa234d29422\") " pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.217560 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.217486    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:57.317863 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.317830    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:57.324063 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.324037    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:11:57.420931 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.420899    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:57.460278 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.460249    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"]
Jul 29 21:11:57.463491 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:11:57.463460    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48364292_ba6d_4420_b602_3fa234d29422.slice/crio-f41b7e267b832a7b87518e2a16764d3de2c8938623bc96a59c8ee0a71403b240 WatchSource:0}: Error finding container f41b7e267b832a7b87518e2a16764d3de2c8938623bc96a59c8ee0a71403b240: Status 404 returned error can't find the container with id f41b7e267b832a7b87518e2a16764d3de2c8938623bc96a59c8ee0a71403b240
Jul 29 21:11:57.520821 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.520791    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:57.626067 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.626037    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:57.737837 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:57.737762    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:11:58.298288 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:11:58.298250    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6" event={"ID":"48364292-ba6d-4420-b602-3fa234d29422","Type":"ContainerStarted","Data":"f41b7e267b832a7b87518e2a16764d3de2c8938623bc96a59c8ee0a71403b240"}
Jul 29 21:12:01.314520 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:01.314482    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6" event={"ID":"48364292-ba6d-4420-b602-3fa234d29422","Type":"ContainerStarted","Data":"3f7c95e7d621703fe181f684caecfafa96ac09f3a7683ea4162292b6af73c15d"}
Jul 29 21:12:02.320529 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:02.320496    2575 generic.go:356] "Generic (PLEG): container finished" podID="48364292-ba6d-4420-b602-3fa234d29422" containerID="3f7c95e7d621703fe181f684caecfafa96ac09f3a7683ea4162292b6af73c15d" exitCode=0
Jul 29 21:12:02.320943 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:02.320589    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6" event={"ID":"48364292-ba6d-4420-b602-3fa234d29422","Type":"ContainerDied","Data":"3f7c95e7d621703fe181f684caecfafa96ac09f3a7683ea4162292b6af73c15d"}
Jul 29 21:12:03.327085 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:03.327050    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6" event={"ID":"48364292-ba6d-4420-b602-3fa234d29422","Type":"ContainerStarted","Data":"88a7dfcdbdaa9aeba9412e9fbcd80ea63d3a8f979f80387d6a812a155ea9b87f"}
Jul 29 21:12:03.327467 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:03.327158    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:12:03.349227 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:03.349177    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6" podStartSLOduration=2.734407123 podStartE2EDuration="7.349164073s" totalImagesPullingTime="3.561460533s" totalInitContainerRuntime="1.053296417s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:11:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:12:03.347912064 +0000 UTC m=+515.353435433" watchObservedRunningTime="2026-07-29 21:12:03.349164073 +0000 UTC m=+515.354687441"
Jul 29 21:12:04.447252 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:04.447217    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:04.546041 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:04.546005    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:07.593217 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:07.593178    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:07.691303 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:07.691267    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:09.036280 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:09.036248    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:09.138386 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:09.138352    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:14.333893 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:14.333860    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8446ffcd9c-72qt6"
Jul 29 21:12:16.240763 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:16.240731    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:16.384624 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:16.384588    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:16.804159 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:16.804124    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:17.099730 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:17.099652    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:17.205490 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:17.205437    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:17.306937 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:17.306899    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:17.415955 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:17.415865    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:17.980648 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:17.980614    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:18.083880 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:18.083846    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:18.201059 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:18.201028    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:18.261371 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:18.261291    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:18.330382 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:18.330349    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:19.192977 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:19.192930    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:25.456521 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:25.456419    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:26.068088 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.068049    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"]
Jul 29 21:12:26.073186 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.073159    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.076332 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.076307    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 21:12:26.076332 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.076329    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-s7bgs\""
Jul 29 21:12:26.076750 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.076730    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 21:12:26.077948 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.077928    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 21:12:26.090031 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.090009    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"]
Jul 29 21:12:26.118369 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.118348    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:26.174368 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.174339    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.174525 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.174389    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.174525 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.174435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.174525 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.174463    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.174738 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.174564    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.174738 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.174597    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.174738 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.174612    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lk6j\" (UniqueName: \"kubernetes.io/projected/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-kube-api-access-2lk6j\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.174738 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.174639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.174738 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.174665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.223356 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.223319    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:26.275781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.275745    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.275781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.275795    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.276014 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.275812    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lk6j\" (UniqueName: \"kubernetes.io/projected/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-kube-api-access-2lk6j\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.276014 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.275843    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.276014 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.275858    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.276014 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.275879    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.276014 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.276005    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.276267 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.276038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.276267 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.276066    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.276370 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.276271    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.276426 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.276366    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.276496 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.276429    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.276625 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.276601    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.276976 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.276954    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.278139 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.278118    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.278483 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.278462    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.284376 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.284346    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.284692 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.284673    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lk6j\" (UniqueName: \"kubernetes.io/projected/af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab-kube-api-access-2lk6j\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m\" (UID: \"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.383926 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.383849    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:26.531349 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.531326    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"]
Jul 29 21:12:26.534399 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:12:26.534370    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf83174d_86cf_4c1c_8e1a_a0ab19d7d8ab.slice/crio-baea74ee6b16518b907c3dd7b0469bd39dddc6bc075516167e0426f118ee6536 WatchSource:0}: Error finding container baea74ee6b16518b907c3dd7b0469bd39dddc6bc075516167e0426f118ee6536: Status 404 returned error can't find the container with id baea74ee6b16518b907c3dd7b0469bd39dddc6bc075516167e0426f118ee6536
Jul 29 21:12:26.612859 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:26.612829    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:27.441762 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:27.441717    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m" event={"ID":"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab","Type":"ContainerStarted","Data":"baea74ee6b16518b907c3dd7b0469bd39dddc6bc075516167e0426f118ee6536"}
Jul 29 21:12:27.974799 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:27.974762    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:28.056039 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.056003    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h"]
Jul 29 21:12:28.059805 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.059783    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h"
Jul 29 21:12:28.062489 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.062466    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 29 21:12:28.062732 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.062718    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-bzsbr\""
Jul 29 21:12:28.063345 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.063320    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l"]
Jul 29 21:12:28.068247 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.068226    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l"
Jul 29 21:12:28.069974 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.069948    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h"]
Jul 29 21:12:28.071849 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.071174    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wfm2x\""
Jul 29 21:12:28.071849 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.071417    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 29 21:12:28.089052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.089002    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l"]
Jul 29 21:12:28.099773 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.099729    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:28.183245 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.183216    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"]
Jul 29 21:12:28.187245 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.187218    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"
Jul 29 21:12:28.190304 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.190108    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9lzxn\""
Jul 29 21:12:28.190304 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.190118    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 21:12:28.190304 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.190185    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 21:12:28.190304 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.190186    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 21:12:28.194406 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.194380    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd5f18e9-c065-4e96-aa61-68dbc0509095-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jhb4l\" (UID: \"cd5f18e9-c065-4e96-aa61-68dbc0509095\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l"
Jul 29 21:12:28.194541 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.194480    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq5m8\" (UniqueName: \"kubernetes.io/projected/cd5f18e9-c065-4e96-aa61-68dbc0509095-kube-api-access-qq5m8\") pod \"llmisvc-controller-manager-777c6bd7d5-jhb4l\" (UID: \"cd5f18e9-c065-4e96-aa61-68dbc0509095\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l"
Jul 29 21:12:28.194636 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.194540    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/011617b9-408e-47e4-89a5-523c2265f543-cert\") pod \"kserve-controller-manager-d6f4b65b8-9gf5h\" (UID: \"011617b9-408e-47e4-89a5-523c2265f543\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h"
Jul 29 21:12:28.194636 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.194563    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzq5m\" (UniqueName: \"kubernetes.io/projected/011617b9-408e-47e4-89a5-523c2265f543-kube-api-access-tzq5m\") pod \"kserve-controller-manager-d6f4b65b8-9gf5h\" (UID: \"011617b9-408e-47e4-89a5-523c2265f543\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h"
Jul 29 21:12:28.204743 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.204722    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"]
Jul 29 21:12:28.296428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.295076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/011617b9-408e-47e4-89a5-523c2265f543-cert\") pod \"kserve-controller-manager-d6f4b65b8-9gf5h\" (UID: \"011617b9-408e-47e4-89a5-523c2265f543\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h"
Jul 29 21:12:28.296428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.295132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/70d76b4a-5884-4287-85f6-30780039a937-metrics-cert\") pod \"lws-controller-manager-d97fdbb4b-n4lzl\" (UID: \"70d76b4a-5884-4287-85f6-30780039a937\") " pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"
Jul 29 21:12:28.296428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.295166    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzq5m\" (UniqueName: \"kubernetes.io/projected/011617b9-408e-47e4-89a5-523c2265f543-kube-api-access-tzq5m\") pod \"kserve-controller-manager-d6f4b65b8-9gf5h\" (UID: \"011617b9-408e-47e4-89a5-523c2265f543\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h"
Jul 29 21:12:28.296428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.295193    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7zxk\" (UniqueName: \"kubernetes.io/projected/70d76b4a-5884-4287-85f6-30780039a937-kube-api-access-m7zxk\") pod \"lws-controller-manager-d97fdbb4b-n4lzl\" (UID: \"70d76b4a-5884-4287-85f6-30780039a937\") " pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"
Jul 29 21:12:28.296428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.295243    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd5f18e9-c065-4e96-aa61-68dbc0509095-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jhb4l\" (UID: \"cd5f18e9-c065-4e96-aa61-68dbc0509095\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l"
Jul 29 21:12:28.296428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.295312    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/70d76b4a-5884-4287-85f6-30780039a937-manager-config\") pod \"lws-controller-manager-d97fdbb4b-n4lzl\" (UID: \"70d76b4a-5884-4287-85f6-30780039a937\") " pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"
Jul 29 21:12:28.296428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.295335    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70d76b4a-5884-4287-85f6-30780039a937-cert\") pod \"lws-controller-manager-d97fdbb4b-n4lzl\" (UID: \"70d76b4a-5884-4287-85f6-30780039a937\") " pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"
Jul 29 21:12:28.296428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.295374    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq5m8\" (UniqueName: \"kubernetes.io/projected/cd5f18e9-c065-4e96-aa61-68dbc0509095-kube-api-access-qq5m8\") pod \"llmisvc-controller-manager-777c6bd7d5-jhb4l\" (UID: \"cd5f18e9-c065-4e96-aa61-68dbc0509095\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l"
Jul 29 21:12:28.296428 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:12:28.295823    2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 29 21:12:28.296428 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:12:28.295900    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/011617b9-408e-47e4-89a5-523c2265f543-cert podName:011617b9-408e-47e4-89a5-523c2265f543 nodeName:}" failed. No retries permitted until 2026-07-29 21:12:28.795879692 +0000 UTC m=+540.801403043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/011617b9-408e-47e4-89a5-523c2265f543-cert") pod "kserve-controller-manager-d6f4b65b8-9gf5h" (UID: "011617b9-408e-47e4-89a5-523c2265f543") : secret "kserve-webhook-server-cert" not found
Jul 29 21:12:28.296428 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:12:28.296179    2575 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 29 21:12:28.296428 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:12:28.296220    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd5f18e9-c065-4e96-aa61-68dbc0509095-cert podName:cd5f18e9-c065-4e96-aa61-68dbc0509095 nodeName:}" failed. No retries permitted until 2026-07-29 21:12:28.796206716 +0000 UTC m=+540.801730066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cd5f18e9-c065-4e96-aa61-68dbc0509095-cert") pod "llmisvc-controller-manager-777c6bd7d5-jhb4l" (UID: "cd5f18e9-c065-4e96-aa61-68dbc0509095") : secret "llmisvc-webhook-server-cert" not found
Jul 29 21:12:28.311775 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.311708    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzq5m\" (UniqueName: \"kubernetes.io/projected/011617b9-408e-47e4-89a5-523c2265f543-kube-api-access-tzq5m\") pod \"kserve-controller-manager-d6f4b65b8-9gf5h\" (UID: \"011617b9-408e-47e4-89a5-523c2265f543\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h"
Jul 29 21:12:28.313832 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.313612    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq5m8\" (UniqueName: \"kubernetes.io/projected/cd5f18e9-c065-4e96-aa61-68dbc0509095-kube-api-access-qq5m8\") pod \"llmisvc-controller-manager-777c6bd7d5-jhb4l\" (UID: \"cd5f18e9-c065-4e96-aa61-68dbc0509095\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l"
Jul 29 21:12:28.396570 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.396316    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/70d76b4a-5884-4287-85f6-30780039a937-metrics-cert\") pod \"lws-controller-manager-d97fdbb4b-n4lzl\" (UID: \"70d76b4a-5884-4287-85f6-30780039a937\") " pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"
Jul 29 21:12:28.396570 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.396357    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7zxk\" (UniqueName: \"kubernetes.io/projected/70d76b4a-5884-4287-85f6-30780039a937-kube-api-access-m7zxk\") pod \"lws-controller-manager-d97fdbb4b-n4lzl\" (UID: \"70d76b4a-5884-4287-85f6-30780039a937\") " pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"
Jul 29 21:12:28.396570 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.396438    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/70d76b4a-5884-4287-85f6-30780039a937-manager-config\") pod \"lws-controller-manager-d97fdbb4b-n4lzl\" (UID: \"70d76b4a-5884-4287-85f6-30780039a937\") " pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"
Jul 29 21:12:28.396570 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.396475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70d76b4a-5884-4287-85f6-30780039a937-cert\") pod \"lws-controller-manager-d97fdbb4b-n4lzl\" (UID: \"70d76b4a-5884-4287-85f6-30780039a937\") " pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"
Jul 29 21:12:28.400853 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.400829    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 21:12:28.401236 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.401220    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 21:12:28.401520 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.401502    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 21:12:28.408119 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.408096    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/70d76b4a-5884-4287-85f6-30780039a937-manager-config\") pod \"lws-controller-manager-d97fdbb4b-n4lzl\" (UID: \"70d76b4a-5884-4287-85f6-30780039a937\") " pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"
Jul 29 21:12:28.410804 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.410766    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70d76b4a-5884-4287-85f6-30780039a937-cert\") pod \"lws-controller-manager-d97fdbb4b-n4lzl\" (UID: \"70d76b4a-5884-4287-85f6-30780039a937\") " pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"
Jul 29 21:12:28.410804 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.410771    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/70d76b4a-5884-4287-85f6-30780039a937-metrics-cert\") pod \"lws-controller-manager-d97fdbb4b-n4lzl\" (UID: \"70d76b4a-5884-4287-85f6-30780039a937\") " pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"
Jul 29 21:12:28.413494 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.413472    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7zxk\" (UniqueName: \"kubernetes.io/projected/70d76b4a-5884-4287-85f6-30780039a937-kube-api-access-m7zxk\") pod \"lws-controller-manager-d97fdbb4b-n4lzl\" (UID: \"70d76b4a-5884-4287-85f6-30780039a937\") " pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"
Jul 29 21:12:28.502882 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.502852    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9lzxn\""
Jul 29 21:12:28.509578 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.509553    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"
Jul 29 21:12:28.529830 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.529797    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:28.707231 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.707146    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:28.800725 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.800691    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/011617b9-408e-47e4-89a5-523c2265f543-cert\") pod \"kserve-controller-manager-d6f4b65b8-9gf5h\" (UID: \"011617b9-408e-47e4-89a5-523c2265f543\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h"
Jul 29 21:12:28.800907 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.800756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd5f18e9-c065-4e96-aa61-68dbc0509095-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jhb4l\" (UID: \"cd5f18e9-c065-4e96-aa61-68dbc0509095\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l"
Jul 29 21:12:28.803405 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.803379    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd5f18e9-c065-4e96-aa61-68dbc0509095-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jhb4l\" (UID: \"cd5f18e9-c065-4e96-aa61-68dbc0509095\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l"
Jul 29 21:12:28.803557 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.803411    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/011617b9-408e-47e4-89a5-523c2265f543-cert\") pod \"kserve-controller-manager-d6f4b65b8-9gf5h\" (UID: \"011617b9-408e-47e4-89a5-523c2265f543\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h"
Jul 29 21:12:28.981519 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.981429    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-bzsbr\""
Jul 29 21:12:28.988702 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.988673    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h"
Jul 29 21:12:28.993097 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:28.993082    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wfm2x\""
Jul 29 21:12:29.000699 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:29.000680    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l"
Jul 29 21:12:29.278262 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:29.278180    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:29.365421 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:29.365390    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:29.448893 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:29.448847    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:12:29.449018 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:29.448949    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:12:29.449018 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:29.448994    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:12:29.467602 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:29.467518    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:12:29.544910 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:29.541189    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h"]
Jul 29 21:12:29.767831 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:29.767627    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l"]
Jul 29 21:12:29.769352 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:29.769325    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"]
Jul 29 21:12:29.769660 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:12:29.769626    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcd5f18e9_c065_4e96_aa61_68dbc0509095.slice/crio-2fbcf602b99088adbf4f81c765e4c99b265387b73ba2fa8e0288902475289519 WatchSource:0}: Error finding container 2fbcf602b99088adbf4f81c765e4c99b265387b73ba2fa8e0288902475289519: Status 404 returned error can't find the container with id 2fbcf602b99088adbf4f81c765e4c99b265387b73ba2fa8e0288902475289519
Jul 29 21:12:29.770647 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:12:29.770622    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d76b4a_5884_4287_85f6_30780039a937.slice/crio-1027cc6942b470b87f696b98a4b587d49175e1b3e63ceea29af71112eb860b5e WatchSource:0}: Error finding container 1027cc6942b470b87f696b98a4b587d49175e1b3e63ceea29af71112eb860b5e: Status 404 returned error can't find the container with id 1027cc6942b470b87f696b98a4b587d49175e1b3e63ceea29af71112eb860b5e
Jul 29 21:12:30.465705 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:30.465655    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h" event={"ID":"011617b9-408e-47e4-89a5-523c2265f543","Type":"ContainerStarted","Data":"60497a67ffc0094993b9353022ed07df1dbb5d2424395052589031c590983e77"}
Jul 29 21:12:30.467489 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:30.467438    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl" event={"ID":"70d76b4a-5884-4287-85f6-30780039a937","Type":"ContainerStarted","Data":"1027cc6942b470b87f696b98a4b587d49175e1b3e63ceea29af71112eb860b5e"}
Jul 29 21:12:30.470075 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:30.470025    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m" event={"ID":"af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab","Type":"ContainerStarted","Data":"da35b71c3345442c2ec29386752170ffae904ed382a73c901ffa647e654f48fe"}
Jul 29 21:12:30.471743 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:30.471691    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l" event={"ID":"cd5f18e9-c065-4e96-aa61-68dbc0509095","Type":"ContainerStarted","Data":"2fbcf602b99088adbf4f81c765e4c99b265387b73ba2fa8e0288902475289519"}
Jul 29 21:12:30.489402 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:30.489346    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m" podStartSLOduration=1.577345362 podStartE2EDuration="4.489326329s" totalImagesPullingTime="2.911980967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:12:30.488397115 +0000 UTC m=+542.493920483" watchObservedRunningTime="2026-07-29 21:12:30.489326329 +0000 UTC m=+542.494849697"
Jul 29 21:12:31.384304 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:31.384267    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:31.390089 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:31.390060    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:31.478222 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:31.478190    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:31.479499 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:31.479473    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m"
Jul 29 21:12:32.486017 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:32.485977    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl" event={"ID":"70d76b4a-5884-4287-85f6-30780039a937","Type":"ContainerStarted","Data":"51296f35e4488120cff16012830820e1dfbf7a5dbd4a5c58afea7e53f3a283a9"}
Jul 29 21:12:32.502482 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:32.502423    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl" podStartSLOduration=2.701510157 podStartE2EDuration="4.502405419s" totalImagesPullingTime="1.800895262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:12:32.500958147 +0000 UTC m=+544.506481518" watchObservedRunningTime="2026-07-29 21:12:32.502405419 +0000 UTC m=+544.507928830"
Jul 29 21:12:33.492200 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:33.492161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h" event={"ID":"011617b9-408e-47e4-89a5-523c2265f543","Type":"ContainerStarted","Data":"0fa4ef830ab4a447cd7b7770f8f2cf57bf80da1607661fc55614d2bf9531548d"}
Jul 29 21:12:33.492671 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:33.492329    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h"
Jul 29 21:12:33.493732 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:33.493707    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l" event={"ID":"cd5f18e9-c065-4e96-aa61-68dbc0509095","Type":"ContainerStarted","Data":"591d69fe32c8d2c0076b02540ea2e5446b7680f5535ae8a4e899cf92351354e1"}
Jul 29 21:12:33.493867 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:33.493806    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l"
Jul 29 21:12:33.494080 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:33.494064    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"
Jul 29 21:12:33.509440 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:33.509400    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h" podStartSLOduration=2.113801297 podStartE2EDuration="5.509386894s" totalImagesPullingTime="3.395585597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:12:33.508538777 +0000 UTC m=+545.514062146" watchObservedRunningTime="2026-07-29 21:12:33.509386894 +0000 UTC m=+545.514910261"
Jul 29 21:12:33.530398 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:33.527142    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l" podStartSLOduration=2.353141804 podStartE2EDuration="5.527118487s" totalImagesPullingTime="3.173976683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:12:33.523840284 +0000 UTC m=+545.529363652" watchObservedRunningTime="2026-07-29 21:12:33.527118487 +0000 UTC m=+545.532641855"
Jul 29 21:12:44.500300 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:12:44.500267    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d97fdbb4b-n4lzl"
Jul 29 21:13:04.500299 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:04.500262    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jhb4l"
Jul 29 21:13:04.503298 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:04.503276    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9gf5h"
Jul 29 21:13:17.792468 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:17.792400    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:17.894285 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:17.894250    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:17.982482 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:17.982423    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:18.732103 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:18.732074    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:18.943506 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:18.943415    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:38.697461 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:38.697407    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:40.789008 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:40.788980    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:44.253043 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:44.253012    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:46.411432 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:46.411376    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:48.642107 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:48.642057    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:48.788859 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:48.788812    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:48.895206 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:48.895128    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:49.614759 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:49.614698    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:50.283658 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:50.283588    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:50.616347 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:50.616314    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:50.823425 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:50.823387    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:50.891912 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:50.891833    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:52.087387 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:52.087340    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:52.183784 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:52.183743    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:52.284872 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:52.284833    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:52.453858 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:52.453785    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:52.826354 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:52.826324    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:54.180088 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:54.180048    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:54.283535 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:54.283481    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:55.844308 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:55.844278    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:57.993695 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:57.993646    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:13:58.051934 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:13:58.051904    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:01.759635 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:01.759597    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:01.860139 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:01.860099    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:01.960191 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:01.960148    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:03.852154 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:03.852119    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"]
Jul 29 21:14:03.855410 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:03.855394    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"
Jul 29 21:14:03.858482 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:03.858435    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 21:14:03.858623 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:03.858548    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4hrql\""
Jul 29 21:14:03.858623 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:03.858610    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 21:14:03.868405 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:03.868383    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"]
Jul 29 21:14:03.941054 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:03.941028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18d9b885-756b-4007-b057-7c5bbd080da2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kwmtw\" (UID: \"18d9b885-756b-4007-b057-7c5bbd080da2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"
Jul 29 21:14:03.941184 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:03.941070    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7m2q\" (UniqueName: \"kubernetes.io/projected/18d9b885-756b-4007-b057-7c5bbd080da2-kube-api-access-h7m2q\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kwmtw\" (UID: \"18d9b885-756b-4007-b057-7c5bbd080da2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"
Jul 29 21:14:04.042451 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:04.042424    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18d9b885-756b-4007-b057-7c5bbd080da2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kwmtw\" (UID: \"18d9b885-756b-4007-b057-7c5bbd080da2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"
Jul 29 21:14:04.042628 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:04.042487    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7m2q\" (UniqueName: \"kubernetes.io/projected/18d9b885-756b-4007-b057-7c5bbd080da2-kube-api-access-h7m2q\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kwmtw\" (UID: \"18d9b885-756b-4007-b057-7c5bbd080da2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"
Jul 29 21:14:04.042783 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:04.042763    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18d9b885-756b-4007-b057-7c5bbd080da2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kwmtw\" (UID: \"18d9b885-756b-4007-b057-7c5bbd080da2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"
Jul 29 21:14:04.058936 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:04.058905    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"]
Jul 29 21:14:04.059152 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:14:04.059133    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-h7m2q], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw" podUID="18d9b885-756b-4007-b057-7c5bbd080da2"
Jul 29 21:14:04.060277 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:04.060257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7m2q\" (UniqueName: \"kubernetes.io/projected/18d9b885-756b-4007-b057-7c5bbd080da2-kube-api-access-h7m2q\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kwmtw\" (UID: \"18d9b885-756b-4007-b057-7c5bbd080da2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"
Jul 29 21:14:04.414752 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:04.414719    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"]
Jul 29 21:14:04.423584 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:04.423555    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"]
Jul 29 21:14:04.902719 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:04.902692    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"
Jul 29 21:14:04.909649 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:04.909627    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"
Jul 29 21:14:04.912315 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:14:04.912290    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kwmtw\" is forbidden: User \"system:node:ip-10-0-134-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-66.ec2.internal' and this object" podUID="18d9b885-756b-4007-b057-7c5bbd080da2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"
Jul 29 21:14:04.948710 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:04.948674    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7m2q\" (UniqueName: \"kubernetes.io/projected/18d9b885-756b-4007-b057-7c5bbd080da2-kube-api-access-h7m2q\") pod \"18d9b885-756b-4007-b057-7c5bbd080da2\" (UID: \"18d9b885-756b-4007-b057-7c5bbd080da2\") "
Jul 29 21:14:04.948803 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:04.948742    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18d9b885-756b-4007-b057-7c5bbd080da2-extensions-socket-volume\") pod \"18d9b885-756b-4007-b057-7c5bbd080da2\" (UID: \"18d9b885-756b-4007-b057-7c5bbd080da2\") "
Jul 29 21:14:04.948952 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:04.948930    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18d9b885-756b-4007-b057-7c5bbd080da2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "18d9b885-756b-4007-b057-7c5bbd080da2" (UID: "18d9b885-756b-4007-b057-7c5bbd080da2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:14:04.949033 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:04.949021    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18d9b885-756b-4007-b057-7c5bbd080da2-extensions-socket-volume\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:14:04.950740 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:04.950718    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18d9b885-756b-4007-b057-7c5bbd080da2-kube-api-access-h7m2q" (OuterVolumeSpecName: "kube-api-access-h7m2q") pod "18d9b885-756b-4007-b057-7c5bbd080da2" (UID: "18d9b885-756b-4007-b057-7c5bbd080da2"). InnerVolumeSpecName "kube-api-access-h7m2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:14:05.050400 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:05.050357    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7m2q\" (UniqueName: \"kubernetes.io/projected/18d9b885-756b-4007-b057-7c5bbd080da2-kube-api-access-h7m2q\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:14:05.477191 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:05.477157    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:05.596329 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:05.596292    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:05.906931 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:05.906899    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"
Jul 29 21:14:05.910824 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:14:05.910794    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kwmtw\" is forbidden: User \"system:node:ip-10-0-134-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-66.ec2.internal' and this object" podUID="18d9b885-756b-4007-b057-7c5bbd080da2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"
Jul 29 21:14:05.919965 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:14:05.919935    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kwmtw\" is forbidden: User \"system:node:ip-10-0-134-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-66.ec2.internal' and this object" podUID="18d9b885-756b-4007-b057-7c5bbd080da2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kwmtw"
Jul 29 21:14:06.482857 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:06.482825    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18d9b885-756b-4007-b057-7c5bbd080da2" path="/var/lib/kubelet/pods/18d9b885-756b-4007-b057-7c5bbd080da2/volumes"
Jul 29 21:14:07.872595 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:07.872563    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:07.968157 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:07.968117    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:14.414175 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:14.414144    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:14.514269 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:14.514237    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:17.578023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:17.577981    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:18.609832 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:18.609799    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:18.667206 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:18.667177    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:26.808945 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:26.808893    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:26.910071 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:26.910042    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:29.828052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:29.828019    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:29.884459 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:29.884421    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:35.606221 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:35.606190    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:35.706022 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:35.705992    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:36.207490 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:36.207441    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:36.307876 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:36.307846    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:36.948474 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:36.948433    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:45.153847 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.153814    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"]
Jul 29 21:14:45.157717 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.157694    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.160402 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.160379    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6r42c\""
Jul 29 21:14:45.167563 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.167537    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"]
Jul 29 21:14:45.180927 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.180905    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:45.299980 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.299937    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72aff634-da5f-432e-92aa-cbc8193dca2d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.300194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.299987    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72aff634-da5f-432e-92aa-cbc8193dca2d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.300194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.300045    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72aff634-da5f-432e-92aa-cbc8193dca2d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.300194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.300114    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72aff634-da5f-432e-92aa-cbc8193dca2d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.300194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.300141    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72aff634-da5f-432e-92aa-cbc8193dca2d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.300194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.300159    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqz6l\" (UniqueName: \"kubernetes.io/projected/72aff634-da5f-432e-92aa-cbc8193dca2d-kube-api-access-dqz6l\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.300387 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.300214    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72aff634-da5f-432e-92aa-cbc8193dca2d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.300387 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.300233    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72aff634-da5f-432e-92aa-cbc8193dca2d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.300387 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.300256    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72aff634-da5f-432e-92aa-cbc8193dca2d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.401270 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.401231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72aff634-da5f-432e-92aa-cbc8193dca2d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.401270 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.401274    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72aff634-da5f-432e-92aa-cbc8193dca2d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.401493 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.401295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72aff634-da5f-432e-92aa-cbc8193dca2d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.401493 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.401331    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72aff634-da5f-432e-92aa-cbc8193dca2d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.401493 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.401349    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72aff634-da5f-432e-92aa-cbc8193dca2d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.401493 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.401367    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72aff634-da5f-432e-92aa-cbc8193dca2d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.401493 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.401420    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72aff634-da5f-432e-92aa-cbc8193dca2d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.401493 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.401469    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72aff634-da5f-432e-92aa-cbc8193dca2d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.401809 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.401495    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqz6l\" (UniqueName: \"kubernetes.io/projected/72aff634-da5f-432e-92aa-cbc8193dca2d-kube-api-access-dqz6l\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.401809 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.401675    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72aff634-da5f-432e-92aa-cbc8193dca2d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.401809 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.401719    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72aff634-da5f-432e-92aa-cbc8193dca2d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.401970 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.401864    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72aff634-da5f-432e-92aa-cbc8193dca2d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.401970 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.401916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72aff634-da5f-432e-92aa-cbc8193dca2d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.402208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.402190    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72aff634-da5f-432e-92aa-cbc8193dca2d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.403839 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.403812    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72aff634-da5f-432e-92aa-cbc8193dca2d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.403949 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.403909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72aff634-da5f-432e-92aa-cbc8193dca2d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.409286 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.409263    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqz6l\" (UniqueName: \"kubernetes.io/projected/72aff634-da5f-432e-92aa-cbc8193dca2d-kube-api-access-dqz6l\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.409387 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.409284    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72aff634-da5f-432e-92aa-cbc8193dca2d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-99jf9\" (UID: \"72aff634-da5f-432e-92aa-cbc8193dca2d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.410115 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.410094    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:45.470243 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.470219    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:45.603917 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.603894    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"]
Jul 29 21:14:45.605942 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:14:45.605915    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72aff634_da5f_432e_92aa_cbc8193dca2d.slice/crio-c6e91338866451ca1bccfb04b1c24dced413e7d061cad1def8796e137120ffd3 WatchSource:0}: Error finding container c6e91338866451ca1bccfb04b1c24dced413e7d061cad1def8796e137120ffd3: Status 404 returned error can't find the container with id c6e91338866451ca1bccfb04b1c24dced413e7d061cad1def8796e137120ffd3
Jul 29 21:14:45.608076 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.608042    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:14:45.608158 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.608119    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:14:45.608200 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:45.608165    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:14:46.096107 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:46.096064    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9" event={"ID":"72aff634-da5f-432e-92aa-cbc8193dca2d","Type":"ContainerStarted","Data":"201214a94707da09c3c57ec551a66f241ac4e564f2d2e966a0fd0f8bd248270a"}
Jul 29 21:14:46.096289 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:46.096156    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9" event={"ID":"72aff634-da5f-432e-92aa-cbc8193dca2d","Type":"ContainerStarted","Data":"c6e91338866451ca1bccfb04b1c24dced413e7d061cad1def8796e137120ffd3"}
Jul 29 21:14:46.115687 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:46.115645    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9" podStartSLOduration=1.115632201 podStartE2EDuration="1.115632201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:14:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:14:46.114657248 +0000 UTC m=+678.120180616" watchObservedRunningTime="2026-07-29 21:14:46.115632201 +0000 UTC m=+678.121155569"
Jul 29 21:14:46.471498 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:46.471395    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:46.481833 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:46.481805    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:47.101077 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:47.101044    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:47.102104 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:47.102072    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:14:58.106167 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.106126    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:58.207813 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.207782    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:58.268466 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.268411    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:58.411130 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.411059    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:14:58.416047 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.416020    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8q668"
Jul 29 21:14:58.420428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.420401    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 21:14:58.420691 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.420465    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 21:14:58.420868 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.420514    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 21:14:58.421015 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.420705    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rgrr7\""
Jul 29 21:14:58.422077 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.422056    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:14:58.449338 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.449308    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:14:58.510043 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.510007    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3db0947e-3709-4542-8226-00b6016546bf-config-file\") pod \"limitador-limitador-54d6d988d5-8q668\" (UID: \"3db0947e-3709-4542-8226-00b6016546bf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8q668"
Jul 29 21:14:58.510172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.510051    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v556v\" (UniqueName: \"kubernetes.io/projected/3db0947e-3709-4542-8226-00b6016546bf-kube-api-access-v556v\") pod \"limitador-limitador-54d6d988d5-8q668\" (UID: \"3db0947e-3709-4542-8226-00b6016546bf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8q668"
Jul 29 21:14:58.610877 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.610842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3db0947e-3709-4542-8226-00b6016546bf-config-file\") pod \"limitador-limitador-54d6d988d5-8q668\" (UID: \"3db0947e-3709-4542-8226-00b6016546bf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8q668"
Jul 29 21:14:58.610877 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.610884    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v556v\" (UniqueName: \"kubernetes.io/projected/3db0947e-3709-4542-8226-00b6016546bf-kube-api-access-v556v\") pod \"limitador-limitador-54d6d988d5-8q668\" (UID: \"3db0947e-3709-4542-8226-00b6016546bf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8q668"
Jul 29 21:14:58.611474 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.611430    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3db0947e-3709-4542-8226-00b6016546bf-config-file\") pod \"limitador-limitador-54d6d988d5-8q668\" (UID: \"3db0947e-3709-4542-8226-00b6016546bf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8q668"
Jul 29 21:14:58.618399 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.618377    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v556v\" (UniqueName: \"kubernetes.io/projected/3db0947e-3709-4542-8226-00b6016546bf-kube-api-access-v556v\") pod \"limitador-limitador-54d6d988d5-8q668\" (UID: \"3db0947e-3709-4542-8226-00b6016546bf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8q668"
Jul 29 21:14:58.728408 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.728322    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8q668"
Jul 29 21:14:58.853438 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.853415    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:14:58.855656 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:14:58.855632    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db0947e_3709_4542_8226_00b6016546bf.slice/crio-6de79b9ad51ac6c7a8a635d7e582899eae11951ee428bdc4f3e56f6b1c505fd2 WatchSource:0}: Error finding container 6de79b9ad51ac6c7a8a635d7e582899eae11951ee428bdc4f3e56f6b1c505fd2: Status 404 returned error can't find the container with id 6de79b9ad51ac6c7a8a635d7e582899eae11951ee428bdc4f3e56f6b1c505fd2
Jul 29 21:14:58.858011 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.857996    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 21:14:58.928967 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.928934    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:58.994167 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:58.994103    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:14:59.154929 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:14:59.154897    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8q668" event={"ID":"3db0947e-3709-4542-8226-00b6016546bf","Type":"ContainerStarted","Data":"6de79b9ad51ac6c7a8a635d7e582899eae11951ee428bdc4f3e56f6b1c505fd2"}
Jul 29 21:15:02.171878 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:15:02.171844    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8q668" event={"ID":"3db0947e-3709-4542-8226-00b6016546bf","Type":"ContainerStarted","Data":"d4e32ccb88a5cc75eb73e212d755967b9d82e4248e68312cf972f23b0059f0f5"}
Jul 29 21:15:02.172226 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:15:02.171918    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8q668"
Jul 29 21:15:02.189241 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:15:02.189199    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-8q668" podStartSLOduration=1.6853978889999999 podStartE2EDuration="4.189187636s" totalImagesPullingTime="2.503789747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:15:02.189029904 +0000 UTC m=+694.194553272" watchObservedRunningTime="2026-07-29 21:15:02.189187636 +0000 UTC m=+694.194711003"
Jul 29 21:15:13.177601 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:15:13.177567    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8q668"
Jul 29 21:15:18.883343 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:15:18.883307    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:15:18.990947 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:15:18.990861    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:15:19.410834 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:15:19.410802    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:15:31.466436 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:15:31.466369    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:15:31.566022 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:15:31.565991    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:15:38.007707 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:15:38.007666    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:15:38.101344 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:15:38.101312    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:15:38.272224 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:15:38.272145    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:15:41.364659 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:15:41.364625    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:15:41.431035 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:15:41.431004    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:16:08.629702 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:08.629667    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:16:14.243393 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:14.243355    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:16:14.341917 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:14.341887    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:16:15.743709 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:15.743675    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:16:16.385973 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:16.385940    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:16:16.444299 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:16.444272    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:16:16.461153 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:16.461126    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:16:24.550960 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:24.550925    2575 generic.go:356] "Generic (PLEG): container finished" podID="72aff634-da5f-432e-92aa-cbc8193dca2d" containerID="201214a94707da09c3c57ec551a66f241ac4e564f2d2e966a0fd0f8bd248270a" exitCode=0
Jul 29 21:16:24.551396 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:24.550996    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9" event={"ID":"72aff634-da5f-432e-92aa-cbc8193dca2d","Type":"ContainerDied","Data":"201214a94707da09c3c57ec551a66f241ac4e564f2d2e966a0fd0f8bd248270a"}
Jul 29 21:16:24.551396 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:24.551324    2575 scope.go:117] "RemoveContainer" containerID="201214a94707da09c3c57ec551a66f241ac4e564f2d2e966a0fd0f8bd248270a"
Jul 29 21:16:24.552310 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:24.552281    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:16:24.552422 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:24.552353    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:16:24.552422 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:24.552387    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:16:25.561081 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:25.561036    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9" event={"ID":"72aff634-da5f-432e-92aa-cbc8193dca2d","Type":"ContainerStarted","Data":"ba087bf2233430ee3f4b4681a1f37bddd7524bd7c42ce5fa294ec498816f85e0"}
Jul 29 21:16:26.470671 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:26.470639    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:16:26.470836 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:26.470795    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-99jf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 29 21:16:26.470881 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:26.470838    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9" podUID="72aff634-da5f-432e-92aa-cbc8193dca2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 29 21:16:26.491420 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:26.491388    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:16:26.589991 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:26.589957    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:16:27.471231 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:27.471195    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-99jf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 29 21:16:27.471405 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:27.471250    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9" podUID="72aff634-da5f-432e-92aa-cbc8193dca2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 29 21:16:28.471307 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:28.471274    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-99jf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 29 21:16:28.471702 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:28.471331    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9" podUID="72aff634-da5f-432e-92aa-cbc8193dca2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 29 21:16:29.473822 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:29.473790    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:16:29.474202 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:29.474062    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:16:29.474648 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:29.474629    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-99jf9"
Jul 29 21:16:38.207557 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:38.207525    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:16:38.525050 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:38.524956    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:16:49.884964 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:49.884927    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"]
Jul 29 21:16:49.888740 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:49.888721    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:49.891430 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:49.891406    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 21:16:49.892507 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:49.892483    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 21:16:49.892627 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:49.892579    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 29 21:16:49.892678 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:49.892658    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gqldj\""
Jul 29 21:16:49.900978 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:49.900656    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"]
Jul 29 21:16:49.951688 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:49.951650    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cfecc06-269a-4e2b-a449-82b1ca976a8b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:49.951688 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:49.951688    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cfecc06-269a-4e2b-a449-82b1ca976a8b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:49.951907 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:49.951720    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cfecc06-269a-4e2b-a449-82b1ca976a8b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:49.951907 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:49.951801    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmjbw\" (UniqueName: \"kubernetes.io/projected/5cfecc06-269a-4e2b-a449-82b1ca976a8b-kube-api-access-nmjbw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:49.952002 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:49.951904    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cfecc06-269a-4e2b-a449-82b1ca976a8b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:49.952002 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:49.951930    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cfecc06-269a-4e2b-a449-82b1ca976a8b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:50.051265 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.051225    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:16:50.052392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.052372    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cfecc06-269a-4e2b-a449-82b1ca976a8b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:50.052468 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.052415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmjbw\" (UniqueName: \"kubernetes.io/projected/5cfecc06-269a-4e2b-a449-82b1ca976a8b-kube-api-access-nmjbw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:50.052517 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.052506    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cfecc06-269a-4e2b-a449-82b1ca976a8b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:50.052668 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.052635    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cfecc06-269a-4e2b-a449-82b1ca976a8b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:50.052810 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.052713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cfecc06-269a-4e2b-a449-82b1ca976a8b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:50.052810 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.052743    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cfecc06-269a-4e2b-a449-82b1ca976a8b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:50.052910 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.052807    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cfecc06-269a-4e2b-a449-82b1ca976a8b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:50.053063 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.053040    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cfecc06-269a-4e2b-a449-82b1ca976a8b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:50.053125 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.053090    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cfecc06-269a-4e2b-a449-82b1ca976a8b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:50.054657 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.054606    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cfecc06-269a-4e2b-a449-82b1ca976a8b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:50.055078 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.055056    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cfecc06-269a-4e2b-a449-82b1ca976a8b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:50.061525 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.061501    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmjbw\" (UniqueName: \"kubernetes.io/projected/5cfecc06-269a-4e2b-a449-82b1ca976a8b-kube-api-access-nmjbw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fj2dr\" (UID: \"5cfecc06-269a-4e2b-a449-82b1ca976a8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:50.200634 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.200530    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:16:50.331534 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.331491    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"]
Jul 29 21:16:50.334032 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:16:50.334005    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfecc06_269a_4e2b_a449_82b1ca976a8b.slice/crio-9ba5eb50f4594cac2584471b92628d9c10d1f564c35a8c51bf95109e88d1154f WatchSource:0}: Error finding container 9ba5eb50f4594cac2584471b92628d9c10d1f564c35a8c51bf95109e88d1154f: Status 404 returned error can't find the container with id 9ba5eb50f4594cac2584471b92628d9c10d1f564c35a8c51bf95109e88d1154f
Jul 29 21:16:50.614558 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.614524    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:16:50.678710 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:50.678677    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr" event={"ID":"5cfecc06-269a-4e2b-a449-82b1ca976a8b","Type":"ContainerStarted","Data":"9ba5eb50f4594cac2584471b92628d9c10d1f564c35a8c51bf95109e88d1154f"}
Jul 29 21:16:51.684585 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:51.684500    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr" event={"ID":"5cfecc06-269a-4e2b-a449-82b1ca976a8b","Type":"ContainerStarted","Data":"3721282fc51601698d3cb9105dd4385e8caf61121170ad2122277651b1e6728e"}
Jul 29 21:16:51.701696 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:51.701650    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr" podStartSLOduration=1.732828328 podStartE2EDuration="2.701637121s" totalImagesPullingTime="968.808793ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:16:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:16:51.700062661 +0000 UTC m=+803.705586029" watchObservedRunningTime="2026-07-29 21:16:51.701637121 +0000 UTC m=+803.707160489"
Jul 29 21:16:57.597274 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.594394    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"]
Jul 29 21:16:57.602489 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.602461    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.605493 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.605465    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 29 21:16:57.609026 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.609004    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"]
Jul 29 21:16:57.623826 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.623800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:16:57.726273 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.726241    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b85c89d8-7f2b-48c6-a9d5-30f42561243b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.726466 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.726284    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b85c89d8-7f2b-48c6-a9d5-30f42561243b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.726466 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.726302    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85c89d8-7f2b-48c6-a9d5-30f42561243b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.726466 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.726320    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b85c89d8-7f2b-48c6-a9d5-30f42561243b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.726466 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.726398    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6v7q\" (UniqueName: \"kubernetes.io/projected/b85c89d8-7f2b-48c6-a9d5-30f42561243b-kube-api-access-s6v7q\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.726609 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.726465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b85c89d8-7f2b-48c6-a9d5-30f42561243b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.827552 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.827517    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85c89d8-7f2b-48c6-a9d5-30f42561243b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.827552 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.827555    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b85c89d8-7f2b-48c6-a9d5-30f42561243b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.827747 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.827694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6v7q\" (UniqueName: \"kubernetes.io/projected/b85c89d8-7f2b-48c6-a9d5-30f42561243b-kube-api-access-s6v7q\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.827795 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.827761    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b85c89d8-7f2b-48c6-a9d5-30f42561243b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.827896 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.827844    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b85c89d8-7f2b-48c6-a9d5-30f42561243b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.827896 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.827889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b85c89d8-7f2b-48c6-a9d5-30f42561243b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.828009 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.827997    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85c89d8-7f2b-48c6-a9d5-30f42561243b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.828082 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.828065    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b85c89d8-7f2b-48c6-a9d5-30f42561243b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.828163 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.828143    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b85c89d8-7f2b-48c6-a9d5-30f42561243b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.829815 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.829792    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b85c89d8-7f2b-48c6-a9d5-30f42561243b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.830165 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.830148    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b85c89d8-7f2b-48c6-a9d5-30f42561243b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.835690 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.835670    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6v7q\" (UniqueName: \"kubernetes.io/projected/b85c89d8-7f2b-48c6-a9d5-30f42561243b-kube-api-access-s6v7q\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rbf6q\" (UID: \"b85c89d8-7f2b-48c6-a9d5-30f42561243b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:57.914034 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:57.913970    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:16:58.044839 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:58.044810    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"]
Jul 29 21:16:58.046323 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:16:58.046299    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85c89d8_7f2b_48c6_a9d5_30f42561243b.slice/crio-b5333a3e612a7b0161c2d48ad5cd5fdde3353bf7b92bd4130ecc9b4af2c82360 WatchSource:0}: Error finding container b5333a3e612a7b0161c2d48ad5cd5fdde3353bf7b92bd4130ecc9b4af2c82360: Status 404 returned error can't find the container with id b5333a3e612a7b0161c2d48ad5cd5fdde3353bf7b92bd4130ecc9b4af2c82360
Jul 29 21:16:58.713676 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:58.713646    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:16:58.718328 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:58.718296    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q" event={"ID":"b85c89d8-7f2b-48c6-a9d5-30f42561243b","Type":"ContainerStarted","Data":"d3a6f5589fcb52f3ae038444c91999d13de72cf1ca0a1ce4f3748209df0f53a4"}
Jul 29 21:16:58.718548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:58.718345    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q" event={"ID":"b85c89d8-7f2b-48c6-a9d5-30f42561243b","Type":"ContainerStarted","Data":"b5333a3e612a7b0161c2d48ad5cd5fdde3353bf7b92bd4130ecc9b4af2c82360"}
Jul 29 21:16:58.735809 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:16:58.735764    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q" podStartSLOduration=1.563594183 podStartE2EDuration="1.73574428s" totalImagesPullingTime="172.150097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:16:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:16:58.733580514 +0000 UTC m=+810.739103877" watchObservedRunningTime="2026-07-29 21:16:58.73574428 +0000 UTC m=+810.741267660"
Jul 29 21:17:00.200672 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:17:00.200633    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:17:00.201079 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:17:00.200701    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:17:00.213353 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:17:00.213323    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:17:00.739053 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:17:00.739025    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fj2dr"
Jul 29 21:17:02.399654 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:17:02.399624    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:17:04.512800 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:17:04.512765    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:17:07.915020 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:17:07.914979    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:17:07.915398 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:17:07.915111    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:17:07.927250 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:17:07.927222    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:17:08.779567 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:17:08.779533    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rbf6q"
Jul 29 21:17:10.814083 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:17:10.814054    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:17:13.009983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:17:13.009947    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:17:19.329432 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:17:19.329396    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:17:23.121094 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:17:23.121052    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:17:28.222201 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:17:28.222165    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:18:26.885903 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:18:26.885821    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:18:26.957848 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:18:26.957819    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:18:28.356277 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:18:28.356239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:18:28.464015 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:18:28.463980    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:18:29.614958 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:18:29.614929    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:18:29.851792 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:18:29.851759    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:18:59.573061 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:18:59.573029    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:19:09.324602 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:19:09.324569    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:19:21.240372 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:19:21.240338    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:19:59.526790 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:19:59.526709    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:20:04.248430 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:20:04.248395    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:20:36.366662 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:20:36.366626    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:20:37.614191 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:20:37.614152    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:21:01.024964 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:21:01.024925    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:21:13.454423 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:21:13.454371    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:21:13.554189 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:21:13.554152    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:21:13.696213 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:21:13.696184    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:21:19.509390 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:21:19.509356    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:21:19.576336 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:21:19.576287    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:21:19.653764 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:21:19.653734    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:21:19.753672 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:21:19.753646    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:21:19.907140 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:21:19.907118    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:21:25.665494 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:21:25.665459    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:21:25.766995 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:21:25.766956    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:21:43.222864 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:21:43.222833    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:21:44.014014 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:21:44.013981    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:21:44.067399 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:21:44.067375    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:21:52.512141 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:21:52.512106    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:22:02.914166 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:22:02.914131    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:22:09.114209 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:22:09.114173    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:22:20.823856 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:22:20.823824    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:22:30.524657 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:22:30.524626    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:22:30.626385 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:22:30.626360    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:22:42.610936 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:22:42.610903    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:22:52.420851 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:22:52.420773    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:23:15.328584 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:23:15.328551    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:23:27.220513 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:23:27.220477    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:23:52.536120 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:23:52.536078    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:24:04.135260 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:24:04.135228    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:24:15.037957 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:24:15.037924    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:24:31.686139 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:24:31.686062    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:24:41.996759 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:24:41.996727    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:24:58.434381 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:24:58.434346    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:25:08.326774 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:25:08.326737    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:25:20.822987 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:25:20.822950    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:25:22.959039 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:25:22.959011    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:25:24.984852 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:25:24.984821    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:25:29.119244 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:25:29.119210    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:27:07.627951 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:27:07.627919    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:27:15.520390 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:27:15.520342    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:27:19.119657 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:27:19.119623    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:27:32.224298 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:27:32.224222    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:27:44.014853 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:27:44.014819    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:27:57.615201 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:27:57.615165    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:28:05.925299 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:28:05.925263    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:28:15.718629 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:28:15.718592    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:28:26.924190 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:28:26.924155    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:28:36.139295 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:28:36.139261    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:28:46.119107 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:28:46.119070    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:28:58.523736 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:28:58.523655    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:29:00.871671 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:00.871636    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:29:06.121014 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:06.120979    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:29:26.620774 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:26.620737    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:29:34.030729 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:34.030694    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:29:46.291827 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.291791    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"]
Jul 29 21:29:46.295460 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.295430    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.298082 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.298062    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-65d8efe4-kserve-self-signed-certs\""
Jul 29 21:29:46.320466 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.320425    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"]
Jul 29 21:29:46.322390 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.322364    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/071dfd20-4a1d-464b-aae0-67f5bd46eca3-tls-certs\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.322528 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.322436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-dshm\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.322528 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.322498    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-tmp-dir\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.322658 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.322547    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-home\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.322658 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.322570    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f5d9\" (UniqueName: \"kubernetes.io/projected/071dfd20-4a1d-464b-aae0-67f5bd46eca3-kube-api-access-8f5d9\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.322658 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.322618    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-model-cache\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.324748 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.324723    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:29:46.423718 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.423675    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-home\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.423905 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.423740    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f5d9\" (UniqueName: \"kubernetes.io/projected/071dfd20-4a1d-464b-aae0-67f5bd46eca3-kube-api-access-8f5d9\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.423905 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.423798    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-model-cache\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.423905 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.423840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/071dfd20-4a1d-464b-aae0-67f5bd46eca3-tls-certs\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.424089 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.423924    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-dshm\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.424089 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.423958    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-tmp-dir\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.424294 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.424272    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-model-cache\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.424717 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.424694    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-tmp-dir\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.424910 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.424782    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-home\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.426356 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.426331    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-dshm\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.426458 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.426427    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/071dfd20-4a1d-464b-aae0-67f5bd46eca3-tls-certs\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.432599 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.432578    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f5d9\" (UniqueName: \"kubernetes.io/projected/071dfd20-4a1d-464b-aae0-67f5bd46eca3-kube-api-access-8f5d9\") pod \"e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") " pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.604947 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.604870    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:46.739593 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:46.739565    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"]
Jul 29 21:29:46.741384 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:29:46.741355    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod071dfd20_4a1d_464b_aae0_67f5bd46eca3.slice/crio-1783541fb403c47e079a1b95cad5339229ad4773357e98225b21b2c9c0e6934a WatchSource:0}: Error finding container 1783541fb403c47e079a1b95cad5339229ad4773357e98225b21b2c9c0e6934a: Status 404 returned error can't find the container with id 1783541fb403c47e079a1b95cad5339229ad4773357e98225b21b2c9c0e6934a
Jul 29 21:29:47.443975 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:47.443943    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z" event={"ID":"071dfd20-4a1d-464b-aae0-67f5bd46eca3","Type":"ContainerStarted","Data":"762d33922fcc81f231cc8073bb1f5721802b536fcbe06b0f2a088386807f37c9"}
Jul 29 21:29:47.444328 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:47.443988    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z" event={"ID":"071dfd20-4a1d-464b-aae0-67f5bd46eca3","Type":"ContainerStarted","Data":"1783541fb403c47e079a1b95cad5339229ad4773357e98225b21b2c9c0e6934a"}
Jul 29 21:29:47.461390 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:47.461338    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z" podStartSLOduration=1.461323942 podStartE2EDuration="1.461323942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:29:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:29:47.460727904 +0000 UTC m=+1579.466251272" watchObservedRunningTime="2026-07-29 21:29:47.461323942 +0000 UTC m=+1579.466847310"
Jul 29 21:29:49.617376 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:49.617342    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:29:50.188874 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.188791    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"]
Jul 29 21:29:50.192574 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.192553    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.195653 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.195632    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-65d8efe4-kserve-self-signed-certs\""
Jul 29 21:29:50.201811 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.201789    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"]
Jul 29 21:29:50.261224 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.261193    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgtm2\" (UniqueName: \"kubernetes.io/projected/8bded789-672e-4480-a25a-5e4fa6664e01-kube-api-access-xgtm2\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.261339 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.261228    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-tmp-dir\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.261339 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.261254    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-dshm\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.261412 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.261382    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-home\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.261469 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.261418    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bded789-672e-4480-a25a-5e4fa6664e01-tls-certs\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.261469 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.261437    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-model-cache\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.362469 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.362422    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-model-cache\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.362620 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.362531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgtm2\" (UniqueName: \"kubernetes.io/projected/8bded789-672e-4480-a25a-5e4fa6664e01-kube-api-access-xgtm2\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.362620 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.362560    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-tmp-dir\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.362620 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.362590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-dshm\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.362757 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.362629    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-home\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.362757 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.362657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bded789-672e-4480-a25a-5e4fa6664e01-tls-certs\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.362855 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.362792    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-model-cache\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.362855 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.362845    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-tmp-dir\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.363023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.363002    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-home\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.364696 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.364671    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-dshm\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.364933 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.364916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bded789-672e-4480-a25a-5e4fa6664e01-tls-certs\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.370844 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.370823    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgtm2\" (UniqueName: \"kubernetes.io/projected/8bded789-672e-4480-a25a-5e4fa6664e01-kube-api-access-xgtm2\") pod \"e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") " pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.503218 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.503137    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:29:50.647400 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.647373    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"]
Jul 29 21:29:50.649416 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:29:50.649391    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bded789_672e_4480_a25a_5e4fa6664e01.slice/crio-78da8cb9d55967f20edb1f10b5f94b097025c450dd4a50092764e94c2e7b5821 WatchSource:0}: Error finding container 78da8cb9d55967f20edb1f10b5f94b097025c450dd4a50092764e94c2e7b5821: Status 404 returned error can't find the container with id 78da8cb9d55967f20edb1f10b5f94b097025c450dd4a50092764e94c2e7b5821
Jul 29 21:29:50.921767 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:50.921735    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:29:51.464271 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:51.464234    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7" event={"ID":"8bded789-672e-4480-a25a-5e4fa6664e01","Type":"ContainerStarted","Data":"8e7b2b2605aad1a925baf57c5161e0b760e08782a761a940e0591bc99349c04d"}
Jul 29 21:29:51.464271 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:51.464279    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7" event={"ID":"8bded789-672e-4480-a25a-5e4fa6664e01","Type":"ContainerStarted","Data":"78da8cb9d55967f20edb1f10b5f94b097025c450dd4a50092764e94c2e7b5821"}
Jul 29 21:29:51.504400 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:51.504356    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7" podStartSLOduration=1.504342431 podStartE2EDuration="1.504342431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:29:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:29:51.50286147 +0000 UTC m=+1583.508384849" watchObservedRunningTime="2026-07-29 21:29:51.504342431 +0000 UTC m=+1583.509865809"
Jul 29 21:29:56.605098 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:56.605062    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:56.605542 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:56.605107    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:56.617479 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:56.617437    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:29:57.503305 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:29:57.503275    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:30:00.142239 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:00.142203    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756010-zkskw"]
Jul 29 21:30:00.145866 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:00.145848    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756010-zkskw"
Jul 29 21:30:00.148213 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:00.148192    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9wjvq\""
Jul 29 21:30:00.153224 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:00.153203    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756010-zkskw"]
Jul 29 21:30:00.157873 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:00.157855    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756010-zkskw"
Jul 29 21:30:00.499886 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:00.499861    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756010-zkskw"]
Jul 29 21:30:00.501848 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:30:00.501815    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a37fb97_f1df_46e4_b48b_91289d365e47.slice/crio-73da375092854d6dcb11731495766381eeebf687009bd954c69db40b86af53d9 WatchSource:0}: Error finding container 73da375092854d6dcb11731495766381eeebf687009bd954c69db40b86af53d9: Status 404 returned error can't find the container with id 73da375092854d6dcb11731495766381eeebf687009bd954c69db40b86af53d9
Jul 29 21:30:00.503258 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:00.503238    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:30:00.503363 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:00.503320    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:30:00.503882 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:00.503862    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 21:30:00.517330 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:00.517301    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:30:01.514125 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:01.514087    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756010-zkskw" event={"ID":"5a37fb97-f1df-46e4-b48b-91289d365e47","Type":"ContainerStarted","Data":"73da375092854d6dcb11731495766381eeebf687009bd954c69db40b86af53d9"}
Jul 29 21:30:01.525398 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:01.525371    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:30:04.531359 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:04.531267    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756010-zkskw" event={"ID":"5a37fb97-f1df-46e4-b48b-91289d365e47","Type":"ContainerStarted","Data":"6be23c574888bcb04373ead2dea6eb536f565e4bc02546185378cbf1e8e0ec2e"}
Jul 29 21:30:04.547899 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:04.547838    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756010-zkskw" podStartSLOduration=1.256216282 podStartE2EDuration="4.54782155s" totalImagesPullingTime="3.291605268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:30:04.546768698 +0000 UTC m=+1596.552292065" watchObservedRunningTime="2026-07-29 21:30:04.54782155 +0000 UTC m=+1596.553344918"
Jul 29 21:30:05.424391 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:05.424357    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:30:05.538059 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:05.538026    2575 generic.go:356] "Generic (PLEG): container finished" podID="5a37fb97-f1df-46e4-b48b-91289d365e47" containerID="6be23c574888bcb04373ead2dea6eb536f565e4bc02546185378cbf1e8e0ec2e" exitCode=0
Jul 29 21:30:05.538429 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:05.538121    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756010-zkskw" event={"ID":"5a37fb97-f1df-46e4-b48b-91289d365e47","Type":"ContainerDied","Data":"6be23c574888bcb04373ead2dea6eb536f565e4bc02546185378cbf1e8e0ec2e"}
Jul 29 21:30:06.685805 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:06.685777    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756010-zkskw"
Jul 29 21:30:07.549407 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:07.549367    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756010-zkskw" event={"ID":"5a37fb97-f1df-46e4-b48b-91289d365e47","Type":"ContainerDied","Data":"73da375092854d6dcb11731495766381eeebf687009bd954c69db40b86af53d9"}
Jul 29 21:30:07.549407 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:07.549401    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756010-zkskw"
Jul 29 21:30:07.549635 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:07.549427    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73da375092854d6dcb11731495766381eeebf687009bd954c69db40b86af53d9"
Jul 29 21:30:19.074716 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:19.074681    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"]
Jul 29 21:30:19.099197 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:19.099167    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:30:19.951343 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:19.951309    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"]
Jul 29 21:30:19.988380 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:19.988347    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:30:23.012099 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:23.012066    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:30:34.093772 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.093730    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z" podUID="071dfd20-4a1d-464b-aae0-67f5bd46eca3" containerName="main" containerID="cri-o://762d33922fcc81f231cc8073bb1f5721802b536fcbe06b0f2a088386807f37c9" gracePeriod=45
Jul 29 21:30:34.352490 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.352416    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:30:34.365881 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.365858    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-home\") pod \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") "
Jul 29 21:30:34.366002 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.365892    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/071dfd20-4a1d-464b-aae0-67f5bd46eca3-tls-certs\") pod \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") "
Jul 29 21:30:34.366002 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.365917    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-tmp-dir\") pod \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") "
Jul 29 21:30:34.366002 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.365939    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-model-cache\") pod \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") "
Jul 29 21:30:34.366141 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.366053    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-dshm\") pod \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") "
Jul 29 21:30:34.366141 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.366058    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-home" (OuterVolumeSpecName: "home") pod "071dfd20-4a1d-464b-aae0-67f5bd46eca3" (UID: "071dfd20-4a1d-464b-aae0-67f5bd46eca3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:34.366242 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.366157    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f5d9\" (UniqueName: \"kubernetes.io/projected/071dfd20-4a1d-464b-aae0-67f5bd46eca3-kube-api-access-8f5d9\") pod \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\" (UID: \"071dfd20-4a1d-464b-aae0-67f5bd46eca3\") "
Jul 29 21:30:34.366242 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.366173    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "071dfd20-4a1d-464b-aae0-67f5bd46eca3" (UID: "071dfd20-4a1d-464b-aae0-67f5bd46eca3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:34.366320 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.366248    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-model-cache" (OuterVolumeSpecName: "model-cache") pod "071dfd20-4a1d-464b-aae0-67f5bd46eca3" (UID: "071dfd20-4a1d-464b-aae0-67f5bd46eca3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:34.366531 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.366514    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-home\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:30:34.366531 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.366531    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-tmp-dir\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:30:34.366669 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.366540    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-model-cache\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:30:34.368186 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.368157    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/071dfd20-4a1d-464b-aae0-67f5bd46eca3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "071dfd20-4a1d-464b-aae0-67f5bd46eca3" (UID: "071dfd20-4a1d-464b-aae0-67f5bd46eca3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:30:34.368293 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.368218    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-dshm" (OuterVolumeSpecName: "dshm") pod "071dfd20-4a1d-464b-aae0-67f5bd46eca3" (UID: "071dfd20-4a1d-464b-aae0-67f5bd46eca3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:34.368293 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.368229    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/071dfd20-4a1d-464b-aae0-67f5bd46eca3-kube-api-access-8f5d9" (OuterVolumeSpecName: "kube-api-access-8f5d9") pod "071dfd20-4a1d-464b-aae0-67f5bd46eca3" (UID: "071dfd20-4a1d-464b-aae0-67f5bd46eca3"). InnerVolumeSpecName "kube-api-access-8f5d9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:30:34.467022 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.466989    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f5d9\" (UniqueName: \"kubernetes.io/projected/071dfd20-4a1d-464b-aae0-67f5bd46eca3-kube-api-access-8f5d9\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:30:34.467022 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.467017    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/071dfd20-4a1d-464b-aae0-67f5bd46eca3-tls-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:30:34.467022 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.467027    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/071dfd20-4a1d-464b-aae0-67f5bd46eca3-dshm\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:30:34.705197 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.705114    2575 generic.go:356] "Generic (PLEG): container finished" podID="071dfd20-4a1d-464b-aae0-67f5bd46eca3" containerID="762d33922fcc81f231cc8073bb1f5721802b536fcbe06b0f2a088386807f37c9" exitCode=0
Jul 29 21:30:34.705197 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.705154    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"
Jul 29 21:30:34.705197 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.705168    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z" event={"ID":"071dfd20-4a1d-464b-aae0-67f5bd46eca3","Type":"ContainerDied","Data":"762d33922fcc81f231cc8073bb1f5721802b536fcbe06b0f2a088386807f37c9"}
Jul 29 21:30:34.705428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.705200    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z" event={"ID":"071dfd20-4a1d-464b-aae0-67f5bd46eca3","Type":"ContainerDied","Data":"1783541fb403c47e079a1b95cad5339229ad4773357e98225b21b2c9c0e6934a"}
Jul 29 21:30:34.705428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.705221    2575 scope.go:117] "RemoveContainer" containerID="762d33922fcc81f231cc8073bb1f5721802b536fcbe06b0f2a088386807f37c9"
Jul 29 21:30:34.718141 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.718123    2575 scope.go:117] "RemoveContainer" containerID="762d33922fcc81f231cc8073bb1f5721802b536fcbe06b0f2a088386807f37c9"
Jul 29 21:30:34.718359 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:30:34.718339    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"762d33922fcc81f231cc8073bb1f5721802b536fcbe06b0f2a088386807f37c9\": container with ID starting with 762d33922fcc81f231cc8073bb1f5721802b536fcbe06b0f2a088386807f37c9 not found: ID does not exist" containerID="762d33922fcc81f231cc8073bb1f5721802b536fcbe06b0f2a088386807f37c9"
Jul 29 21:30:34.718409 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.718366    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762d33922fcc81f231cc8073bb1f5721802b536fcbe06b0f2a088386807f37c9"} err="failed to get container status \"762d33922fcc81f231cc8073bb1f5721802b536fcbe06b0f2a088386807f37c9\": rpc error: code = NotFound desc = could not find container \"762d33922fcc81f231cc8073bb1f5721802b536fcbe06b0f2a088386807f37c9\": container with ID starting with 762d33922fcc81f231cc8073bb1f5721802b536fcbe06b0f2a088386807f37c9 not found: ID does not exist"
Jul 29 21:30:34.730292 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.730256    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"]
Jul 29 21:30:34.732018 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.732000    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-65d8efe4-kserve-5f5bff66bc-f778z"]
Jul 29 21:30:34.970144 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:34.970062    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7" podUID="8bded789-672e-4480-a25a-5e4fa6664e01" containerName="main" containerID="cri-o://8e7b2b2605aad1a925baf57c5161e0b760e08782a761a940e0591bc99349c04d" gracePeriod=45
Jul 29 21:30:35.218113 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.218087    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:30:35.274828 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.274756    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-dshm\") pod \"8bded789-672e-4480-a25a-5e4fa6664e01\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") "
Jul 29 21:30:35.274828 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.274802    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-tmp-dir\") pod \"8bded789-672e-4480-a25a-5e4fa6664e01\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") "
Jul 29 21:30:35.275039 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.274864    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgtm2\" (UniqueName: \"kubernetes.io/projected/8bded789-672e-4480-a25a-5e4fa6664e01-kube-api-access-xgtm2\") pod \"8bded789-672e-4480-a25a-5e4fa6664e01\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") "
Jul 29 21:30:35.275039 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.274913    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bded789-672e-4480-a25a-5e4fa6664e01-tls-certs\") pod \"8bded789-672e-4480-a25a-5e4fa6664e01\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") "
Jul 29 21:30:35.275039 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.274969    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-model-cache\") pod \"8bded789-672e-4480-a25a-5e4fa6664e01\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") "
Jul 29 21:30:35.275039 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.275002    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-home\") pod \"8bded789-672e-4480-a25a-5e4fa6664e01\" (UID: \"8bded789-672e-4480-a25a-5e4fa6664e01\") "
Jul 29 21:30:35.275252 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.275114    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8bded789-672e-4480-a25a-5e4fa6664e01" (UID: "8bded789-672e-4480-a25a-5e4fa6664e01"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:35.275252 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.275200    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-model-cache" (OuterVolumeSpecName: "model-cache") pod "8bded789-672e-4480-a25a-5e4fa6664e01" (UID: "8bded789-672e-4480-a25a-5e4fa6664e01"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:35.275365 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.275289    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-home" (OuterVolumeSpecName: "home") pod "8bded789-672e-4480-a25a-5e4fa6664e01" (UID: "8bded789-672e-4480-a25a-5e4fa6664e01"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:35.275422 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.275374    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-tmp-dir\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:30:35.275422 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.275389    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-model-cache\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:30:35.277121 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.277096    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bded789-672e-4480-a25a-5e4fa6664e01-kube-api-access-xgtm2" (OuterVolumeSpecName: "kube-api-access-xgtm2") pod "8bded789-672e-4480-a25a-5e4fa6664e01" (UID: "8bded789-672e-4480-a25a-5e4fa6664e01"). InnerVolumeSpecName "kube-api-access-xgtm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:30:35.277287 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.277267    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-dshm" (OuterVolumeSpecName: "dshm") pod "8bded789-672e-4480-a25a-5e4fa6664e01" (UID: "8bded789-672e-4480-a25a-5e4fa6664e01"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:30:35.277502 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.277481    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bded789-672e-4480-a25a-5e4fa6664e01-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8bded789-672e-4480-a25a-5e4fa6664e01" (UID: "8bded789-672e-4480-a25a-5e4fa6664e01"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:30:35.376540 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.376506    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgtm2\" (UniqueName: \"kubernetes.io/projected/8bded789-672e-4480-a25a-5e4fa6664e01-kube-api-access-xgtm2\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:30:35.376540 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.376537    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bded789-672e-4480-a25a-5e4fa6664e01-tls-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:30:35.376690 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.376553    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-home\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:30:35.376690 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.376564    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bded789-672e-4480-a25a-5e4fa6664e01-dshm\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:30:35.712641 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.712612    2575 generic.go:356] "Generic (PLEG): container finished" podID="8bded789-672e-4480-a25a-5e4fa6664e01" containerID="8e7b2b2605aad1a925baf57c5161e0b760e08782a761a940e0591bc99349c04d" exitCode=0
Jul 29 21:30:35.712812 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.712661    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"
Jul 29 21:30:35.712812 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.712676    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7" event={"ID":"8bded789-672e-4480-a25a-5e4fa6664e01","Type":"ContainerDied","Data":"8e7b2b2605aad1a925baf57c5161e0b760e08782a761a940e0591bc99349c04d"}
Jul 29 21:30:35.712812 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.712709    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7" event={"ID":"8bded789-672e-4480-a25a-5e4fa6664e01","Type":"ContainerDied","Data":"78da8cb9d55967f20edb1f10b5f94b097025c450dd4a50092764e94c2e7b5821"}
Jul 29 21:30:35.712812 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.712726    2575 scope.go:117] "RemoveContainer" containerID="8e7b2b2605aad1a925baf57c5161e0b760e08782a761a940e0591bc99349c04d"
Jul 29 21:30:35.721506 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.721491    2575 scope.go:117] "RemoveContainer" containerID="8e7b2b2605aad1a925baf57c5161e0b760e08782a761a940e0591bc99349c04d"
Jul 29 21:30:35.721746 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:30:35.721726    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e7b2b2605aad1a925baf57c5161e0b760e08782a761a940e0591bc99349c04d\": container with ID starting with 8e7b2b2605aad1a925baf57c5161e0b760e08782a761a940e0591bc99349c04d not found: ID does not exist" containerID="8e7b2b2605aad1a925baf57c5161e0b760e08782a761a940e0591bc99349c04d"
Jul 29 21:30:35.721818 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.721753    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e7b2b2605aad1a925baf57c5161e0b760e08782a761a940e0591bc99349c04d"} err="failed to get container status \"8e7b2b2605aad1a925baf57c5161e0b760e08782a761a940e0591bc99349c04d\": rpc error: code = NotFound desc = could not find container \"8e7b2b2605aad1a925baf57c5161e0b760e08782a761a940e0591bc99349c04d\": container with ID starting with 8e7b2b2605aad1a925baf57c5161e0b760e08782a761a940e0591bc99349c04d not found: ID does not exist"
Jul 29 21:30:35.734944 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.734916    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"]
Jul 29 21:30:35.738850 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:35.738828    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-65d8efe4-kserve-66d7b8944c-5zmj7"]
Jul 29 21:30:36.483816 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:36.483775    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="071dfd20-4a1d-464b-aae0-67f5bd46eca3" path="/var/lib/kubelet/pods/071dfd20-4a1d-464b-aae0-67f5bd46eca3/volumes"
Jul 29 21:30:36.484394 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:36.484376    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bded789-672e-4480-a25a-5e4fa6664e01" path="/var/lib/kubelet/pods/8bded789-672e-4480-a25a-5e4fa6664e01/volumes"
Jul 29 21:30:36.522925 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:36.522894    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:30:43.516045 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:43.516006    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:30:44.801073 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:44.801037    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:30:49.845155 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:30:49.845124    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:31:00.121415 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:31:00.121377    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:31:15.217489 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:31:15.217453    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:31:24.423819 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:31:24.423759    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:31:38.050389 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:31:38.050351    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:31:47.538340 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:31:47.538302    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:32:01.618074 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:32:01.618040    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:32:11.229712 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:32:11.229669    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:32:21.822531 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:32:21.822492    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:32:32.616861 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:32:32.616820    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:32:45.136362 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:32:45.136324    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:32:54.516641 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:32:54.516604    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:33:07.425660 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:33:07.425625    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:33:19.643901 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:33:19.643866    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:33:33.231408 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:33:33.231372    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:33:36.064290 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:33:36.064254    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:33:42.518520 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:33:42.518485    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:34:02.240351 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:02.240306    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:05.680943 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:05.680863    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:05.778202 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:05.778166    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:05.927155 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:05.927122    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:34:06.173768 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:06.173727    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:12.175866 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.175828    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:12.260238 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.260204    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:12.413972 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.413940    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:12.718066 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.718034    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"]
Jul 29 21:34:12.718517 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.718500    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a37fb97-f1df-46e4-b48b-91289d365e47" containerName="cleanup"
Jul 29 21:34:12.718517 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.718518    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a37fb97-f1df-46e4-b48b-91289d365e47" containerName="cleanup"
Jul 29 21:34:12.718683 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.718543    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="071dfd20-4a1d-464b-aae0-67f5bd46eca3" containerName="main"
Jul 29 21:34:12.718683 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.718552    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="071dfd20-4a1d-464b-aae0-67f5bd46eca3" containerName="main"
Jul 29 21:34:12.718683 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.718562    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bded789-672e-4480-a25a-5e4fa6664e01" containerName="main"
Jul 29 21:34:12.718683 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.718571    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bded789-672e-4480-a25a-5e4fa6664e01" containerName="main"
Jul 29 21:34:12.718683 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.718654    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bded789-672e-4480-a25a-5e4fa6664e01" containerName="main"
Jul 29 21:34:12.718683 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.718671    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="071dfd20-4a1d-464b-aae0-67f5bd46eca3" containerName="main"
Jul 29 21:34:12.718683 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.718680    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a37fb97-f1df-46e4-b48b-91289d365e47" containerName="cleanup"
Jul 29 21:34:12.722127 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.722107    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.725403 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.725383    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-80781434-openshift-default-dockercfg-94v86\""
Jul 29 21:34:12.735034 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.735009    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:12.744759 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.744739    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"]
Jul 29 21:34:12.835328 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.835291    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:12.869291 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.869266    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b65df201-cbae-4aff-89a9-eaf44c6b1246-istiod-ca-cert\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.869380 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.869301    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-token\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.869380 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.869362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-podinfo\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.869490 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.869394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6bfw\" (UniqueName: \"kubernetes.io/projected/b65df201-cbae-4aff-89a9-eaf44c6b1246-kube-api-access-j6bfw\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.869490 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.869467    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-credential-socket\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.869567 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.869503    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-workload-socket\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.869567 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.869526    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-workload-certs\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.869567 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.869542    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-envoy\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.869678 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.869567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-data\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.970535 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.970429    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-podinfo\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.970535 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.970493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6bfw\" (UniqueName: \"kubernetes.io/projected/b65df201-cbae-4aff-89a9-eaf44c6b1246-kube-api-access-j6bfw\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.970535 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.970520    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-credential-socket\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.970800 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.970544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-workload-socket\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.970800 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.970572    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-workload-certs\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.970800 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.970589    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-envoy\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.970800 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.970613    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-data\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.971002 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.970981    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-workload-socket\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.971069 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.971033    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-credential-socket\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.971069 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.971032    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-workload-certs\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.971165 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.971103    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-data\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.971220 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.971176    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b65df201-cbae-4aff-89a9-eaf44c6b1246-istiod-ca-cert\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.971279 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.971216    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-token\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.971770 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.971750    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b65df201-cbae-4aff-89a9-eaf44c6b1246-istiod-ca-cert\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.972982 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.972961    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-envoy\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.973120 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.973104    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-podinfo\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.978485 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.978458    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6bfw\" (UniqueName: \"kubernetes.io/projected/b65df201-cbae-4aff-89a9-eaf44c6b1246-kube-api-access-j6bfw\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:12.978682 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:12.978665    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-token\") pod \"e2e-ait-80781434-openshift-default-5948d54b8b-z85kj\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") " pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:13.032824 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:13.032800    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:13.171927 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:13.171902    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"]
Jul 29 21:34:13.174158 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:34:13.174129    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65df201_cbae_4aff_89a9_eaf44c6b1246.slice/crio-01df1c1e717de613d668ec9f4eaa3effc699b88da8806c1cd82e44c37cd072b3 WatchSource:0}: Error finding container 01df1c1e717de613d668ec9f4eaa3effc699b88da8806c1cd82e44c37cd072b3: Status 404 returned error can't find the container with id 01df1c1e717de613d668ec9f4eaa3effc699b88da8806c1cd82e44c37cd072b3
Jul 29 21:34:13.176234 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:13.176203    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:34:13.176615 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:13.176277    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:34:13.176615 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:13.176324    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:34:13.772306 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:13.772270    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj" event={"ID":"b65df201-cbae-4aff-89a9-eaf44c6b1246","Type":"ContainerStarted","Data":"3c51bc8a7b0f71d9c7f3e0bb1c12a08b1d8bf48b6e6847fed802f7507e8450bc"}
Jul 29 21:34:13.772487 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:13.772327    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj" event={"ID":"b65df201-cbae-4aff-89a9-eaf44c6b1246","Type":"ContainerStarted","Data":"01df1c1e717de613d668ec9f4eaa3effc699b88da8806c1cd82e44c37cd072b3"}
Jul 29 21:34:13.819122 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:13.816025    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj" podStartSLOduration=1.816005877 podStartE2EDuration="1.816005877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:34:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:34:13.810843359 +0000 UTC m=+1845.816366726" watchObservedRunningTime="2026-07-29 21:34:13.816005877 +0000 UTC m=+1845.821529245"
Jul 29 21:34:14.033651 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:14.033580    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:14.039755 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:14.039722    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:14.777175 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:14.777137    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:14.778091 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:14.778071    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:15.196057 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:15.196020    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:15.291125 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:15.291091    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:16.501813 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:16.501781    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:17.032066 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:17.032031    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:17.140728 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:17.140696    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:17.235892 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:17.235863    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:23.031047 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:23.030957    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:34:30.741082 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:30.741036    2575 patch_prober.go:28] interesting pod/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": read tcp 10.132.0.2:48732->10.132.0.41:15021: read: connection reset by peer" start-of-body=
Jul 29 21:34:30.741545 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:30.741105    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj" podUID="b65df201-cbae-4aff-89a9-eaf44c6b1246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": read tcp 10.132.0.2:48732->10.132.0.41:15021: read: connection reset by peer"
Jul 29 21:34:30.866473 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:30.866427    2575 generic.go:356] "Generic (PLEG): container finished" podID="b65df201-cbae-4aff-89a9-eaf44c6b1246" containerID="3c51bc8a7b0f71d9c7f3e0bb1c12a08b1d8bf48b6e6847fed802f7507e8450bc" exitCode=0
Jul 29 21:34:30.866594 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:30.866481    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj" event={"ID":"b65df201-cbae-4aff-89a9-eaf44c6b1246","Type":"ContainerDied","Data":"3c51bc8a7b0f71d9c7f3e0bb1c12a08b1d8bf48b6e6847fed802f7507e8450bc"}
Jul 29 21:34:30.866862 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:30.866847    2575 scope.go:117] "RemoveContainer" containerID="3c51bc8a7b0f71d9c7f3e0bb1c12a08b1d8bf48b6e6847fed802f7507e8450bc"
Jul 29 21:34:30.867870 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:30.867839    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:34:30.867938 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:30.867924    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:34:30.867975 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:30.867956    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:34:31.874901 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:31.874867    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj" event={"ID":"b65df201-cbae-4aff-89a9-eaf44c6b1246","Type":"ContainerStarted","Data":"0628b70edbf889a42cf482dea379dba7da44ff292bbb0d13e0ff74c9739714a3"}
Jul 29 21:34:32.033480 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:32.033427    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:32.034114 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:32.033642    2575 patch_prober.go:28] interesting pod/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 29 21:34:32.034114 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:32.033825    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj" podUID="b65df201-cbae-4aff-89a9-eaf44c6b1246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 29 21:34:33.033618 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:33.033579    2575 patch_prober.go:28] interesting pod/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 29 21:34:33.034120 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:33.033659    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj" podUID="b65df201-cbae-4aff-89a9-eaf44c6b1246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 29 21:34:34.033794 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:34.033758    2575 patch_prober.go:28] interesting pod/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 29 21:34:34.034470 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:34.034420    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj" podUID="b65df201-cbae-4aff-89a9-eaf44c6b1246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 29 21:34:35.033704 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:35.033662    2575 patch_prober.go:28] interesting pod/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 29 21:34:35.033913 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:35.033736    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj" podUID="b65df201-cbae-4aff-89a9-eaf44c6b1246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 29 21:34:36.036820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:36.036790    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:36.037229 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:36.037044    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:36.037723 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:36.037705    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:40.989911 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:40.989870    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429"]
Jul 29 21:34:40.992630 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:40.992611    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429"
Jul 29 21:34:40.995651 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:40.995630    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9wjvq\""
Jul 29 21:34:40.995772 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:40.995631    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 21:34:41.002354 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:41.002330    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429"]
Jul 29 21:34:41.137403 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:41.137363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0e7fead-8164-450a-a7c5-de8dbaff0d61-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-80781434-s6429\" (UID: \"f0e7fead-8164-450a-a7c5-de8dbaff0d61\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429"
Jul 29 21:34:41.238477 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:41.238428    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0e7fead-8164-450a-a7c5-de8dbaff0d61-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-80781434-s6429\" (UID: \"f0e7fead-8164-450a-a7c5-de8dbaff0d61\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429"
Jul 29 21:34:41.239044 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:41.239024    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0e7fead-8164-450a-a7c5-de8dbaff0d61-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-80781434-s6429\" (UID: \"f0e7fead-8164-450a-a7c5-de8dbaff0d61\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429"
Jul 29 21:34:41.303251 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:41.303221    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429"
Jul 29 21:34:41.431486 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:41.431416    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429"]
Jul 29 21:34:41.434565 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:34:41.434536    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e7fead_8164_450a_a7c5_de8dbaff0d61.slice/crio-41d79e97018d59a0a4f1b4a68dd4ab5e8115b12411a56206f92ab255fdfe1d88 WatchSource:0}: Error finding container 41d79e97018d59a0a4f1b4a68dd4ab5e8115b12411a56206f92ab255fdfe1d88: Status 404 returned error can't find the container with id 41d79e97018d59a0a4f1b4a68dd4ab5e8115b12411a56206f92ab255fdfe1d88
Jul 29 21:34:41.926072 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:41.925981    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429" event={"ID":"f0e7fead-8164-450a-a7c5-de8dbaff0d61","Type":"ContainerStarted","Data":"c95c21862deaac8bdd9932975fe6c030d49d48eca7b7bd7bb49c29418115f2c6"}
Jul 29 21:34:41.926072 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:41.926066    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429" event={"ID":"f0e7fead-8164-450a-a7c5-de8dbaff0d61","Type":"ContainerStarted","Data":"41d79e97018d59a0a4f1b4a68dd4ab5e8115b12411a56206f92ab255fdfe1d88"}
Jul 29 21:34:41.943347 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:41.943304    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429" podStartSLOduration=1.943290253 podStartE2EDuration="1.943290253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:34:41.94113715 +0000 UTC m=+1873.946660521" watchObservedRunningTime="2026-07-29 21:34:41.943290253 +0000 UTC m=+1873.948813621"
Jul 29 21:34:42.931804 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:42.931771    2575 generic.go:356] "Generic (PLEG): container finished" podID="f0e7fead-8164-450a-a7c5-de8dbaff0d61" containerID="c95c21862deaac8bdd9932975fe6c030d49d48eca7b7bd7bb49c29418115f2c6" exitCode=0
Jul 29 21:34:42.932205 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:42.931872    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429" event={"ID":"f0e7fead-8164-450a-a7c5-de8dbaff0d61","Type":"ContainerDied","Data":"c95c21862deaac8bdd9932975fe6c030d49d48eca7b7bd7bb49c29418115f2c6"}
Jul 29 21:34:44.075745 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:44.075713    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429"
Jul 29 21:34:44.167581 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:44.167552    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0e7fead-8164-450a-a7c5-de8dbaff0d61-maas-api-service-ca\") pod \"f0e7fead-8164-450a-a7c5-de8dbaff0d61\" (UID: \"f0e7fead-8164-450a-a7c5-de8dbaff0d61\") "
Jul 29 21:34:44.167906 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:44.167881    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0e7fead-8164-450a-a7c5-de8dbaff0d61-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f0e7fead-8164-450a-a7c5-de8dbaff0d61" (UID: "f0e7fead-8164-450a-a7c5-de8dbaff0d61"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:34:44.268511 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:44.268433    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0e7fead-8164-450a-a7c5-de8dbaff0d61-maas-api-service-ca\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:34:44.943709 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:44.943673    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429"
Jul 29 21:34:44.943888 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:44.943712    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429" event={"ID":"f0e7fead-8164-450a-a7c5-de8dbaff0d61","Type":"ContainerDied","Data":"41d79e97018d59a0a4f1b4a68dd4ab5e8115b12411a56206f92ab255fdfe1d88"}
Jul 29 21:34:44.943888 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:44.943775    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41d79e97018d59a0a4f1b4a68dd4ab5e8115b12411a56206f92ab255fdfe1d88"
Jul 29 21:34:46.971993 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:46.971959    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:47.067077 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:47.067044    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:47.169354 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:47.169318    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:47.246850 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:47.246766    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429"]
Jul 29 21:34:47.252413 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:47.252388    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80781434-s6429"]
Jul 29 21:34:47.308826 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:47.308792    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:47.451723 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:47.451690    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"]
Jul 29 21:34:47.451928 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:47.451905    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj" podUID="b65df201-cbae-4aff-89a9-eaf44c6b1246" containerName="istio-proxy" containerID="cri-o://0628b70edbf889a42cf482dea379dba7da44ff292bbb0d13e0ff74c9739714a3" gracePeriod=30
Jul 29 21:34:47.484176 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:47.484138    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:47.721645 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:47.721604    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:48.015037 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.014966    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:48.196482 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.196429    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:48.338619 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.338594    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:48.484341 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.484311    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0e7fead-8164-450a-a7c5-de8dbaff0d61" path="/var/lib/kubelet/pods/f0e7fead-8164-450a-a7c5-de8dbaff0d61/volumes"
Jul 29 21:34:48.595420 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.595337    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"]
Jul 29 21:34:48.595991 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.595972    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0e7fead-8164-450a-a7c5-de8dbaff0d61" containerName="revoke-keys"
Jul 29 21:34:48.596069 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.595993    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0e7fead-8164-450a-a7c5-de8dbaff0d61" containerName="revoke-keys"
Jul 29 21:34:48.596127 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.596107    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0e7fead-8164-450a-a7c5-de8dbaff0d61" containerName="revoke-keys"
Jul 29 21:34:48.598655 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.598634    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.601692 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.601668    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-f6f4f61f-gw-openshift-default-dockercfg-p4dhj\""
Jul 29 21:34:48.616714 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.616691    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"]
Jul 29 21:34:48.640062 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.640032    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:48.707226 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.707190    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istiod-ca-cert\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.707516 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.707496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-data\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.707727 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.707709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-envoy\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.707871 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.707857    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-token\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.708048 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.708032    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-podinfo\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.708185 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.708168    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-credential-socket\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.708322 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.708296    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-workload-certs\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.708502 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.708486    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gxl8\" (UniqueName: \"kubernetes.io/projected/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-kube-api-access-7gxl8\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.708634 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.708622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-workload-socket\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.809851 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.809812    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-envoy\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.809851 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.809855    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-token\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.810096 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.809918    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-podinfo\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.810096 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.809942    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-credential-socket\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.810096 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.809970    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-workload-certs\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.810096 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.810023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gxl8\" (UniqueName: \"kubernetes.io/projected/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-kube-api-access-7gxl8\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.810096 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.810047    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-workload-socket\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.810364 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.810111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istiod-ca-cert\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.810364 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.810147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-data\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.810663 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.810603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-workload-certs\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.810817 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.810683    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-workload-socket\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.810817 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.810748    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-data\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.810817 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.810793    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-credential-socket\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.811046 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.811022    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istiod-ca-cert\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.812358 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.812334    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-envoy\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.812615 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.812598    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-podinfo\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.820307 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.820282    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gxl8\" (UniqueName: \"kubernetes.io/projected/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-kube-api-access-7gxl8\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.820407 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.820305    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-token\") pod \"e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") " pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:48.909289 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:48.909234    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:49.046874 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:49.046849    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"]
Jul 29 21:34:49.049154 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:34:49.049126    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c16cc5b_73fb_4895_9f5e_b64298ee5f7a.slice/crio-5af9c739e2eea82954308ece29593db2ffa467cc663e881046f07182f1f630f1 WatchSource:0}: Error finding container 5af9c739e2eea82954308ece29593db2ffa467cc663e881046f07182f1f630f1: Status 404 returned error can't find the container with id 5af9c739e2eea82954308ece29593db2ffa467cc663e881046f07182f1f630f1
Jul 29 21:34:49.051919 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:49.051889    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:34:49.051998 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:49.051954    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:34:49.051998 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:49.051982    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:34:49.110179 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:49.110152    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:49.972951 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:49.972915    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v" event={"ID":"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a","Type":"ContainerStarted","Data":"d2b326dbd34d4fc1c05d4fa43dcbc80c3187f5c3b73589415f4402be1ecebb74"}
Jul 29 21:34:49.973116 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:49.972969    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v" event={"ID":"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a","Type":"ContainerStarted","Data":"5af9c739e2eea82954308ece29593db2ffa467cc663e881046f07182f1f630f1"}
Jul 29 21:34:50.017048 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:50.016998    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v" podStartSLOduration=2.016980613 podStartE2EDuration="2.016980613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:34:50.015690611 +0000 UTC m=+1882.021213981" watchObservedRunningTime="2026-07-29 21:34:50.016980613 +0000 UTC m=+1882.022504062"
Jul 29 21:34:50.821831 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:50.821798    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:34:50.909630 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:50.909600    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:50.914066 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:50.914038    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:50.977836 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:50.977813    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:50.978619 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:50.978598    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:34:51.039717 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:51.039684    2575 patch_prober.go:28] interesting pod/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 21:34:51.039870 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:51.039745    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj" podUID="b65df201-cbae-4aff-89a9-eaf44c6b1246" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 21:34:51.526223 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:51.526181    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:51.669722 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:51.669686    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:51.864084 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:51.864052    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:52.200213 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.200124    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:52.288287 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.288250    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:34:52.705939 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.705913    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:52.848685 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.848645    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-credential-socket\") pod \"b65df201-cbae-4aff-89a9-eaf44c6b1246\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") "
Jul 29 21:34:52.848685 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.848688    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-workload-certs\") pod \"b65df201-cbae-4aff-89a9-eaf44c6b1246\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") "
Jul 29 21:34:52.848905 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.848744    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6bfw\" (UniqueName: \"kubernetes.io/projected/b65df201-cbae-4aff-89a9-eaf44c6b1246-kube-api-access-j6bfw\") pod \"b65df201-cbae-4aff-89a9-eaf44c6b1246\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") "
Jul 29 21:34:52.848905 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.848762    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-data\") pod \"b65df201-cbae-4aff-89a9-eaf44c6b1246\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") "
Jul 29 21:34:52.848905 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.848787    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b65df201-cbae-4aff-89a9-eaf44c6b1246-istiod-ca-cert\") pod \"b65df201-cbae-4aff-89a9-eaf44c6b1246\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") "
Jul 29 21:34:52.848905 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.848821    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-envoy\") pod \"b65df201-cbae-4aff-89a9-eaf44c6b1246\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") "
Jul 29 21:34:52.848905 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.848840    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-podinfo\") pod \"b65df201-cbae-4aff-89a9-eaf44c6b1246\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") "
Jul 29 21:34:52.848905 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.848864    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-workload-socket\") pod \"b65df201-cbae-4aff-89a9-eaf44c6b1246\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") "
Jul 29 21:34:52.848905 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.848905    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-token\") pod \"b65df201-cbae-4aff-89a9-eaf44c6b1246\" (UID: \"b65df201-cbae-4aff-89a9-eaf44c6b1246\") "
Jul 29 21:34:52.849256 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.848910    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b65df201-cbae-4aff-89a9-eaf44c6b1246" (UID: "b65df201-cbae-4aff-89a9-eaf44c6b1246"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:34:52.849256 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.849133    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b65df201-cbae-4aff-89a9-eaf44c6b1246" (UID: "b65df201-cbae-4aff-89a9-eaf44c6b1246"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:34:52.849256 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.849208    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b65df201-cbae-4aff-89a9-eaf44c6b1246" (UID: "b65df201-cbae-4aff-89a9-eaf44c6b1246"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:34:52.849256 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.849218    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b65df201-cbae-4aff-89a9-eaf44c6b1246-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b65df201-cbae-4aff-89a9-eaf44c6b1246" (UID: "b65df201-cbae-4aff-89a9-eaf44c6b1246"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:34:52.849256 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.849239    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-credential-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:34:52.849256 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.849257    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-workload-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:34:52.849844 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.849822    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-data" (OuterVolumeSpecName: "istio-data") pod "b65df201-cbae-4aff-89a9-eaf44c6b1246" (UID: "b65df201-cbae-4aff-89a9-eaf44c6b1246"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:34:52.851165 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.851135    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b65df201-cbae-4aff-89a9-eaf44c6b1246" (UID: "b65df201-cbae-4aff-89a9-eaf44c6b1246"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:34:52.851266 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.851190    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-token" (OuterVolumeSpecName: "istio-token") pod "b65df201-cbae-4aff-89a9-eaf44c6b1246" (UID: "b65df201-cbae-4aff-89a9-eaf44c6b1246"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:34:52.851335 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.851318    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b65df201-cbae-4aff-89a9-eaf44c6b1246-kube-api-access-j6bfw" (OuterVolumeSpecName: "kube-api-access-j6bfw") pod "b65df201-cbae-4aff-89a9-eaf44c6b1246" (UID: "b65df201-cbae-4aff-89a9-eaf44c6b1246"). InnerVolumeSpecName "kube-api-access-j6bfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:34:52.851525 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.851505    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b65df201-cbae-4aff-89a9-eaf44c6b1246" (UID: "b65df201-cbae-4aff-89a9-eaf44c6b1246"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:34:52.950666 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.950632    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-token\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:34:52.950666 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.950664    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6bfw\" (UniqueName: \"kubernetes.io/projected/b65df201-cbae-4aff-89a9-eaf44c6b1246-kube-api-access-j6bfw\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:34:52.950666 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.950674    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-data\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:34:52.951021 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.950682    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b65df201-cbae-4aff-89a9-eaf44c6b1246-istiod-ca-cert\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:34:52.951021 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.950690    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-envoy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:34:52.951021 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.950698    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b65df201-cbae-4aff-89a9-eaf44c6b1246-istio-podinfo\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:34:52.951021 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.950705    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b65df201-cbae-4aff-89a9-eaf44c6b1246-workload-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:34:52.989737 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.989709    2575 generic.go:356] "Generic (PLEG): container finished" podID="b65df201-cbae-4aff-89a9-eaf44c6b1246" containerID="0628b70edbf889a42cf482dea379dba7da44ff292bbb0d13e0ff74c9739714a3" exitCode=0
Jul 29 21:34:52.989846 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.989766    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"
Jul 29 21:34:52.989846 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.989794    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj" event={"ID":"b65df201-cbae-4aff-89a9-eaf44c6b1246","Type":"ContainerDied","Data":"0628b70edbf889a42cf482dea379dba7da44ff292bbb0d13e0ff74c9739714a3"}
Jul 29 21:34:52.989957 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.989876    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj" event={"ID":"b65df201-cbae-4aff-89a9-eaf44c6b1246","Type":"ContainerDied","Data":"01df1c1e717de613d668ec9f4eaa3effc699b88da8806c1cd82e44c37cd072b3"}
Jul 29 21:34:52.989957 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.989901    2575 scope.go:117] "RemoveContainer" containerID="0628b70edbf889a42cf482dea379dba7da44ff292bbb0d13e0ff74c9739714a3"
Jul 29 21:34:52.999358 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:52.999340    2575 scope.go:117] "RemoveContainer" containerID="3c51bc8a7b0f71d9c7f3e0bb1c12a08b1d8bf48b6e6847fed802f7507e8450bc"
Jul 29 21:34:53.007103 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:53.007088    2575 scope.go:117] "RemoveContainer" containerID="0628b70edbf889a42cf482dea379dba7da44ff292bbb0d13e0ff74c9739714a3"
Jul 29 21:34:53.007331 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:34:53.007313    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0628b70edbf889a42cf482dea379dba7da44ff292bbb0d13e0ff74c9739714a3\": container with ID starting with 0628b70edbf889a42cf482dea379dba7da44ff292bbb0d13e0ff74c9739714a3 not found: ID does not exist" containerID="0628b70edbf889a42cf482dea379dba7da44ff292bbb0d13e0ff74c9739714a3"
Jul 29 21:34:53.007373 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:53.007339    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0628b70edbf889a42cf482dea379dba7da44ff292bbb0d13e0ff74c9739714a3"} err="failed to get container status \"0628b70edbf889a42cf482dea379dba7da44ff292bbb0d13e0ff74c9739714a3\": rpc error: code = NotFound desc = could not find container \"0628b70edbf889a42cf482dea379dba7da44ff292bbb0d13e0ff74c9739714a3\": container with ID starting with 0628b70edbf889a42cf482dea379dba7da44ff292bbb0d13e0ff74c9739714a3 not found: ID does not exist"
Jul 29 21:34:53.007373 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:53.007354    2575 scope.go:117] "RemoveContainer" containerID="3c51bc8a7b0f71d9c7f3e0bb1c12a08b1d8bf48b6e6847fed802f7507e8450bc"
Jul 29 21:34:53.007606 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:34:53.007588    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c51bc8a7b0f71d9c7f3e0bb1c12a08b1d8bf48b6e6847fed802f7507e8450bc\": container with ID starting with 3c51bc8a7b0f71d9c7f3e0bb1c12a08b1d8bf48b6e6847fed802f7507e8450bc not found: ID does not exist" containerID="3c51bc8a7b0f71d9c7f3e0bb1c12a08b1d8bf48b6e6847fed802f7507e8450bc"
Jul 29 21:34:53.007663 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:53.007610    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c51bc8a7b0f71d9c7f3e0bb1c12a08b1d8bf48b6e6847fed802f7507e8450bc"} err="failed to get container status \"3c51bc8a7b0f71d9c7f3e0bb1c12a08b1d8bf48b6e6847fed802f7507e8450bc\": rpc error: code = NotFound desc = could not find container \"3c51bc8a7b0f71d9c7f3e0bb1c12a08b1d8bf48b6e6847fed802f7507e8450bc\": container with ID starting with 3c51bc8a7b0f71d9c7f3e0bb1c12a08b1d8bf48b6e6847fed802f7507e8450bc not found: ID does not exist"
Jul 29 21:34:53.014335 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:53.014314    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"]
Jul 29 21:34:53.017561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:53.017544    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-80781434-openshift-default-5948d54b8b-z85kj"]
Jul 29 21:34:54.483389 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:34:54.483353    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b65df201-cbae-4aff-89a9-eaf44c6b1246" path="/var/lib/kubelet/pods/b65df201-cbae-4aff-89a9-eaf44c6b1246/volumes"
Jul 29 21:35:00.821354 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:00.821316    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:35:05.056281 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:05.056247    2575 generic.go:356] "Generic (PLEG): container finished" podID="9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" containerID="d2b326dbd34d4fc1c05d4fa43dcbc80c3187f5c3b73589415f4402be1ecebb74" exitCode=0
Jul 29 21:35:05.056281 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:05.056284    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v" event={"ID":"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a","Type":"ContainerDied","Data":"d2b326dbd34d4fc1c05d4fa43dcbc80c3187f5c3b73589415f4402be1ecebb74"}
Jul 29 21:35:05.056748 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:05.056633    2575 scope.go:117] "RemoveContainer" containerID="d2b326dbd34d4fc1c05d4fa43dcbc80c3187f5c3b73589415f4402be1ecebb74"
Jul 29 21:35:05.057600 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:05.057573    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:35:05.057658 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:05.057651    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:35:05.057694 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:05.057680    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:35:05.978803 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:05.978763    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:35:06.064226 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:06.064192    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v" event={"ID":"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a","Type":"ContainerStarted","Data":"0da292592b9c3e59fd4772345cfd8a7c72c972a196e2de8d32793ae83a8154db"}
Jul 29 21:35:06.909721 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:06.909687    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:35:06.910408 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:06.910384    2575 patch_prober.go:28] interesting pod/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 29 21:35:06.910477 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:06.910433    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v" podUID="9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 29 21:35:07.910165 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:07.910129    2575 patch_prober.go:28] interesting pod/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 29 21:35:07.910553 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:07.910185    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v" podUID="9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 29 21:35:08.909571 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:08.909539    2575 patch_prober.go:28] interesting pod/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 29 21:35:08.909738 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:08.909588    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v" podUID="9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 29 21:35:09.909859 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:09.909823    2575 patch_prober.go:28] interesting pod/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 29 21:35:09.910313 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:09.909882    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v" podUID="9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 29 21:35:10.913365 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:10.913335    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:35:10.913756 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:10.913706    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:35:10.914405 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:10.914384    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:35:16.610830 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:16.610796    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7"]
Jul 29 21:35:16.611176 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:16.611166    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65df201-cbae-4aff-89a9-eaf44c6b1246" containerName="istio-proxy"
Jul 29 21:35:16.611216 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:16.611177    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65df201-cbae-4aff-89a9-eaf44c6b1246" containerName="istio-proxy"
Jul 29 21:35:16.611260 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:16.611250    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65df201-cbae-4aff-89a9-eaf44c6b1246" containerName="istio-proxy"
Jul 29 21:35:16.611300 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:16.611263    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65df201-cbae-4aff-89a9-eaf44c6b1246" containerName="istio-proxy"
Jul 29 21:35:16.614260 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:16.614245    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7"
Jul 29 21:35:16.616944 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:16.616921    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9wjvq\""
Jul 29 21:35:16.616944 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:16.616931    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 21:35:16.622573 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:16.622552    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7"]
Jul 29 21:35:16.655203 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:16.655177    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/495a954f-dfd4-4093-9bd9-a6307bf1b6c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7\" (UID: \"495a954f-dfd4-4093-9bd9-a6307bf1b6c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7"
Jul 29 21:35:16.756484 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:16.756441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/495a954f-dfd4-4093-9bd9-a6307bf1b6c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7\" (UID: \"495a954f-dfd4-4093-9bd9-a6307bf1b6c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7"
Jul 29 21:35:16.757029 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:16.757010    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/495a954f-dfd4-4093-9bd9-a6307bf1b6c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7\" (UID: \"495a954f-dfd4-4093-9bd9-a6307bf1b6c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7"
Jul 29 21:35:16.926410 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:16.926352    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7"
Jul 29 21:35:17.062393 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:17.062371    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7"]
Jul 29 21:35:17.064111 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:35:17.064081    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495a954f_dfd4_4093_9bd9_a6307bf1b6c1.slice/crio-c86e3de4bf40759ad84cabb49c8a674fad39c621627d80f6920656c9606c6423 WatchSource:0}: Error finding container c86e3de4bf40759ad84cabb49c8a674fad39c621627d80f6920656c9606c6423: Status 404 returned error can't find the container with id c86e3de4bf40759ad84cabb49c8a674fad39c621627d80f6920656c9606c6423
Jul 29 21:35:17.122976 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:17.122932    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7" event={"ID":"495a954f-dfd4-4093-9bd9-a6307bf1b6c1","Type":"ContainerStarted","Data":"c86e3de4bf40759ad84cabb49c8a674fad39c621627d80f6920656c9606c6423"}
Jul 29 21:35:18.128848 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:18.128820    2575 generic.go:356] "Generic (PLEG): container finished" podID="495a954f-dfd4-4093-9bd9-a6307bf1b6c1" containerID="0b96653a2525c1e8fbc9e0b7b2ee91c0255c5ed929da3c2c79a3b3e87719b3bd" exitCode=0
Jul 29 21:35:18.129216 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:18.128887    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7" event={"ID":"495a954f-dfd4-4093-9bd9-a6307bf1b6c1","Type":"ContainerDied","Data":"0b96653a2525c1e8fbc9e0b7b2ee91c0255c5ed929da3c2c79a3b3e87719b3bd"}
Jul 29 21:35:19.260317 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:19.260292    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7"
Jul 29 21:35:19.378520 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:19.378496    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/495a954f-dfd4-4093-9bd9-a6307bf1b6c1-maas-api-service-ca\") pod \"495a954f-dfd4-4093-9bd9-a6307bf1b6c1\" (UID: \"495a954f-dfd4-4093-9bd9-a6307bf1b6c1\") "
Jul 29 21:35:19.378810 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:19.378789    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/495a954f-dfd4-4093-9bd9-a6307bf1b6c1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "495a954f-dfd4-4093-9bd9-a6307bf1b6c1" (UID: "495a954f-dfd4-4093-9bd9-a6307bf1b6c1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:35:19.479549 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:19.479494    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/495a954f-dfd4-4093-9bd9-a6307bf1b6c1-maas-api-service-ca\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:35:20.140587 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:20.140557    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7"
Jul 29 21:35:20.140587 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:20.140581    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7" event={"ID":"495a954f-dfd4-4093-9bd9-a6307bf1b6c1","Type":"ContainerDied","Data":"c86e3de4bf40759ad84cabb49c8a674fad39c621627d80f6920656c9606c6423"}
Jul 29 21:35:20.140796 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:20.140631    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c86e3de4bf40759ad84cabb49c8a674fad39c621627d80f6920656c9606c6423"
Jul 29 21:35:22.978493 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:22.978401    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:23.052603 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:23.052552    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:23.122013 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:23.121972    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:23.191425 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:23.191387    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7"]
Jul 29 21:35:23.193483 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:23.193454    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:23.193676 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:23.193656    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f6f4f61f-c6fq7"]
Jul 29 21:35:23.347582 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:23.347551    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"]
Jul 29 21:35:23.347830 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:23.347805    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v" podUID="9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" containerName="istio-proxy" containerID="cri-o://0da292592b9c3e59fd4772345cfd8a7c72c972a196e2de8d32793ae83a8154db" gracePeriod=30
Jul 29 21:35:23.383196 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:23.383157    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:23.602640 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:23.602556    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:23.858079 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:23.858000    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:24.209412 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.209337    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"]
Jul 29 21:35:24.209812 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.209797    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65df201-cbae-4aff-89a9-eaf44c6b1246" containerName="istio-proxy"
Jul 29 21:35:24.209862 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.209813    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65df201-cbae-4aff-89a9-eaf44c6b1246" containerName="istio-proxy"
Jul 29 21:35:24.209862 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.209837    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="495a954f-dfd4-4093-9bd9-a6307bf1b6c1" containerName="revoke-keys"
Jul 29 21:35:24.209862 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.209843    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="495a954f-dfd4-4093-9bd9-a6307bf1b6c1" containerName="revoke-keys"
Jul 29 21:35:24.209953 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.209907    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="495a954f-dfd4-4093-9bd9-a6307bf1b6c1" containerName="revoke-keys"
Jul 29 21:35:24.213215 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.213192    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.217686 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.217667    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0d8fc281-openshift-default-dockercfg-n9mqz\""
Jul 29 21:35:24.232405 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.232384    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"]
Jul 29 21:35:24.239636 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.239610    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:24.321093 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.321067    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-credential-socket\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.321205 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.321098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5cba660-4cbb-427a-977b-239a33c765a7-istio-token\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.321205 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.321168    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-istio-data\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.321205 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.321186    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-workload-certs\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.321342 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.321223    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5cba660-4cbb-427a-977b-239a33c765a7-istiod-ca-cert\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.321342 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.321253    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-workload-socket\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.321342 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.321275    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpj7x\" (UniqueName: \"kubernetes.io/projected/c5cba660-4cbb-427a-977b-239a33c765a7-kube-api-access-cpj7x\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.321479 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.321347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-istio-envoy\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.321479 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.321378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5cba660-4cbb-427a-977b-239a33c765a7-istio-podinfo\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.337647 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.337620    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:24.422066 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.422032    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-istio-envoy\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.422066 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.422067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5cba660-4cbb-427a-977b-239a33c765a7-istio-podinfo\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.422298 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.422090    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-credential-socket\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.422298 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.422111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5cba660-4cbb-427a-977b-239a33c765a7-istio-token\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.422298 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.422187    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-istio-data\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.422298 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.422216    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-workload-certs\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.422298 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.422255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5cba660-4cbb-427a-977b-239a33c765a7-istiod-ca-cert\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.422298 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.422296    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-workload-socket\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.422627 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.422337    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpj7x\" (UniqueName: \"kubernetes.io/projected/c5cba660-4cbb-427a-977b-239a33c765a7-kube-api-access-cpj7x\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.422681 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.422627    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-istio-data\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.422681 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.422632    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-credential-socket\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.422783 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.422724    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-workload-certs\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.422783 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.422738    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-workload-socket\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.422992 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.422968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5cba660-4cbb-427a-977b-239a33c765a7-istiod-ca-cert\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.424552 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.424531    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-istio-envoy\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.424841 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.424823    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5cba660-4cbb-427a-977b-239a33c765a7-istio-podinfo\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.431026 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.431004    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5cba660-4cbb-427a-977b-239a33c765a7-istio-token\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.431191 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.431174    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpj7x\" (UniqueName: \"kubernetes.io/projected/c5cba660-4cbb-427a-977b-239a33c765a7-kube-api-access-cpj7x\") pod \"e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") " pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.483181 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.483125    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="495a954f-dfd4-4093-9bd9-a6307bf1b6c1" path="/var/lib/kubelet/pods/495a954f-dfd4-4093-9bd9-a6307bf1b6c1/volumes"
Jul 29 21:35:24.523606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.523584    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:24.660990 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.660952    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"]
Jul 29 21:35:24.662825 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:35:24.662794    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5cba660_4cbb_427a_977b_239a33c765a7.slice/crio-7495a89db13d5e09b1be58d7264439e576a0ca5af99690dda3c79061773982b1 WatchSource:0}: Error finding container 7495a89db13d5e09b1be58d7264439e576a0ca5af99690dda3c79061773982b1: Status 404 returned error can't find the container with id 7495a89db13d5e09b1be58d7264439e576a0ca5af99690dda3c79061773982b1
Jul 29 21:35:24.664898 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.664864    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:35:24.665015 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.664938    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:35:24.665015 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:24.664993    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:35:25.166257 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:25.166225    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt" event={"ID":"c5cba660-4cbb-427a-977b-239a33c765a7","Type":"ContainerStarted","Data":"3527eef52fcb4c8c5aa2b1444b0f3301e64b6a7c7c77047f03c54b38dd8264d9"}
Jul 29 21:35:25.166425 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:25.166284    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt" event={"ID":"c5cba660-4cbb-427a-977b-239a33c765a7","Type":"ContainerStarted","Data":"7495a89db13d5e09b1be58d7264439e576a0ca5af99690dda3c79061773982b1"}
Jul 29 21:35:25.189815 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:25.189759    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt" podStartSLOduration=1.18974497 podStartE2EDuration="1.18974497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:35:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:35:25.187308573 +0000 UTC m=+1917.192831973" watchObservedRunningTime="2026-07-29 21:35:25.18974497 +0000 UTC m=+1917.195268334"
Jul 29 21:35:25.524288 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:25.524223    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:25.529189 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:25.529166    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:25.915820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:25.915769    2575 patch_prober.go:28] interesting pod/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 21:35:25.915974 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:25.915851    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v" podUID="9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 21:35:26.171798 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:26.171703    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:26.172731 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:26.172711    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:26.540673 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:26.540638    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:26.864151 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:26.864067    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:27.216208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:27.216129    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:35:27.675114 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:27.675080    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:28.301734 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.301703    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:28.399414 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.399388    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:28.491258 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.491227    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:28.605181 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.605153    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:35:28.764159 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.764130    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gxl8\" (UniqueName: \"kubernetes.io/projected/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-kube-api-access-7gxl8\") pod \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") "
Jul 29 21:35:28.764613 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.764172    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-envoy\") pod \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") "
Jul 29 21:35:28.764613 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.764208    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-token\") pod \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") "
Jul 29 21:35:28.764613 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.764224    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-podinfo\") pod \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") "
Jul 29 21:35:28.764613 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.764247    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-credential-socket\") pod \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") "
Jul 29 21:35:28.764613 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.764308    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-data\") pod \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") "
Jul 29 21:35:28.764613 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.764331    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-workload-socket\") pod \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") "
Jul 29 21:35:28.764613 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.764359    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istiod-ca-cert\") pod \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") "
Jul 29 21:35:28.764613 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.764437    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-workload-certs\") pod \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\" (UID: \"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a\") "
Jul 29 21:35:28.765051 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.764686    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" (UID: "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:35:28.765051 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.764765    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" (UID: "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:35:28.765051 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.764834    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-credential-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:35:28.765051 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.764918    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" (UID: "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:35:28.765293 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.765079    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" (UID: "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:35:28.765293 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.765227    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-data" (OuterVolumeSpecName: "istio-data") pod "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" (UID: "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:35:28.766637 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.766613    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-token" (OuterVolumeSpecName: "istio-token") pod "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" (UID: "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:35:28.766734 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.766646    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-kube-api-access-7gxl8" (OuterVolumeSpecName: "kube-api-access-7gxl8") pod "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" (UID: "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a"). InnerVolumeSpecName "kube-api-access-7gxl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:35:28.766867 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.766847    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" (UID: "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:35:28.766959 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.766940    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" (UID: "9c16cc5b-73fb-4895-9f5e-b64298ee5f7a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:35:28.865878 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.865826    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-workload-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:35:28.865878 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.865848    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gxl8\" (UniqueName: \"kubernetes.io/projected/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-kube-api-access-7gxl8\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:35:28.865878 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.865862    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-envoy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:35:28.865878 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.865874    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-token\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:35:28.865878 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.865881    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-podinfo\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:35:28.866092 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.865890    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istio-data\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:35:28.866092 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.865897    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-workload-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:35:28.866092 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:28.865904    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a-istiod-ca-cert\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:35:29.187230 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:29.187162    2575 generic.go:356] "Generic (PLEG): container finished" podID="9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" containerID="0da292592b9c3e59fd4772345cfd8a7c72c972a196e2de8d32793ae83a8154db" exitCode=0
Jul 29 21:35:29.187230 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:29.187209    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"
Jul 29 21:35:29.187392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:29.187247    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v" event={"ID":"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a","Type":"ContainerDied","Data":"0da292592b9c3e59fd4772345cfd8a7c72c972a196e2de8d32793ae83a8154db"}
Jul 29 21:35:29.187392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:29.187301    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v" event={"ID":"9c16cc5b-73fb-4895-9f5e-b64298ee5f7a","Type":"ContainerDied","Data":"5af9c739e2eea82954308ece29593db2ffa467cc663e881046f07182f1f630f1"}
Jul 29 21:35:29.187392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:29.187330    2575 scope.go:117] "RemoveContainer" containerID="0da292592b9c3e59fd4772345cfd8a7c72c972a196e2de8d32793ae83a8154db"
Jul 29 21:35:29.196926 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:29.196909    2575 scope.go:117] "RemoveContainer" containerID="d2b326dbd34d4fc1c05d4fa43dcbc80c3187f5c3b73589415f4402be1ecebb74"
Jul 29 21:35:29.204742 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:29.204726    2575 scope.go:117] "RemoveContainer" containerID="0da292592b9c3e59fd4772345cfd8a7c72c972a196e2de8d32793ae83a8154db"
Jul 29 21:35:29.204974 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:35:29.204957    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0da292592b9c3e59fd4772345cfd8a7c72c972a196e2de8d32793ae83a8154db\": container with ID starting with 0da292592b9c3e59fd4772345cfd8a7c72c972a196e2de8d32793ae83a8154db not found: ID does not exist" containerID="0da292592b9c3e59fd4772345cfd8a7c72c972a196e2de8d32793ae83a8154db"
Jul 29 21:35:29.205035 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:29.204981    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0da292592b9c3e59fd4772345cfd8a7c72c972a196e2de8d32793ae83a8154db"} err="failed to get container status \"0da292592b9c3e59fd4772345cfd8a7c72c972a196e2de8d32793ae83a8154db\": rpc error: code = NotFound desc = could not find container \"0da292592b9c3e59fd4772345cfd8a7c72c972a196e2de8d32793ae83a8154db\": container with ID starting with 0da292592b9c3e59fd4772345cfd8a7c72c972a196e2de8d32793ae83a8154db not found: ID does not exist"
Jul 29 21:35:29.205035 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:29.204997    2575 scope.go:117] "RemoveContainer" containerID="d2b326dbd34d4fc1c05d4fa43dcbc80c3187f5c3b73589415f4402be1ecebb74"
Jul 29 21:35:29.205219 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:35:29.205204    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2b326dbd34d4fc1c05d4fa43dcbc80c3187f5c3b73589415f4402be1ecebb74\": container with ID starting with d2b326dbd34d4fc1c05d4fa43dcbc80c3187f5c3b73589415f4402be1ecebb74 not found: ID does not exist" containerID="d2b326dbd34d4fc1c05d4fa43dcbc80c3187f5c3b73589415f4402be1ecebb74"
Jul 29 21:35:29.205264 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:29.205223    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b326dbd34d4fc1c05d4fa43dcbc80c3187f5c3b73589415f4402be1ecebb74"} err="failed to get container status \"d2b326dbd34d4fc1c05d4fa43dcbc80c3187f5c3b73589415f4402be1ecebb74\": rpc error: code = NotFound desc = could not find container \"d2b326dbd34d4fc1c05d4fa43dcbc80c3187f5c3b73589415f4402be1ecebb74\": container with ID starting with d2b326dbd34d4fc1c05d4fa43dcbc80c3187f5c3b73589415f4402be1ecebb74 not found: ID does not exist"
Jul 29 21:35:29.213786 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:29.211512    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"]
Jul 29 21:35:29.217881 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:29.217861    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-f6f4f61f-gw-openshift-default-dcbd98b8-xlw4v"]
Jul 29 21:35:30.482041 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:30.482007    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" path="/var/lib/kubelet/pods/9c16cc5b-73fb-4895-9f5e-b64298ee5f7a/volumes"
Jul 29 21:35:38.330289 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:38.330253    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:35:41.483850 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:41.483296    2575 patch_prober.go:28] interesting pod/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": read tcp 10.132.0.2:46828->10.132.0.45:15021: read: connection reset by peer" start-of-body=
Jul 29 21:35:41.483850 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:41.483376    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt" podUID="c5cba660-4cbb-427a-977b-239a33c765a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": read tcp 10.132.0.2:46828->10.132.0.45:15021: read: connection reset by peer"
Jul 29 21:35:42.256705 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:42.256668    2575 generic.go:356] "Generic (PLEG): container finished" podID="c5cba660-4cbb-427a-977b-239a33c765a7" containerID="3527eef52fcb4c8c5aa2b1444b0f3301e64b6a7c7c77047f03c54b38dd8264d9" exitCode=0
Jul 29 21:35:42.256889 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:42.256744    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt" event={"ID":"c5cba660-4cbb-427a-977b-239a33c765a7","Type":"ContainerDied","Data":"3527eef52fcb4c8c5aa2b1444b0f3301e64b6a7c7c77047f03c54b38dd8264d9"}
Jul 29 21:35:42.257167 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:42.257153    2575 scope.go:117] "RemoveContainer" containerID="3527eef52fcb4c8c5aa2b1444b0f3301e64b6a7c7c77047f03c54b38dd8264d9"
Jul 29 21:35:42.258158 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:42.258132    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:35:42.258273 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:42.258212    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:35:42.258273 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:42.258262    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:35:43.264239 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:43.264207    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt" event={"ID":"c5cba660-4cbb-427a-977b-239a33c765a7","Type":"ContainerStarted","Data":"16a8494e81420bb2e3a08ffb17dd682d45532d09ce034f5e6766f5f59dabacbb"}
Jul 29 21:35:43.524796 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:43.524697    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:43.524950 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:43.524923    2575 patch_prober.go:28] interesting pod/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 29 21:35:43.525000 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:43.524974    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt" podUID="c5cba660-4cbb-427a-977b-239a33c765a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 29 21:35:44.524458 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:44.524404    2575 patch_prober.go:28] interesting pod/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 29 21:35:44.524838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:44.524479    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt" podUID="c5cba660-4cbb-427a-977b-239a33c765a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 29 21:35:45.524768 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:45.524726    2575 patch_prober.go:28] interesting pod/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 29 21:35:45.525242 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:45.524788    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt" podUID="c5cba660-4cbb-427a-977b-239a33c765a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 29 21:35:46.523892 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:46.523857    2575 patch_prober.go:28] interesting pod/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 29 21:35:46.524103 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:46.523910    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt" podUID="c5cba660-4cbb-427a-977b-239a33c765a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 29 21:35:47.527643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:47.527608    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:47.528053 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:47.527891    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:47.528572 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:47.528553    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:35:52.585749 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:52.585712    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp"]
Jul 29 21:35:52.586265 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:52.586246    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" containerName="istio-proxy"
Jul 29 21:35:52.586341 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:52.586268    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" containerName="istio-proxy"
Jul 29 21:35:52.586341 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:52.586291    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" containerName="istio-proxy"
Jul 29 21:35:52.586341 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:52.586301    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" containerName="istio-proxy"
Jul 29 21:35:52.586502 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:52.586393    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" containerName="istio-proxy"
Jul 29 21:35:52.589760 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:52.589744    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp"
Jul 29 21:35:52.592421 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:52.592398    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 21:35:52.592560 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:52.592398    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9wjvq\""
Jul 29 21:35:52.596069 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:52.596049    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp"]
Jul 29 21:35:52.682812 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:52.682783    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02ee8b16-c573-427c-ad82-3dd93288d74e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp\" (UID: \"02ee8b16-c573-427c-ad82-3dd93288d74e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp"
Jul 29 21:35:52.784138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:52.784108    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02ee8b16-c573-427c-ad82-3dd93288d74e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp\" (UID: \"02ee8b16-c573-427c-ad82-3dd93288d74e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp"
Jul 29 21:35:52.784738 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:52.784719    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02ee8b16-c573-427c-ad82-3dd93288d74e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp\" (UID: \"02ee8b16-c573-427c-ad82-3dd93288d74e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp"
Jul 29 21:35:52.901577 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:52.901508    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp"
Jul 29 21:35:53.030414 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:53.030386    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp"]
Jul 29 21:35:53.031970 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:35:53.031941    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ee8b16_c573_427c_ad82_3dd93288d74e.slice/crio-c38ce8d81adf392c01246e7eb04b8c6140346b698957de4ac87fc73bba2c6f6d WatchSource:0}: Error finding container c38ce8d81adf392c01246e7eb04b8c6140346b698957de4ac87fc73bba2c6f6d: Status 404 returned error can't find the container with id c38ce8d81adf392c01246e7eb04b8c6140346b698957de4ac87fc73bba2c6f6d
Jul 29 21:35:53.314358 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:53.314324    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp" event={"ID":"02ee8b16-c573-427c-ad82-3dd93288d74e","Type":"ContainerStarted","Data":"c38ce8d81adf392c01246e7eb04b8c6140346b698957de4ac87fc73bba2c6f6d"}
Jul 29 21:35:54.320884 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:54.320852    2575 generic.go:356] "Generic (PLEG): container finished" podID="02ee8b16-c573-427c-ad82-3dd93288d74e" containerID="f22bc0789ba9429491fecf0eb47c94dadaaac1fb916d4617a808baa6e39521ef" exitCode=0
Jul 29 21:35:54.321272 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:54.320894    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp" event={"ID":"02ee8b16-c573-427c-ad82-3dd93288d74e","Type":"ContainerDied","Data":"f22bc0789ba9429491fecf0eb47c94dadaaac1fb916d4617a808baa6e39521ef"}
Jul 29 21:35:55.458535 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:55.458509    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp"
Jul 29 21:35:55.508641 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:55.508612    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02ee8b16-c573-427c-ad82-3dd93288d74e-maas-api-service-ca\") pod \"02ee8b16-c573-427c-ad82-3dd93288d74e\" (UID: \"02ee8b16-c573-427c-ad82-3dd93288d74e\") "
Jul 29 21:35:55.508986 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:55.508959    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02ee8b16-c573-427c-ad82-3dd93288d74e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "02ee8b16-c573-427c-ad82-3dd93288d74e" (UID: "02ee8b16-c573-427c-ad82-3dd93288d74e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:35:55.509195 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:55.509172    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02ee8b16-c573-427c-ad82-3dd93288d74e-maas-api-service-ca\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:35:56.331522 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:56.331496    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp"
Jul 29 21:35:56.331769 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:56.331487    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp" event={"ID":"02ee8b16-c573-427c-ad82-3dd93288d74e","Type":"ContainerDied","Data":"c38ce8d81adf392c01246e7eb04b8c6140346b698957de4ac87fc73bba2c6f6d"}
Jul 29 21:35:56.331769 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:56.331622    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c38ce8d81adf392c01246e7eb04b8c6140346b698957de4ac87fc73bba2c6f6d"
Jul 29 21:35:58.258723 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:58.258691    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:58.434696 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:58.434660    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp"]
Jul 29 21:35:58.437265 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:58.437234    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d8fc281-7tjjp"]
Jul 29 21:35:58.484420 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:58.484386    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02ee8b16-c573-427c-ad82-3dd93288d74e" path="/var/lib/kubelet/pods/02ee8b16-c573-427c-ad82-3dd93288d74e/volumes"
Jul 29 21:35:59.361436 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:59.361397    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:59.642579 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:59.642504    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"]
Jul 29 21:35:59.642725 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:59.642704    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt" podUID="c5cba660-4cbb-427a-977b-239a33c765a7" containerName="istio-proxy" containerID="cri-o://16a8494e81420bb2e3a08ffb17dd682d45532d09ce034f5e6766f5f59dabacbb" gracePeriod=30
Jul 29 21:35:59.666811 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:59.666786    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:35:59.913351 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:35:59.913255    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:00.155487 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.155437    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:00.446433 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.446399    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"]
Jul 29 21:36:00.446869 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.446853    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02ee8b16-c573-427c-ad82-3dd93288d74e" containerName="revoke-keys"
Jul 29 21:36:00.446914 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.446871    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="02ee8b16-c573-427c-ad82-3dd93288d74e" containerName="revoke-keys"
Jul 29 21:36:00.446982 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.446973    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c16cc5b-73fb-4895-9f5e-b64298ee5f7a" containerName="istio-proxy"
Jul 29 21:36:00.447021 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.446988    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="02ee8b16-c573-427c-ad82-3dd93288d74e" containerName="revoke-keys"
Jul 29 21:36:00.450192 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.450176    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.453907 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.453883    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-592dab8c-openshift-default-dockercfg-46llq\""
Jul 29 21:36:00.469595 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.469570    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"]
Jul 29 21:36:00.479428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.479398    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:00.558298 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.558261    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-workload-socket\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.558520 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.558311    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ec76c82-111d-4984-bdac-d73fe340aff8-istiod-ca-cert\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.558520 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.558468    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-data\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.558660 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.558531    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z9b9\" (UniqueName: \"kubernetes.io/projected/2ec76c82-111d-4984-bdac-d73fe340aff8-kube-api-access-9z9b9\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.558660 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.558576    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-envoy\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.558660 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.558650    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-credential-socket\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.558804 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.558680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-workload-certs\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.558804 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.558740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-podinfo\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.558804 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.558765    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-token\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.660143 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.660104    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ec76c82-111d-4984-bdac-d73fe340aff8-istiod-ca-cert\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.660311 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.660168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-data\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.660311 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.660202    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z9b9\" (UniqueName: \"kubernetes.io/projected/2ec76c82-111d-4984-bdac-d73fe340aff8-kube-api-access-9z9b9\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.660311 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.660238    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-envoy\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.660311 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.660283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-credential-socket\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.660311 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.660310    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-workload-certs\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.660611 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.660342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-podinfo\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.660611 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.660370    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-token\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.660611 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.660440    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-workload-socket\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.660769 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.660622    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-data\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.660917 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.660883    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ec76c82-111d-4984-bdac-d73fe340aff8-istiod-ca-cert\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.661114 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.661090    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-workload-certs\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.661240 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.661129    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-credential-socket\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.661240 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.661186    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-workload-socket\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.662617 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.662593    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-envoy\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.662883 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.662865    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-podinfo\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.669271 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.669248    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-token\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.669984 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.669964    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z9b9\" (UniqueName: \"kubernetes.io/projected/2ec76c82-111d-4984-bdac-d73fe340aff8-kube-api-access-9z9b9\") pod \"e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") " pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.761418 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.761353    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:00.902909 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.902884    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"]
Jul 29 21:36:00.905707 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:36:00.905671    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec76c82_111d_4984_bdac_d73fe340aff8.slice/crio-fdd82a483bb4ddb2a549c0111d3e085a314d9f8f256d5cbcc0263d3965945ead WatchSource:0}: Error finding container fdd82a483bb4ddb2a549c0111d3e085a314d9f8f256d5cbcc0263d3965945ead: Status 404 returned error can't find the container with id fdd82a483bb4ddb2a549c0111d3e085a314d9f8f256d5cbcc0263d3965945ead
Jul 29 21:36:00.907940 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.907907    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:36:00.908035 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.907970    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:36:00.908035 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.907997    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:36:00.980918 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:00.980892    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:01.359808 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:01.359770    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr" event={"ID":"2ec76c82-111d-4984-bdac-d73fe340aff8","Type":"ContainerStarted","Data":"84432bf19dee7181923877fafc590ee300c3530fb9fc70b9e9604e095a830839"}
Jul 29 21:36:01.359948 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:01.359827    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr" event={"ID":"2ec76c82-111d-4984-bdac-d73fe340aff8","Type":"ContainerStarted","Data":"fdd82a483bb4ddb2a549c0111d3e085a314d9f8f256d5cbcc0263d3965945ead"}
Jul 29 21:36:01.383207 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:01.383161    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr" podStartSLOduration=1.383146321 podStartE2EDuration="1.383146321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:36:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:36:01.380812853 +0000 UTC m=+1953.386336221" watchObservedRunningTime="2026-07-29 21:36:01.383146321 +0000 UTC m=+1953.388669688"
Jul 29 21:36:01.761741 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:01.761666    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:01.766152 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:01.766126    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:02.365106 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:02.365076    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:02.365943 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:02.365923    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:02.417714 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:02.417683    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:36:02.530311 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:02.530281    2575 patch_prober.go:28] interesting pod/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 21:36:02.530494 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:02.530332    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt" podUID="c5cba660-4cbb-427a-977b-239a33c765a7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 21:36:02.822818 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:02.822787    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:02.919910 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:02.919882    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:03.946542 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:03.946501    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:04.449196 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:04.449167    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:04.545015 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:04.544979    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:04.639517 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:04.639482    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:04.902968 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:04.902945    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:36:05.001640 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.001606    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-workload-socket\") pod \"c5cba660-4cbb-427a-977b-239a33c765a7\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") "
Jul 29 21:36:05.002023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.001661    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-istio-envoy\") pod \"c5cba660-4cbb-427a-977b-239a33c765a7\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") "
Jul 29 21:36:05.002023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.001706    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5cba660-4cbb-427a-977b-239a33c765a7-istio-podinfo\") pod \"c5cba660-4cbb-427a-977b-239a33c765a7\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") "
Jul 29 21:36:05.002023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.001731    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-istio-data\") pod \"c5cba660-4cbb-427a-977b-239a33c765a7\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") "
Jul 29 21:36:05.002023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.001754    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-workload-certs\") pod \"c5cba660-4cbb-427a-977b-239a33c765a7\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") "
Jul 29 21:36:05.002023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.001785    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5cba660-4cbb-427a-977b-239a33c765a7-istiod-ca-cert\") pod \"c5cba660-4cbb-427a-977b-239a33c765a7\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") "
Jul 29 21:36:05.002023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.001814    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-credential-socket\") pod \"c5cba660-4cbb-427a-977b-239a33c765a7\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") "
Jul 29 21:36:05.002023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.001876    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpj7x\" (UniqueName: \"kubernetes.io/projected/c5cba660-4cbb-427a-977b-239a33c765a7-kube-api-access-cpj7x\") pod \"c5cba660-4cbb-427a-977b-239a33c765a7\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") "
Jul 29 21:36:05.002023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.001878    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c5cba660-4cbb-427a-977b-239a33c765a7" (UID: "c5cba660-4cbb-427a-977b-239a33c765a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:36:05.002023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.001918    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5cba660-4cbb-427a-977b-239a33c765a7-istio-token\") pod \"c5cba660-4cbb-427a-977b-239a33c765a7\" (UID: \"c5cba660-4cbb-427a-977b-239a33c765a7\") "
Jul 29 21:36:05.002536 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.002046    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c5cba660-4cbb-427a-977b-239a33c765a7" (UID: "c5cba660-4cbb-427a-977b-239a33c765a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:36:05.002536 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.002163    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c5cba660-4cbb-427a-977b-239a33c765a7" (UID: "c5cba660-4cbb-427a-977b-239a33c765a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:36:05.002536 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.002327    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-workload-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:05.002536 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.002346    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-workload-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:05.002536 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.002359    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-credential-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:05.002751 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.002571    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5cba660-4cbb-427a-977b-239a33c765a7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c5cba660-4cbb-427a-977b-239a33c765a7" (UID: "c5cba660-4cbb-427a-977b-239a33c765a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:36:05.002840 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.002817    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-istio-data" (OuterVolumeSpecName: "istio-data") pod "c5cba660-4cbb-427a-977b-239a33c765a7" (UID: "c5cba660-4cbb-427a-977b-239a33c765a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:36:05.004037 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.004016    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5cba660-4cbb-427a-977b-239a33c765a7-kube-api-access-cpj7x" (OuterVolumeSpecName: "kube-api-access-cpj7x") pod "c5cba660-4cbb-427a-977b-239a33c765a7" (UID: "c5cba660-4cbb-427a-977b-239a33c765a7"). InnerVolumeSpecName "kube-api-access-cpj7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:36:05.004124 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.004104    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c5cba660-4cbb-427a-977b-239a33c765a7" (UID: "c5cba660-4cbb-427a-977b-239a33c765a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:36:05.004310 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.004284    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c5cba660-4cbb-427a-977b-239a33c765a7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c5cba660-4cbb-427a-977b-239a33c765a7" (UID: "c5cba660-4cbb-427a-977b-239a33c765a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:36:05.004310 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.004293    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5cba660-4cbb-427a-977b-239a33c765a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "c5cba660-4cbb-427a-977b-239a33c765a7" (UID: "c5cba660-4cbb-427a-977b-239a33c765a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:36:05.102963 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.102930    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpj7x\" (UniqueName: \"kubernetes.io/projected/c5cba660-4cbb-427a-977b-239a33c765a7-kube-api-access-cpj7x\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:05.102963 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.102960    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5cba660-4cbb-427a-977b-239a33c765a7-istio-token\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:05.102963 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.102969    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-istio-envoy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:05.103184 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.102976    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5cba660-4cbb-427a-977b-239a33c765a7-istio-podinfo\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:05.103184 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.102984    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5cba660-4cbb-427a-977b-239a33c765a7-istio-data\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:05.103184 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.102991    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5cba660-4cbb-427a-977b-239a33c765a7-istiod-ca-cert\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:05.382687 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.382610    2575 generic.go:356] "Generic (PLEG): container finished" podID="c5cba660-4cbb-427a-977b-239a33c765a7" containerID="16a8494e81420bb2e3a08ffb17dd682d45532d09ce034f5e6766f5f59dabacbb" exitCode=0
Jul 29 21:36:05.382687 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.382673    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"
Jul 29 21:36:05.382866 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.382693    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt" event={"ID":"c5cba660-4cbb-427a-977b-239a33c765a7","Type":"ContainerDied","Data":"16a8494e81420bb2e3a08ffb17dd682d45532d09ce034f5e6766f5f59dabacbb"}
Jul 29 21:36:05.382866 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.382754    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt" event={"ID":"c5cba660-4cbb-427a-977b-239a33c765a7","Type":"ContainerDied","Data":"7495a89db13d5e09b1be58d7264439e576a0ca5af99690dda3c79061773982b1"}
Jul 29 21:36:05.382866 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.382777    2575 scope.go:117] "RemoveContainer" containerID="16a8494e81420bb2e3a08ffb17dd682d45532d09ce034f5e6766f5f59dabacbb"
Jul 29 21:36:05.392279 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.392261    2575 scope.go:117] "RemoveContainer" containerID="3527eef52fcb4c8c5aa2b1444b0f3301e64b6a7c7c77047f03c54b38dd8264d9"
Jul 29 21:36:05.400124 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.400107    2575 scope.go:117] "RemoveContainer" containerID="16a8494e81420bb2e3a08ffb17dd682d45532d09ce034f5e6766f5f59dabacbb"
Jul 29 21:36:05.400371 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:36:05.400350    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16a8494e81420bb2e3a08ffb17dd682d45532d09ce034f5e6766f5f59dabacbb\": container with ID starting with 16a8494e81420bb2e3a08ffb17dd682d45532d09ce034f5e6766f5f59dabacbb not found: ID does not exist" containerID="16a8494e81420bb2e3a08ffb17dd682d45532d09ce034f5e6766f5f59dabacbb"
Jul 29 21:36:05.400421 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.400380    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a8494e81420bb2e3a08ffb17dd682d45532d09ce034f5e6766f5f59dabacbb"} err="failed to get container status \"16a8494e81420bb2e3a08ffb17dd682d45532d09ce034f5e6766f5f59dabacbb\": rpc error: code = NotFound desc = could not find container \"16a8494e81420bb2e3a08ffb17dd682d45532d09ce034f5e6766f5f59dabacbb\": container with ID starting with 16a8494e81420bb2e3a08ffb17dd682d45532d09ce034f5e6766f5f59dabacbb not found: ID does not exist"
Jul 29 21:36:05.400421 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.400396    2575 scope.go:117] "RemoveContainer" containerID="3527eef52fcb4c8c5aa2b1444b0f3301e64b6a7c7c77047f03c54b38dd8264d9"
Jul 29 21:36:05.400687 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:36:05.400668    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3527eef52fcb4c8c5aa2b1444b0f3301e64b6a7c7c77047f03c54b38dd8264d9\": container with ID starting with 3527eef52fcb4c8c5aa2b1444b0f3301e64b6a7c7c77047f03c54b38dd8264d9 not found: ID does not exist" containerID="3527eef52fcb4c8c5aa2b1444b0f3301e64b6a7c7c77047f03c54b38dd8264d9"
Jul 29 21:36:05.400752 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.400696    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3527eef52fcb4c8c5aa2b1444b0f3301e64b6a7c7c77047f03c54b38dd8264d9"} err="failed to get container status \"3527eef52fcb4c8c5aa2b1444b0f3301e64b6a7c7c77047f03c54b38dd8264d9\": rpc error: code = NotFound desc = could not find container \"3527eef52fcb4c8c5aa2b1444b0f3301e64b6a7c7c77047f03c54b38dd8264d9\": container with ID starting with 3527eef52fcb4c8c5aa2b1444b0f3301e64b6a7c7c77047f03c54b38dd8264d9 not found: ID does not exist"
Jul 29 21:36:05.406397 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.406370    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"]
Jul 29 21:36:05.410505 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:05.410483    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0d8fc281-openshift-default-c96544784-qqwtt"]
Jul 29 21:36:06.482355 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:06.482322    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5cba660-4cbb-427a-977b-239a33c765a7" path="/var/lib/kubelet/pods/c5cba660-4cbb-427a-977b-239a33c765a7/volumes"
Jul 29 21:36:13.016629 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:13.016589    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:36:17.366344 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:17.366306    2575 patch_prober.go:28] interesting pod/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 29 21:36:17.366764 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:17.366372    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr" podUID="2ec76c82-111d-4984-bdac-d73fe340aff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 29 21:36:17.456569 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:17.456535    2575 generic.go:356] "Generic (PLEG): container finished" podID="2ec76c82-111d-4984-bdac-d73fe340aff8" containerID="84432bf19dee7181923877fafc590ee300c3530fb9fc70b9e9604e095a830839" exitCode=0
Jul 29 21:36:17.456739 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:17.456596    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr" event={"ID":"2ec76c82-111d-4984-bdac-d73fe340aff8","Type":"ContainerDied","Data":"84432bf19dee7181923877fafc590ee300c3530fb9fc70b9e9604e095a830839"}
Jul 29 21:36:17.457005 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:17.456990    2575 scope.go:117] "RemoveContainer" containerID="84432bf19dee7181923877fafc590ee300c3530fb9fc70b9e9604e095a830839"
Jul 29 21:36:17.458107 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:17.458077    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:36:17.458184 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:17.458143    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:36:17.458184 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:17.458172    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:36:18.463783 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:18.463739    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr" event={"ID":"2ec76c82-111d-4984-bdac-d73fe340aff8","Type":"ContainerStarted","Data":"743e12ee131d34efaa72e11d1682ed7202e62276b32916e7fd2fdab26f4d0792"}
Jul 29 21:36:18.761670 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:18.761571    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:18.761867 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:18.761847    2575 patch_prober.go:28] interesting pod/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 29 21:36:18.761957 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:18.761898    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr" podUID="2ec76c82-111d-4984-bdac-d73fe340aff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 29 21:36:19.762134 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:19.762095    2575 patch_prober.go:28] interesting pod/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 29 21:36:19.762625 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:19.762171    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr" podUID="2ec76c82-111d-4984-bdac-d73fe340aff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 29 21:36:20.761818 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:20.761729    2575 patch_prober.go:28] interesting pod/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 29 21:36:20.761818 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:20.761787    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr" podUID="2ec76c82-111d-4984-bdac-d73fe340aff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 29 21:36:21.762178 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:21.762139    2575 patch_prober.go:28] interesting pod/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 29 21:36:21.762598 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:21.762199    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr" podUID="2ec76c82-111d-4984-bdac-d73fe340aff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 29 21:36:22.765461 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:22.765412    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:22.765845 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:22.765782    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:22.766477 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:22.766439    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:27.713367 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:27.713333    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48"]
Jul 29 21:36:27.713759 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:27.713743    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5cba660-4cbb-427a-977b-239a33c765a7" containerName="istio-proxy"
Jul 29 21:36:27.713759 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:27.713756    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5cba660-4cbb-427a-977b-239a33c765a7" containerName="istio-proxy"
Jul 29 21:36:27.713847 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:27.713768    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5cba660-4cbb-427a-977b-239a33c765a7" containerName="istio-proxy"
Jul 29 21:36:27.713847 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:27.713774    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5cba660-4cbb-427a-977b-239a33c765a7" containerName="istio-proxy"
Jul 29 21:36:27.713847 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:27.713834    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5cba660-4cbb-427a-977b-239a33c765a7" containerName="istio-proxy"
Jul 29 21:36:27.717251 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:27.717234    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48"
Jul 29 21:36:27.720010 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:27.719988    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 21:36:27.720122 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:27.720025    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9wjvq\""
Jul 29 21:36:27.724256 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:27.724227    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48"]
Jul 29 21:36:27.815715 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:27.815685    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aba3c2a-5427-4df0-8207-9ee3b1596f38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-592dab8c-ksv48\" (UID: \"0aba3c2a-5427-4df0-8207-9ee3b1596f38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48"
Jul 29 21:36:27.916457 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:27.916417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aba3c2a-5427-4df0-8207-9ee3b1596f38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-592dab8c-ksv48\" (UID: \"0aba3c2a-5427-4df0-8207-9ee3b1596f38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48"
Jul 29 21:36:27.917158 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:27.917136    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aba3c2a-5427-4df0-8207-9ee3b1596f38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-592dab8c-ksv48\" (UID: \"0aba3c2a-5427-4df0-8207-9ee3b1596f38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48"
Jul 29 21:36:28.028782 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:28.028712    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48"
Jul 29 21:36:28.160748 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:28.160721    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48"]
Jul 29 21:36:28.162726 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:36:28.162696    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aba3c2a_5427_4df0_8207_9ee3b1596f38.slice/crio-4aca57547b2d38642b2793c698a5fd32b80afb6258ab9e8df70f7a9a85d88d45 WatchSource:0}: Error finding container 4aca57547b2d38642b2793c698a5fd32b80afb6258ab9e8df70f7a9a85d88d45: Status 404 returned error can't find the container with id 4aca57547b2d38642b2793c698a5fd32b80afb6258ab9e8df70f7a9a85d88d45
Jul 29 21:36:28.515497 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:28.515461    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48" event={"ID":"0aba3c2a-5427-4df0-8207-9ee3b1596f38","Type":"ContainerStarted","Data":"22ccaf326b8eac29fadce0bdeeff87daa23ff0bdc6cce45b3a4957f60fed0a85"}
Jul 29 21:36:28.515666 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:28.515510    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48" event={"ID":"0aba3c2a-5427-4df0-8207-9ee3b1596f38","Type":"ContainerStarted","Data":"4aca57547b2d38642b2793c698a5fd32b80afb6258ab9e8df70f7a9a85d88d45"}
Jul 29 21:36:28.530911 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:28.530859    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48" podStartSLOduration=1.5308407229999998 podStartE2EDuration="1.530840723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:36:28.530406843 +0000 UTC m=+1980.535930212" watchObservedRunningTime="2026-07-29 21:36:28.530840723 +0000 UTC m=+1980.536364091"
Jul 29 21:36:29.521637 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:29.521604    2575 generic.go:356] "Generic (PLEG): container finished" podID="0aba3c2a-5427-4df0-8207-9ee3b1596f38" containerID="22ccaf326b8eac29fadce0bdeeff87daa23ff0bdc6cce45b3a4957f60fed0a85" exitCode=0
Jul 29 21:36:29.522015 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:29.521682    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48" event={"ID":"0aba3c2a-5427-4df0-8207-9ee3b1596f38","Type":"ContainerDied","Data":"22ccaf326b8eac29fadce0bdeeff87daa23ff0bdc6cce45b3a4957f60fed0a85"}
Jul 29 21:36:30.663968 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:30.663939    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48"
Jul 29 21:36:30.740437 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:30.740408    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aba3c2a-5427-4df0-8207-9ee3b1596f38-maas-api-service-ca\") pod \"0aba3c2a-5427-4df0-8207-9ee3b1596f38\" (UID: \"0aba3c2a-5427-4df0-8207-9ee3b1596f38\") "
Jul 29 21:36:30.740798 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:30.740765    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aba3c2a-5427-4df0-8207-9ee3b1596f38-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0aba3c2a-5427-4df0-8207-9ee3b1596f38" (UID: "0aba3c2a-5427-4df0-8207-9ee3b1596f38"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:36:30.842133 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:30.842111    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aba3c2a-5427-4df0-8207-9ee3b1596f38-maas-api-service-ca\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:31.532441 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:31.532405    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48" event={"ID":"0aba3c2a-5427-4df0-8207-9ee3b1596f38","Type":"ContainerDied","Data":"4aca57547b2d38642b2793c698a5fd32b80afb6258ab9e8df70f7a9a85d88d45"}
Jul 29 21:36:31.532441 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:31.532434    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48"
Jul 29 21:36:31.532653 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:31.532476    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4aca57547b2d38642b2793c698a5fd32b80afb6258ab9e8df70f7a9a85d88d45"
Jul 29 21:36:34.572661 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:34.572616    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:34.643519 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:34.643470    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:34.710514 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:34.710479    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:34.751152 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:34.751120    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48"]
Jul 29 21:36:34.753674 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:34.753651    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-592dab8c-ksv48"]
Jul 29 21:36:34.810629 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:34.810599    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:34.891738 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:34.891651    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"]
Jul 29 21:36:34.891943 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:34.891919    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr" podUID="2ec76c82-111d-4984-bdac-d73fe340aff8" containerName="istio-proxy" containerID="cri-o://743e12ee131d34efaa72e11d1682ed7202e62276b32916e7fd2fdab26f4d0792" gracePeriod=30
Jul 29 21:36:34.919091 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:34.919028    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:35.189180 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:35.189102    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:35.695575 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:35.695543    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:35.786250 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:35.786220    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:35.886985 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:35.886951    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:36.425167 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:36.425121    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:36:36.483888 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:36.483856    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aba3c2a-5427-4df0-8207-9ee3b1596f38" path="/var/lib/kubelet/pods/0aba3c2a-5427-4df0-8207-9ee3b1596f38/volumes"
Jul 29 21:36:36.873632 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:36.873595    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:36.975901 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:36.975864    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:37.403898 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:37.403866    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:37.768392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:37.768322    2575 patch_prober.go:28] interesting pod/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 21:36:37.768392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:37.768380    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr" podUID="2ec76c82-111d-4984-bdac-d73fe340aff8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 21:36:40.067410 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.067386    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:40.079336 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.079299    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:40.128169 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.128134    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ec76c82-111d-4984-bdac-d73fe340aff8-istiod-ca-cert\") pod \"2ec76c82-111d-4984-bdac-d73fe340aff8\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") "
Jul 29 21:36:40.128169 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.128172    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-envoy\") pod \"2ec76c82-111d-4984-bdac-d73fe340aff8\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") "
Jul 29 21:36:40.128401 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.128213    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-data\") pod \"2ec76c82-111d-4984-bdac-d73fe340aff8\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") "
Jul 29 21:36:40.128401 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.128308    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z9b9\" (UniqueName: \"kubernetes.io/projected/2ec76c82-111d-4984-bdac-d73fe340aff8-kube-api-access-9z9b9\") pod \"2ec76c82-111d-4984-bdac-d73fe340aff8\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") "
Jul 29 21:36:40.128401 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.128341    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-workload-certs\") pod \"2ec76c82-111d-4984-bdac-d73fe340aff8\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") "
Jul 29 21:36:40.128401 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.128377    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-token\") pod \"2ec76c82-111d-4984-bdac-d73fe340aff8\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") "
Jul 29 21:36:40.128635 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.128429    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-workload-socket\") pod \"2ec76c82-111d-4984-bdac-d73fe340aff8\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") "
Jul 29 21:36:40.128635 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.128493    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-credential-socket\") pod \"2ec76c82-111d-4984-bdac-d73fe340aff8\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") "
Jul 29 21:36:40.128635 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.128522    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-podinfo\") pod \"2ec76c82-111d-4984-bdac-d73fe340aff8\" (UID: \"2ec76c82-111d-4984-bdac-d73fe340aff8\") "
Jul 29 21:36:40.128785 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.128665    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ec76c82-111d-4984-bdac-d73fe340aff8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2ec76c82-111d-4984-bdac-d73fe340aff8" (UID: "2ec76c82-111d-4984-bdac-d73fe340aff8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:36:40.128785 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.128652    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2ec76c82-111d-4984-bdac-d73fe340aff8" (UID: "2ec76c82-111d-4984-bdac-d73fe340aff8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:36:40.128785 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.128726    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2ec76c82-111d-4984-bdac-d73fe340aff8" (UID: "2ec76c82-111d-4984-bdac-d73fe340aff8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:36:40.128945 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.128903    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2ec76c82-111d-4984-bdac-d73fe340aff8" (UID: "2ec76c82-111d-4984-bdac-d73fe340aff8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:36:40.129004 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.128963    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-workload-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:40.129004 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.128983    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-workload-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:40.129004 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.128995    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ec76c82-111d-4984-bdac-d73fe340aff8-istiod-ca-cert\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:40.129312 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.129281    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-data" (OuterVolumeSpecName: "istio-data") pod "2ec76c82-111d-4984-bdac-d73fe340aff8" (UID: "2ec76c82-111d-4984-bdac-d73fe340aff8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:36:40.130435 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.130413    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2ec76c82-111d-4984-bdac-d73fe340aff8" (UID: "2ec76c82-111d-4984-bdac-d73fe340aff8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:36:40.130685 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.130667    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec76c82-111d-4984-bdac-d73fe340aff8-kube-api-access-9z9b9" (OuterVolumeSpecName: "kube-api-access-9z9b9") pod "2ec76c82-111d-4984-bdac-d73fe340aff8" (UID: "2ec76c82-111d-4984-bdac-d73fe340aff8"). InnerVolumeSpecName "kube-api-access-9z9b9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:36:40.130782 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.130767    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2ec76c82-111d-4984-bdac-d73fe340aff8" (UID: "2ec76c82-111d-4984-bdac-d73fe340aff8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:36:40.130854 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.130839    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-token" (OuterVolumeSpecName: "istio-token") pod "2ec76c82-111d-4984-bdac-d73fe340aff8" (UID: "2ec76c82-111d-4984-bdac-d73fe340aff8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:36:40.144595 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.144560    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:40.229652 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.229576    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-credential-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:40.229652 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.229602    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-podinfo\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:40.229652 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.229613    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-envoy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:40.229652 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.229621    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-data\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:40.229652 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.229629    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z9b9\" (UniqueName: \"kubernetes.io/projected/2ec76c82-111d-4984-bdac-d73fe340aff8-kube-api-access-9z9b9\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:40.229652 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.229637    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ec76c82-111d-4984-bdac-d73fe340aff8-istio-token\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:36:40.581907 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.581877    2575 generic.go:356] "Generic (PLEG): container finished" podID="2ec76c82-111d-4984-bdac-d73fe340aff8" containerID="743e12ee131d34efaa72e11d1682ed7202e62276b32916e7fd2fdab26f4d0792" exitCode=0
Jul 29 21:36:40.582084 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.581924    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr" event={"ID":"2ec76c82-111d-4984-bdac-d73fe340aff8","Type":"ContainerDied","Data":"743e12ee131d34efaa72e11d1682ed7202e62276b32916e7fd2fdab26f4d0792"}
Jul 29 21:36:40.582084 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.581986    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr" event={"ID":"2ec76c82-111d-4984-bdac-d73fe340aff8","Type":"ContainerDied","Data":"fdd82a483bb4ddb2a549c0111d3e085a314d9f8f256d5cbcc0263d3965945ead"}
Jul 29 21:36:40.582084 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.581924    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"
Jul 29 21:36:40.582084 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.582009    2575 scope.go:117] "RemoveContainer" containerID="743e12ee131d34efaa72e11d1682ed7202e62276b32916e7fd2fdab26f4d0792"
Jul 29 21:36:40.591324 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.591303    2575 scope.go:117] "RemoveContainer" containerID="84432bf19dee7181923877fafc590ee300c3530fb9fc70b9e9604e095a830839"
Jul 29 21:36:40.599704 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.599674    2575 scope.go:117] "RemoveContainer" containerID="743e12ee131d34efaa72e11d1682ed7202e62276b32916e7fd2fdab26f4d0792"
Jul 29 21:36:40.600065 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:36:40.600038    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"743e12ee131d34efaa72e11d1682ed7202e62276b32916e7fd2fdab26f4d0792\": container with ID starting with 743e12ee131d34efaa72e11d1682ed7202e62276b32916e7fd2fdab26f4d0792 not found: ID does not exist" containerID="743e12ee131d34efaa72e11d1682ed7202e62276b32916e7fd2fdab26f4d0792"
Jul 29 21:36:40.600144 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.600076    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743e12ee131d34efaa72e11d1682ed7202e62276b32916e7fd2fdab26f4d0792"} err="failed to get container status \"743e12ee131d34efaa72e11d1682ed7202e62276b32916e7fd2fdab26f4d0792\": rpc error: code = NotFound desc = could not find container \"743e12ee131d34efaa72e11d1682ed7202e62276b32916e7fd2fdab26f4d0792\": container with ID starting with 743e12ee131d34efaa72e11d1682ed7202e62276b32916e7fd2fdab26f4d0792 not found: ID does not exist"
Jul 29 21:36:40.600144 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.600101    2575 scope.go:117] "RemoveContainer" containerID="84432bf19dee7181923877fafc590ee300c3530fb9fc70b9e9604e095a830839"
Jul 29 21:36:40.600419 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:36:40.600398    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84432bf19dee7181923877fafc590ee300c3530fb9fc70b9e9604e095a830839\": container with ID starting with 84432bf19dee7181923877fafc590ee300c3530fb9fc70b9e9604e095a830839 not found: ID does not exist" containerID="84432bf19dee7181923877fafc590ee300c3530fb9fc70b9e9604e095a830839"
Jul 29 21:36:40.600505 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.600425    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84432bf19dee7181923877fafc590ee300c3530fb9fc70b9e9604e095a830839"} err="failed to get container status \"84432bf19dee7181923877fafc590ee300c3530fb9fc70b9e9604e095a830839\": rpc error: code = NotFound desc = could not find container \"84432bf19dee7181923877fafc590ee300c3530fb9fc70b9e9604e095a830839\": container with ID starting with 84432bf19dee7181923877fafc590ee300c3530fb9fc70b9e9604e095a830839 not found: ID does not exist"
Jul 29 21:36:40.601891 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.601872    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"]
Jul 29 21:36:40.605711 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:40.605688    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-592dab8c-openshift-default-7447b8dc44-n9tpr"]
Jul 29 21:36:42.483232 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:42.483187    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ec76c82-111d-4984-bdac-d73fe340aff8" path="/var/lib/kubelet/pods/2ec76c82-111d-4984-bdac-d73fe340aff8/volumes"
Jul 29 21:36:43.419662 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:43.419624    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:43.519345 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:43.519307    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:43.619312 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:43.619280    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:43.738295 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:43.738210    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:36:44.254375 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:36:44.254340    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:37:00.981682 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:37:00.981644    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:37:10.505066 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:37:10.505028    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:37:16.641538 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:37:16.641504    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:37:16.747272 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:37:16.747240    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:37:16.842189 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:37:16.842157    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:37:32.805994 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:37:32.805958    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:37:38.675543 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:37:38.675507    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:37:38.787270 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:37:38.787238    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:37:38.894921 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:37:38.894885    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:37:49.509168 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:37:49.509136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:37:50.402935 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:37:50.402851    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:37:57.002319 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:37:57.002281    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:37:57.118239 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:37:57.118200    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:37:57.202548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:37:57.202512    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:37:57.318367 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:37:57.318339    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:01.028676 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:01.028638    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:38:02.573049 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:02.573014    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:02.667576 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:02.667539    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:02.769490 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:02.769436    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:04.638904 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:04.638867    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:10.323598 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:10.323562    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:38:10.542188 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:10.542151    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:10.642929 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:10.642834    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:11.252079 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:11.252046    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:17.131827 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.131791    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:17.229436 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.229392    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:17.328929 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.328896    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:17.626351 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.626312    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"]
Jul 29 21:38:17.626767 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.626752    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec76c82-111d-4984-bdac-d73fe340aff8" containerName="istio-proxy"
Jul 29 21:38:17.626767 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.626768    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec76c82-111d-4984-bdac-d73fe340aff8" containerName="istio-proxy"
Jul 29 21:38:17.626890 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.626782    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aba3c2a-5427-4df0-8207-9ee3b1596f38" containerName="revoke-keys"
Jul 29 21:38:17.626890 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.626788    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aba3c2a-5427-4df0-8207-9ee3b1596f38" containerName="revoke-keys"
Jul 29 21:38:17.626890 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.626812    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec76c82-111d-4984-bdac-d73fe340aff8" containerName="istio-proxy"
Jul 29 21:38:17.626890 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.626821    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec76c82-111d-4984-bdac-d73fe340aff8" containerName="istio-proxy"
Jul 29 21:38:17.626890 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.626881    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aba3c2a-5427-4df0-8207-9ee3b1596f38" containerName="revoke-keys"
Jul 29 21:38:17.627134 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.626893    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5cba660-4cbb-427a-977b-239a33c765a7" containerName="istio-proxy"
Jul 29 21:38:17.627134 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.626905    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ec76c82-111d-4984-bdac-d73fe340aff8" containerName="istio-proxy"
Jul 29 21:38:17.627134 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.626912    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ec76c82-111d-4984-bdac-d73fe340aff8" containerName="istio-proxy"
Jul 29 21:38:17.630077 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.630058    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.633118 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.633092    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-095b8200-openshift-default-dockercfg-5g7vj\""
Jul 29 21:38:17.654042 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.654020    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"]
Jul 29 21:38:17.663160 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.663132    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:17.717523 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.717484    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-workload-socket\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.717832 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.717802    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-token\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.717999 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.717969    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-data\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.718134 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.718010    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-workload-certs\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.718134 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.718043    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istiod-ca-cert\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.718134 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.718072    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-credential-socket\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.718308 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.718138    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr2zv\" (UniqueName: \"kubernetes.io/projected/9cb5dd4c-5259-424c-a696-83e3cd2673b3-kube-api-access-hr2zv\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.718308 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.718190    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-podinfo\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.718308 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.718242    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-envoy\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.819806 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.819769    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-podinfo\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.819980 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.819826    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-envoy\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.819980 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.819866    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-workload-socket\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.819980 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.819898    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-token\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.820210 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.820055    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-data\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.820210 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.820117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-workload-certs\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.820210 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.820150    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istiod-ca-cert\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.820210 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.820180    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-credential-socket\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.820428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.820250    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr2zv\" (UniqueName: \"kubernetes.io/projected/9cb5dd4c-5259-424c-a696-83e3cd2673b3-kube-api-access-hr2zv\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.820428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.820344    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-workload-socket\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.820428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.820412    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-workload-certs\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.820614 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.820499    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-data\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.820661 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.820638    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-credential-socket\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.820903 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.820884    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istiod-ca-cert\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.822368 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.822348    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-podinfo\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.822462 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.822343    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-envoy\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.839541 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.839512    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-token\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.840325 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.840304    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr2zv\" (UniqueName: \"kubernetes.io/projected/9cb5dd4c-5259-424c-a696-83e3cd2673b3-kube-api-access-hr2zv\") pod \"e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") " pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:17.845947 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.845920    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:17.941497 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:17.941388    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:18.078289 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:18.078260    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"]
Jul 29 21:38:18.079776 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:38:18.079744    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb5dd4c_5259_424c_a696_83e3cd2673b3.slice/crio-86f8947414cc86320cf45250eb01b4918ad59e50355b6d5a71005e0675f25b29 WatchSource:0}: Error finding container 86f8947414cc86320cf45250eb01b4918ad59e50355b6d5a71005e0675f25b29: Status 404 returned error can't find the container with id 86f8947414cc86320cf45250eb01b4918ad59e50355b6d5a71005e0675f25b29
Jul 29 21:38:18.081781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:18.081751    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:38:18.081874 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:18.081810    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:38:18.081874 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:18.081835    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:38:19.087526 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:19.087487    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc" event={"ID":"9cb5dd4c-5259-424c-a696-83e3cd2673b3","Type":"ContainerStarted","Data":"2008d2a8e7b0d1105c9c4c6337da156df3387c74776d3ff3b751b919320088ab"}
Jul 29 21:38:19.087928 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:19.087546    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc" event={"ID":"9cb5dd4c-5259-424c-a696-83e3cd2673b3","Type":"ContainerStarted","Data":"86f8947414cc86320cf45250eb01b4918ad59e50355b6d5a71005e0675f25b29"}
Jul 29 21:38:19.110812 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:19.110763    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc" podStartSLOduration=2.110748387 podStartE2EDuration="2.110748387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:38:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:38:19.109165065 +0000 UTC m=+2091.114688470" watchObservedRunningTime="2026-07-29 21:38:19.110748387 +0000 UTC m=+2091.116271755"
Jul 29 21:38:19.942086 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:19.942044    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:19.946861 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:19.946835    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:20.092752 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:20.092716    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:20.093778 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:20.093756    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:20.320090 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:20.320046    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:38:21.155873 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:21.155839    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:21.273305 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:21.273272    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:22.361608 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:22.361574    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:22.921897 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:22.921860    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:23.087220 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:23.087178    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:23.184377 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:23.184341    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:32.224826 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:32.224793    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:38:35.525079 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:35.523688    2575 patch_prober.go:28] interesting pod/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": read tcp 10.132.0.2:57220->10.132.0.49:15021: read: connection reset by peer" start-of-body=
Jul 29 21:38:35.525079 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:35.523780    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc" podUID="9cb5dd4c-5259-424c-a696-83e3cd2673b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": read tcp 10.132.0.2:57220->10.132.0.49:15021: read: connection reset by peer"
Jul 29 21:38:36.189920 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:36.189883    2575 generic.go:356] "Generic (PLEG): container finished" podID="9cb5dd4c-5259-424c-a696-83e3cd2673b3" containerID="2008d2a8e7b0d1105c9c4c6337da156df3387c74776d3ff3b751b919320088ab" exitCode=0
Jul 29 21:38:36.190097 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:36.189959    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc" event={"ID":"9cb5dd4c-5259-424c-a696-83e3cd2673b3","Type":"ContainerDied","Data":"2008d2a8e7b0d1105c9c4c6337da156df3387c74776d3ff3b751b919320088ab"}
Jul 29 21:38:36.190399 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:36.190382    2575 scope.go:117] "RemoveContainer" containerID="2008d2a8e7b0d1105c9c4c6337da156df3387c74776d3ff3b751b919320088ab"
Jul 29 21:38:36.191373 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:36.191346    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:38:36.191490 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:36.191411    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:38:36.191490 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:36.191465    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:38:37.196750 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:37.196709    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc" event={"ID":"9cb5dd4c-5259-424c-a696-83e3cd2673b3","Type":"ContainerStarted","Data":"df94a5b8fc4e28e5a4fbaa7c768dc46766b8aceb827ab112a61f6d4b353a15c8"}
Jul 29 21:38:37.942269 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:37.942227    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:37.942628 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:37.942349    2575 patch_prober.go:28] interesting pod/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 29 21:38:37.942854 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:37.942828    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc" podUID="9cb5dd4c-5259-424c-a696-83e3cd2673b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 29 21:38:38.942032 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:38.941992    2575 patch_prober.go:28] interesting pod/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 29 21:38:38.942703 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:38.942668    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc" podUID="9cb5dd4c-5259-424c-a696-83e3cd2673b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 29 21:38:39.942372 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:39.942336    2575 patch_prober.go:28] interesting pod/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 29 21:38:39.942943 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:39.942916    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc" podUID="9cb5dd4c-5259-424c-a696-83e3cd2673b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 29 21:38:40.942755 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:40.942716    2575 patch_prober.go:28] interesting pod/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 29 21:38:40.943160 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:40.942772    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc" podUID="9cb5dd4c-5259-424c-a696-83e3cd2673b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 29 21:38:41.945871 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:41.945838    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:41.946237 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:41.946113    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:41.946819 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:41.946802    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:38:47.273534 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:47.273499    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:47.979981 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:47.979947    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:48.070262 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:48.070218    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:48.445747 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:48.445711    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:54.232155 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:54.232118    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:54.332826 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:54.332792    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:38:54.634084 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:54.634047    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-095b8200-wkpkm"]
Jul 29 21:38:54.637800 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:54.637781    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-095b8200-wkpkm"
Jul 29 21:38:54.640520 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:54.640500    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9wjvq\""
Jul 29 21:38:54.640520 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:54.640515    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 21:38:54.645198 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:54.645174    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-095b8200-wkpkm"]
Jul 29 21:38:54.769758 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:54.769728    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b208f44-7aa3-4984-8f55-074dd0360270-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-095b8200-wkpkm\" (UID: \"8b208f44-7aa3-4984-8f55-074dd0360270\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-095b8200-wkpkm"
Jul 29 21:38:54.870849 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:54.870811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b208f44-7aa3-4984-8f55-074dd0360270-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-095b8200-wkpkm\" (UID: \"8b208f44-7aa3-4984-8f55-074dd0360270\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-095b8200-wkpkm"
Jul 29 21:38:54.871432 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:54.871410    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b208f44-7aa3-4984-8f55-074dd0360270-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-095b8200-wkpkm\" (UID: \"8b208f44-7aa3-4984-8f55-074dd0360270\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-095b8200-wkpkm"
Jul 29 21:38:54.950216 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:54.950150    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-095b8200-wkpkm"
Jul 29 21:38:55.080393 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:55.080367    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-095b8200-wkpkm"]
Jul 29 21:38:55.082237 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:38:55.082203    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b208f44_7aa3_4984_8f55_074dd0360270.slice/crio-2fdfe37603eb294b749377494a10bd4b9f03fec6381b9140c5a574ce2d3df699 WatchSource:0}: Error finding container 2fdfe37603eb294b749377494a10bd4b9f03fec6381b9140c5a574ce2d3df699: Status 404 returned error can't find the container with id 2fdfe37603eb294b749377494a10bd4b9f03fec6381b9140c5a574ce2d3df699
Jul 29 21:38:55.292377 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:55.292345    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-095b8200-wkpkm" event={"ID":"8b208f44-7aa3-4984-8f55-074dd0360270","Type":"ContainerStarted","Data":"2fdfe37603eb294b749377494a10bd4b9f03fec6381b9140c5a574ce2d3df699"}
Jul 29 21:38:56.299406 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:56.299374    2575 generic.go:356] "Generic (PLEG): container finished" podID="8b208f44-7aa3-4984-8f55-074dd0360270" containerID="91c08d8314d828b245e296bc1591c6e135b4a128404151d2a1427f9f7bb127b9" exitCode=0
Jul 29 21:38:56.299803 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:56.299470    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-095b8200-wkpkm" event={"ID":"8b208f44-7aa3-4984-8f55-074dd0360270","Type":"ContainerDied","Data":"91c08d8314d828b245e296bc1591c6e135b4a128404151d2a1427f9f7bb127b9"}
Jul 29 21:38:57.443718 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:57.443696    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-095b8200-wkpkm"
Jul 29 21:38:57.493416 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:57.493388    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b208f44-7aa3-4984-8f55-074dd0360270-maas-api-service-ca\") pod \"8b208f44-7aa3-4984-8f55-074dd0360270\" (UID: \"8b208f44-7aa3-4984-8f55-074dd0360270\") "
Jul 29 21:38:57.493772 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:57.493743    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b208f44-7aa3-4984-8f55-074dd0360270-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8b208f44-7aa3-4984-8f55-074dd0360270" (UID: "8b208f44-7aa3-4984-8f55-074dd0360270"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:38:57.594913 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:57.594852    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b208f44-7aa3-4984-8f55-074dd0360270-maas-api-service-ca\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:38:58.311285 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:58.311246    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-095b8200-wkpkm"
Jul 29 21:38:58.311488 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:58.311287    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-095b8200-wkpkm" event={"ID":"8b208f44-7aa3-4984-8f55-074dd0360270","Type":"ContainerDied","Data":"2fdfe37603eb294b749377494a10bd4b9f03fec6381b9140c5a574ce2d3df699"}
Jul 29 21:38:58.311488 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:38:58.311346    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2fdfe37603eb294b749377494a10bd4b9f03fec6381b9140c5a574ce2d3df699"
Jul 29 21:39:05.137747 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:05.137703    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:05.256675 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:05.256632    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:05.358854 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:05.358821    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-095b8200-wkpkm"]
Jul 29 21:39:05.363018 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:05.362992    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-095b8200-wkpkm"]
Jul 29 21:39:05.384240 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:05.384171    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:05.750687 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:05.750659    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:06.482185 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:06.482152    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b208f44-7aa3-4984-8f55-074dd0360270" path="/var/lib/kubelet/pods/8b208f44-7aa3-4984-8f55-074dd0360270/volumes"
Jul 29 21:39:08.319266 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:08.319225    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:39:11.533849 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:11.533807    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:11.633949 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:11.633917    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:11.807701 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:11.807669    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"]
Jul 29 21:39:11.807948 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:11.807923    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc" podUID="9cb5dd4c-5259-424c-a696-83e3cd2673b3" containerName="istio-proxy" containerID="cri-o://df94a5b8fc4e28e5a4fbaa7c768dc46766b8aceb827ab112a61f6d4b353a15c8" gracePeriod=30
Jul 29 21:39:11.833999 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:11.833953    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:11.948620 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:11.948581    2575 patch_prober.go:28] interesting pod/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 21:39:11.948787 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:11.948643    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc" podUID="9cb5dd4c-5259-424c-a696-83e3cd2673b3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 21:39:12.081915 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:12.081823    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:12.201989 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:12.201957    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:12.302016 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:12.301982    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:12.438194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:12.438096    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:17.060860 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.060833    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:39:17.178130 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.178036    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-credential-socket\") pod \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") "
Jul 29 21:39:17.178130 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.178096    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-workload-certs\") pod \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") "
Jul 29 21:39:17.178358 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.178134    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-podinfo\") pod \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") "
Jul 29 21:39:17.178358 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.178159    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-data\") pod \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") "
Jul 29 21:39:17.178358 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.178204    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-envoy\") pod \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") "
Jul 29 21:39:17.178358 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.178231    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr2zv\" (UniqueName: \"kubernetes.io/projected/9cb5dd4c-5259-424c-a696-83e3cd2673b3-kube-api-access-hr2zv\") pod \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") "
Jul 29 21:39:17.178358 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.178272    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-workload-socket\") pod \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") "
Jul 29 21:39:17.178671 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.178361    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istiod-ca-cert\") pod \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") "
Jul 29 21:39:17.178671 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.178380    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-token\") pod \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\" (UID: \"9cb5dd4c-5259-424c-a696-83e3cd2673b3\") "
Jul 29 21:39:17.178671 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.178394    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9cb5dd4c-5259-424c-a696-83e3cd2673b3" (UID: "9cb5dd4c-5259-424c-a696-83e3cd2673b3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:39:17.178671 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.178486    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9cb5dd4c-5259-424c-a696-83e3cd2673b3" (UID: "9cb5dd4c-5259-424c-a696-83e3cd2673b3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:39:17.178866 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.178758    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-credential-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:39:17.178866 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.178767    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9cb5dd4c-5259-424c-a696-83e3cd2673b3" (UID: "9cb5dd4c-5259-424c-a696-83e3cd2673b3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:39:17.178866 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.178782    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-workload-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:39:17.179185 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.179156    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-data" (OuterVolumeSpecName: "istio-data") pod "9cb5dd4c-5259-424c-a696-83e3cd2673b3" (UID: "9cb5dd4c-5259-424c-a696-83e3cd2673b3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:39:17.179273 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.179229    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9cb5dd4c-5259-424c-a696-83e3cd2673b3" (UID: "9cb5dd4c-5259-424c-a696-83e3cd2673b3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:39:17.180596 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.180567    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9cb5dd4c-5259-424c-a696-83e3cd2673b3" (UID: "9cb5dd4c-5259-424c-a696-83e3cd2673b3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:39:17.180711 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.180592    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9cb5dd4c-5259-424c-a696-83e3cd2673b3" (UID: "9cb5dd4c-5259-424c-a696-83e3cd2673b3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:39:17.180711 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.180649    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-token" (OuterVolumeSpecName: "istio-token") pod "9cb5dd4c-5259-424c-a696-83e3cd2673b3" (UID: "9cb5dd4c-5259-424c-a696-83e3cd2673b3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:39:17.180831 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.180807    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cb5dd4c-5259-424c-a696-83e3cd2673b3-kube-api-access-hr2zv" (OuterVolumeSpecName: "kube-api-access-hr2zv") pod "9cb5dd4c-5259-424c-a696-83e3cd2673b3" (UID: "9cb5dd4c-5259-424c-a696-83e3cd2673b3"). InnerVolumeSpecName "kube-api-access-hr2zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:39:17.279534 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.279501    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-data\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:39:17.279534 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.279527    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-envoy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:39:17.279534 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.279537    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr2zv\" (UniqueName: \"kubernetes.io/projected/9cb5dd4c-5259-424c-a696-83e3cd2673b3-kube-api-access-hr2zv\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:39:17.279773 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.279548    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb5dd4c-5259-424c-a696-83e3cd2673b3-workload-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:39:17.279773 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.279558    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istiod-ca-cert\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:39:17.279773 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.279566    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-token\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:39:17.279773 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.279575    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cb5dd4c-5259-424c-a696-83e3cd2673b3-istio-podinfo\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:39:17.412025 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.411995    2575 generic.go:356] "Generic (PLEG): container finished" podID="9cb5dd4c-5259-424c-a696-83e3cd2673b3" containerID="df94a5b8fc4e28e5a4fbaa7c768dc46766b8aceb827ab112a61f6d4b353a15c8" exitCode=0
Jul 29 21:39:17.412225 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.412059    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"
Jul 29 21:39:17.412225 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.412085    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc" event={"ID":"9cb5dd4c-5259-424c-a696-83e3cd2673b3","Type":"ContainerDied","Data":"df94a5b8fc4e28e5a4fbaa7c768dc46766b8aceb827ab112a61f6d4b353a15c8"}
Jul 29 21:39:17.412225 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.412150    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc" event={"ID":"9cb5dd4c-5259-424c-a696-83e3cd2673b3","Type":"ContainerDied","Data":"86f8947414cc86320cf45250eb01b4918ad59e50355b6d5a71005e0675f25b29"}
Jul 29 21:39:17.412225 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.412184    2575 scope.go:117] "RemoveContainer" containerID="df94a5b8fc4e28e5a4fbaa7c768dc46766b8aceb827ab112a61f6d4b353a15c8"
Jul 29 21:39:17.424875 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.424857    2575 scope.go:117] "RemoveContainer" containerID="2008d2a8e7b0d1105c9c4c6337da156df3387c74776d3ff3b751b919320088ab"
Jul 29 21:39:17.433291 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.433275    2575 scope.go:117] "RemoveContainer" containerID="df94a5b8fc4e28e5a4fbaa7c768dc46766b8aceb827ab112a61f6d4b353a15c8"
Jul 29 21:39:17.433579 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:39:17.433558    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df94a5b8fc4e28e5a4fbaa7c768dc46766b8aceb827ab112a61f6d4b353a15c8\": container with ID starting with df94a5b8fc4e28e5a4fbaa7c768dc46766b8aceb827ab112a61f6d4b353a15c8 not found: ID does not exist" containerID="df94a5b8fc4e28e5a4fbaa7c768dc46766b8aceb827ab112a61f6d4b353a15c8"
Jul 29 21:39:17.433643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.433587    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df94a5b8fc4e28e5a4fbaa7c768dc46766b8aceb827ab112a61f6d4b353a15c8"} err="failed to get container status \"df94a5b8fc4e28e5a4fbaa7c768dc46766b8aceb827ab112a61f6d4b353a15c8\": rpc error: code = NotFound desc = could not find container \"df94a5b8fc4e28e5a4fbaa7c768dc46766b8aceb827ab112a61f6d4b353a15c8\": container with ID starting with df94a5b8fc4e28e5a4fbaa7c768dc46766b8aceb827ab112a61f6d4b353a15c8 not found: ID does not exist"
Jul 29 21:39:17.433643 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.433604    2575 scope.go:117] "RemoveContainer" containerID="2008d2a8e7b0d1105c9c4c6337da156df3387c74776d3ff3b751b919320088ab"
Jul 29 21:39:17.433838 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:39:17.433824    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2008d2a8e7b0d1105c9c4c6337da156df3387c74776d3ff3b751b919320088ab\": container with ID starting with 2008d2a8e7b0d1105c9c4c6337da156df3387c74776d3ff3b751b919320088ab not found: ID does not exist" containerID="2008d2a8e7b0d1105c9c4c6337da156df3387c74776d3ff3b751b919320088ab"
Jul 29 21:39:17.433884 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.433842    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2008d2a8e7b0d1105c9c4c6337da156df3387c74776d3ff3b751b919320088ab"} err="failed to get container status \"2008d2a8e7b0d1105c9c4c6337da156df3387c74776d3ff3b751b919320088ab\": rpc error: code = NotFound desc = could not find container \"2008d2a8e7b0d1105c9c4c6337da156df3387c74776d3ff3b751b919320088ab\": container with ID starting with 2008d2a8e7b0d1105c9c4c6337da156df3387c74776d3ff3b751b919320088ab not found: ID does not exist"
Jul 29 21:39:17.442799 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.442776    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"]
Jul 29 21:39:17.448232 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:17.448205    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-095b8200-openshift-default-7c449fcfdd-kqwkc"]
Jul 29 21:39:18.396587 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:18.396553    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:18.465414 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:18.465379    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:18.483323 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:18.483297    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cb5dd4c-5259-424c-a696-83e3cd2673b3" path="/var/lib/kubelet/pods/9cb5dd4c-5259-424c-a696-83e3cd2673b3/volumes"
Jul 29 21:39:18.604879 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:18.604841    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:18.785467 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:18.785357    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:18.856846 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:18.856816    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:24.695972 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:24.695925    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:24.769937 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:24.769903    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:31.851721 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:31.851684    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:32.153603 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.153515    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"]
Jul 29 21:39:32.154176 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.154158    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b208f44-7aa3-4984-8f55-074dd0360270" containerName="revoke-keys"
Jul 29 21:39:32.154251 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.154178    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b208f44-7aa3-4984-8f55-074dd0360270" containerName="revoke-keys"
Jul 29 21:39:32.154251 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.154193    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb5dd4c-5259-424c-a696-83e3cd2673b3" containerName="istio-proxy"
Jul 29 21:39:32.154251 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.154198    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb5dd4c-5259-424c-a696-83e3cd2673b3" containerName="istio-proxy"
Jul 29 21:39:32.154251 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.154211    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb5dd4c-5259-424c-a696-83e3cd2673b3" containerName="istio-proxy"
Jul 29 21:39:32.154251 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.154217    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb5dd4c-5259-424c-a696-83e3cd2673b3" containerName="istio-proxy"
Jul 29 21:39:32.154424 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.154282    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cb5dd4c-5259-424c-a696-83e3cd2673b3" containerName="istio-proxy"
Jul 29 21:39:32.154424 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.154291    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cb5dd4c-5259-424c-a696-83e3cd2673b3" containerName="istio-proxy"
Jul 29 21:39:32.154424 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.154296    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b208f44-7aa3-4984-8f55-074dd0360270" containerName="revoke-keys"
Jul 29 21:39:32.158766 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.158747    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.161697 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.161671    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a6a723f4-openshift-default-dockercfg-nc4lm\""
Jul 29 21:39:32.170893 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.170869    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"]
Jul 29 21:39:32.185174 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.185141    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:32.199613 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.199588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-credential-socket\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.199719 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.199628    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-envoy\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.199719 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.199688    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-workload-certs\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.199719 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.199714    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-data\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.199833 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.199739    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-workload-socket\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.199833 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.199798    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istiod-ca-cert\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.199908 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.199833    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvj7s\" (UniqueName: \"kubernetes.io/projected/42e580c0-6a59-4927-b8e9-ca1d276fed7a-kube-api-access-dvj7s\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.199908 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.199863    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-podinfo\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.199982 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.199925    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-token\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.285101 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.285066    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:32.301142 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.301118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-envoy\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.301229 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.301164    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-workload-certs\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.301229 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.301204    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-data\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.301299 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.301235    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-workload-socket\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.301392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.301368    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istiod-ca-cert\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.301462 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.301420    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvj7s\" (UniqueName: \"kubernetes.io/projected/42e580c0-6a59-4927-b8e9-ca1d276fed7a-kube-api-access-dvj7s\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.301529 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.301480    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-podinfo\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.301586 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.301545    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-token\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.301640 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.301603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-workload-certs\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.301640 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.301621    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-credential-socket\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.301749 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.301659    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-workload-socket\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.301983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.301960    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-data\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.302109 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.301999    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-credential-socket\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.302233 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.302214    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istiod-ca-cert\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.303487 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.303465    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-envoy\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.303823 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.303803    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-podinfo\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.309996 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.309969    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-token\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.310137 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.310116    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvj7s\" (UniqueName: \"kubernetes.io/projected/42e580c0-6a59-4927-b8e9-ca1d276fed7a-kube-api-access-dvj7s\") pod \"e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") " pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.469765 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.469673    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:32.612664 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.612634    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"]
Jul 29 21:39:32.614517 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:39:32.614476    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e580c0_6a59_4927_b8e9_ca1d276fed7a.slice/crio-ed9de3ed608906a22b092947121b3be8cd505a2446af350b56694f8603a48e86 WatchSource:0}: Error finding container ed9de3ed608906a22b092947121b3be8cd505a2446af350b56694f8603a48e86: Status 404 returned error can't find the container with id ed9de3ed608906a22b092947121b3be8cd505a2446af350b56694f8603a48e86
Jul 29 21:39:32.616819 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.616788    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:39:32.616905 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.616855    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:39:32.616905 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:32.616881    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:39:33.496805 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:33.496766    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5" event={"ID":"42e580c0-6a59-4927-b8e9-ca1d276fed7a","Type":"ContainerStarted","Data":"a92d2d0d219a30a1011349e04b9c0a5ce6806451e238835bcb851d20b844bc5a"}
Jul 29 21:39:33.497282 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:33.496824    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5" event={"ID":"42e580c0-6a59-4927-b8e9-ca1d276fed7a","Type":"ContainerStarted","Data":"ed9de3ed608906a22b092947121b3be8cd505a2446af350b56694f8603a48e86"}
Jul 29 21:39:33.520395 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:33.520351    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5" podStartSLOduration=1.520336301 podStartE2EDuration="1.520336301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:39:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:39:33.52010801 +0000 UTC m=+2165.525631468" watchObservedRunningTime="2026-07-29 21:39:33.520336301 +0000 UTC m=+2165.525859669"
Jul 29 21:39:34.470533 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:34.470498    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:34.475089 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:34.475064    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:34.501978 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:34.501946    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:34.502770 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:34.502749    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:35.707118 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:35.707079    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:35.807020 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:35.806993    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:36.613002 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:36.612963    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:37.100604 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:37.100568    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:37.203825 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:37.203771    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:39:42.417775 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:42.417737    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:39:50.542578 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:50.542546    2575 patch_prober.go:28] interesting pod/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 21:39:50.544803 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:50.542616    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5" podUID="42e580c0-6a59-4927-b8e9-ca1d276fed7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 21:39:51.593108 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:51.593073    2575 generic.go:356] "Generic (PLEG): container finished" podID="42e580c0-6a59-4927-b8e9-ca1d276fed7a" containerID="a92d2d0d219a30a1011349e04b9c0a5ce6806451e238835bcb851d20b844bc5a" exitCode=0
Jul 29 21:39:51.593494 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:51.593145    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5" event={"ID":"42e580c0-6a59-4927-b8e9-ca1d276fed7a","Type":"ContainerDied","Data":"a92d2d0d219a30a1011349e04b9c0a5ce6806451e238835bcb851d20b844bc5a"}
Jul 29 21:39:51.593494 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:51.593470    2575 scope.go:117] "RemoveContainer" containerID="a92d2d0d219a30a1011349e04b9c0a5ce6806451e238835bcb851d20b844bc5a"
Jul 29 21:39:51.594491 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:51.594440    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:39:51.594562 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:51.594544    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:39:51.594609 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:51.594596    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:39:52.600013 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:52.599978    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5" event={"ID":"42e580c0-6a59-4927-b8e9-ca1d276fed7a","Type":"ContainerStarted","Data":"ca2d73cb68bd5e9a063e2fd6abc0fa417993cbfef0a15761e5496dd6a009d544"}
Jul 29 21:39:53.470005 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:53.469964    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:53.470200 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:53.470180    2575 patch_prober.go:28] interesting pod/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 29 21:39:53.470247 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:53.470222    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5" podUID="42e580c0-6a59-4927-b8e9-ca1d276fed7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 29 21:39:54.470071 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:54.470038    2575 patch_prober.go:28] interesting pod/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 29 21:39:54.470484 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:54.470089    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5" podUID="42e580c0-6a59-4927-b8e9-ca1d276fed7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 29 21:39:55.471022 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:55.470983    2575 patch_prober.go:28] interesting pod/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 29 21:39:55.471429 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:55.471050    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5" podUID="42e580c0-6a59-4927-b8e9-ca1d276fed7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 29 21:39:56.473282 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:56.473248    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:56.473734 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:56.473525    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:39:56.474357 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:39:56.474334    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:40:00.531836 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:00.531797    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:40:02.392590 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.392553    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"]
Jul 29 21:40:02.395971 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.395944    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.399587 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.399556    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a6a723f4\"/\"kube-root-ca.crt\""
Jul 29 21:40:02.399587 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.399573    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a6a723f4\"/\"e2e-lifecycle-model-a6a723f4-kserve-self-signed-certs\""
Jul 29 21:40:02.399765 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.399573    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a6a723f4\"/\"default-dockercfg-bn9dz\""
Jul 29 21:40:02.400599 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.400583    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a6a723f4\"/\"openshift-service-ca.crt\""
Jul 29 21:40:02.405014 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.404989    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"]
Jul 29 21:40:02.483373 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.483344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-dshm\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.483373 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.483378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-model-cache\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.483598 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.483400    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-home\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.483598 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.483423    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-tmp-dir\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.483598 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.483502    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-tls-certs\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.483598 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.483563    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4gr7\" (UniqueName: \"kubernetes.io/projected/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-kube-api-access-w4gr7\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.509791 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.509756    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:40:02.584644 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.584603    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-dshm\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.584644 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.584648    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-model-cache\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.584897 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.584671    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-home\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.584897 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.584687    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-tmp-dir\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.584897 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.584709    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-tls-certs\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.584897 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.584754    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4gr7\" (UniqueName: \"kubernetes.io/projected/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-kube-api-access-w4gr7\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.585107 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.585053    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-model-cache\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.585154 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.585130    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-home\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.585190 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.585153    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-tmp-dir\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.587052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.587025    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-dshm\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.587245 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.587224    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-tls-certs\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.594036 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.594013    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4gr7\" (UniqueName: \"kubernetes.io/projected/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-kube-api-access-w4gr7\") pod \"e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") " pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.706865 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.706765    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:02.847272 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:02.847240    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"]
Jul 29 21:40:02.849392 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:40:02.849366    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod625c02a9_bb8f_45b9_bdcd_f169b5e871b7.slice/crio-bf668400e28fec725bc1cd35aa7e1654327b8946e435cfe36d77319bae230c46 WatchSource:0}: Error finding container bf668400e28fec725bc1cd35aa7e1654327b8946e435cfe36d77319bae230c46: Status 404 returned error can't find the container with id bf668400e28fec725bc1cd35aa7e1654327b8946e435cfe36d77319bae230c46
Jul 29 21:40:03.660198 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:03.660161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn" event={"ID":"625c02a9-bb8f-45b9-bdcd-f169b5e871b7","Type":"ContainerStarted","Data":"b4e03e829f597401b8a6c2143d3e3d29739e87ccdaadcc84e3781e14b34710d1"}
Jul 29 21:40:03.660597 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:03.660207    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn" event={"ID":"625c02a9-bb8f-45b9-bdcd-f169b5e871b7","Type":"ContainerStarted","Data":"bf668400e28fec725bc1cd35aa7e1654327b8946e435cfe36d77319bae230c46"}
Jul 29 21:40:06.119494 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:06.119413    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn" podStartSLOduration=4.119396524 podStartE2EDuration="4.119396524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:40:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:40:03.6778943 +0000 UTC m=+2195.683417680" watchObservedRunningTime="2026-07-29 21:40:06.119396524 +0000 UTC m=+2198.124919891"
Jul 29 21:40:06.119886 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:06.119711    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:40:12.707421 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:12.707387    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:12.707827 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:12.707433    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:12.719841 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:12.719818    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:13.724239 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:13.724208    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:40:22.811289 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:22.811253    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:40:30.067314 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:30.067271    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps"]
Jul 29 21:40:30.073920 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:30.073887    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps"
Jul 29 21:40:30.075485 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:30.075458    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps"]
Jul 29 21:40:30.076827 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:30.076798    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 21:40:30.077298 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:30.077280    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9wjvq\""
Jul 29 21:40:30.141857 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:30.141826    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4168799f-4d06-473a-9441-a3415fac4ed1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps\" (UID: \"4168799f-4d06-473a-9441-a3415fac4ed1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps"
Jul 29 21:40:30.243091 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:30.243054    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4168799f-4d06-473a-9441-a3415fac4ed1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps\" (UID: \"4168799f-4d06-473a-9441-a3415fac4ed1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps"
Jul 29 21:40:30.243738 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:30.243716    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4168799f-4d06-473a-9441-a3415fac4ed1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps\" (UID: \"4168799f-4d06-473a-9441-a3415fac4ed1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps"
Jul 29 21:40:30.386625 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:30.386538    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps"
Jul 29 21:40:30.520217 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:30.520154    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps"]
Jul 29 21:40:30.522920 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:40:30.522883    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4168799f_4d06_473a_9441_a3415fac4ed1.slice/crio-e760a66f46d889f049e47cafb41e3900d2d78b3353e0fcfd0f068fec4fe3271b WatchSource:0}: Error finding container e760a66f46d889f049e47cafb41e3900d2d78b3353e0fcfd0f068fec4fe3271b: Status 404 returned error can't find the container with id e760a66f46d889f049e47cafb41e3900d2d78b3353e0fcfd0f068fec4fe3271b
Jul 29 21:40:30.804123 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:30.804085    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps" event={"ID":"4168799f-4d06-473a-9441-a3415fac4ed1","Type":"ContainerStarted","Data":"e760a66f46d889f049e47cafb41e3900d2d78b3353e0fcfd0f068fec4fe3271b"}
Jul 29 21:40:31.810077 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:31.810047    2575 generic.go:356] "Generic (PLEG): container finished" podID="4168799f-4d06-473a-9441-a3415fac4ed1" containerID="3fa7bbc00ff32268dd212aafdb0001cfa52b4fb3e3e113caf9007d36ab5f95de" exitCode=0
Jul 29 21:40:31.810473 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:31.810133    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps" event={"ID":"4168799f-4d06-473a-9441-a3415fac4ed1","Type":"ContainerDied","Data":"3fa7bbc00ff32268dd212aafdb0001cfa52b4fb3e3e113caf9007d36ab5f95de"}
Jul 29 21:40:32.951059 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:32.951033    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps"
Jul 29 21:40:33.072607 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:33.072547    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4168799f-4d06-473a-9441-a3415fac4ed1-maas-api-service-ca\") pod \"4168799f-4d06-473a-9441-a3415fac4ed1\" (UID: \"4168799f-4d06-473a-9441-a3415fac4ed1\") "
Jul 29 21:40:33.072870 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:33.072848    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4168799f-4d06-473a-9441-a3415fac4ed1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4168799f-4d06-473a-9441-a3415fac4ed1" (UID: "4168799f-4d06-473a-9441-a3415fac4ed1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:40:33.173578 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:33.173550    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4168799f-4d06-473a-9441-a3415fac4ed1-maas-api-service-ca\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:40:33.821927 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:33.821896    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps"
Jul 29 21:40:33.822124 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:33.821932    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps" event={"ID":"4168799f-4d06-473a-9441-a3415fac4ed1","Type":"ContainerDied","Data":"e760a66f46d889f049e47cafb41e3900d2d78b3353e0fcfd0f068fec4fe3271b"}
Jul 29 21:40:33.822124 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:33.821988    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e760a66f46d889f049e47cafb41e3900d2d78b3353e0fcfd0f068fec4fe3271b"
Jul 29 21:40:44.515838 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:44.515795    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:40:45.718578 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:45.718542    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:40:45.787919 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:45.787883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:40:45.890969 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:45.890925    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:40:45.892209 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:45.892184    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps"]
Jul 29 21:40:45.894692 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:45.894670    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a6a723f4-2ctps"]
Jul 29 21:40:45.988122 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:45.988027    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:40:46.483243 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:46.483203    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4168799f-4d06-473a-9441-a3415fac4ed1" path="/var/lib/kubelet/pods/4168799f-4d06-473a-9441-a3415fac4ed1/volumes"
Jul 29 21:40:49.561691 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:49.561652    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:40:54.413048 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:54.412958    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:40:54.544685 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:54.544651    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"]
Jul 29 21:40:54.603049 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:40:54.603019    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:41:09.563651 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:09.563590    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn" podUID="625c02a9-bb8f-45b9-bdcd-f169b5e871b7" containerName="main" containerID="cri-o://b4e03e829f597401b8a6c2143d3e3d29739e87ccdaadcc84e3781e14b34710d1" gracePeriod=45
Jul 29 21:41:09.817383 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:09.817329    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:41:09.915765 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:09.915736    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-dshm\") pod \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") "
Jul 29 21:41:09.915909 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:09.915850    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-tls-certs\") pod \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") "
Jul 29 21:41:09.915909 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:09.915871    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4gr7\" (UniqueName: \"kubernetes.io/projected/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-kube-api-access-w4gr7\") pod \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") "
Jul 29 21:41:09.915909 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:09.915898    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-model-cache\") pod \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") "
Jul 29 21:41:09.916062 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:09.915917    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-home\") pod \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") "
Jul 29 21:41:09.916062 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:09.915952    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-tmp-dir\") pod \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\" (UID: \"625c02a9-bb8f-45b9-bdcd-f169b5e871b7\") "
Jul 29 21:41:09.916275 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:09.916188    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-model-cache" (OuterVolumeSpecName: "model-cache") pod "625c02a9-bb8f-45b9-bdcd-f169b5e871b7" (UID: "625c02a9-bb8f-45b9-bdcd-f169b5e871b7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:41:09.916275 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:09.916205    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-home" (OuterVolumeSpecName: "home") pod "625c02a9-bb8f-45b9-bdcd-f169b5e871b7" (UID: "625c02a9-bb8f-45b9-bdcd-f169b5e871b7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:41:09.916275 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:09.916264    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "625c02a9-bb8f-45b9-bdcd-f169b5e871b7" (UID: "625c02a9-bb8f-45b9-bdcd-f169b5e871b7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:41:09.917936 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:09.917907    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-dshm" (OuterVolumeSpecName: "dshm") pod "625c02a9-bb8f-45b9-bdcd-f169b5e871b7" (UID: "625c02a9-bb8f-45b9-bdcd-f169b5e871b7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:41:09.918017 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:09.917957    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "625c02a9-bb8f-45b9-bdcd-f169b5e871b7" (UID: "625c02a9-bb8f-45b9-bdcd-f169b5e871b7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:41:09.918017 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:09.918002    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-kube-api-access-w4gr7" (OuterVolumeSpecName: "kube-api-access-w4gr7") pod "625c02a9-bb8f-45b9-bdcd-f169b5e871b7" (UID: "625c02a9-bb8f-45b9-bdcd-f169b5e871b7"). InnerVolumeSpecName "kube-api-access-w4gr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:41:10.017718 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:10.017685    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-tls-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:41:10.017718 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:10.017712    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4gr7\" (UniqueName: \"kubernetes.io/projected/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-kube-api-access-w4gr7\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:41:10.017718 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:10.017723    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-model-cache\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:41:10.017919 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:10.017731    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-home\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:41:10.017919 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:10.017739    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-tmp-dir\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:41:10.017919 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:10.017746    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/625c02a9-bb8f-45b9-bdcd-f169b5e871b7-dshm\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:41:10.027128 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:10.027103    2575 generic.go:356] "Generic (PLEG): container finished" podID="625c02a9-bb8f-45b9-bdcd-f169b5e871b7" containerID="b4e03e829f597401b8a6c2143d3e3d29739e87ccdaadcc84e3781e14b34710d1" exitCode=0
Jul 29 21:41:10.027253 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:10.027149    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"
Jul 29 21:41:10.027253 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:10.027151    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn" event={"ID":"625c02a9-bb8f-45b9-bdcd-f169b5e871b7","Type":"ContainerDied","Data":"b4e03e829f597401b8a6c2143d3e3d29739e87ccdaadcc84e3781e14b34710d1"}
Jul 29 21:41:10.027253 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:10.027210    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn" event={"ID":"625c02a9-bb8f-45b9-bdcd-f169b5e871b7","Type":"ContainerDied","Data":"bf668400e28fec725bc1cd35aa7e1654327b8946e435cfe36d77319bae230c46"}
Jul 29 21:41:10.027253 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:10.027233    2575 scope.go:117] "RemoveContainer" containerID="b4e03e829f597401b8a6c2143d3e3d29739e87ccdaadcc84e3781e14b34710d1"
Jul 29 21:41:10.036677 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:10.036658    2575 scope.go:117] "RemoveContainer" containerID="b4e03e829f597401b8a6c2143d3e3d29739e87ccdaadcc84e3781e14b34710d1"
Jul 29 21:41:10.036925 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:41:10.036902    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4e03e829f597401b8a6c2143d3e3d29739e87ccdaadcc84e3781e14b34710d1\": container with ID starting with b4e03e829f597401b8a6c2143d3e3d29739e87ccdaadcc84e3781e14b34710d1 not found: ID does not exist" containerID="b4e03e829f597401b8a6c2143d3e3d29739e87ccdaadcc84e3781e14b34710d1"
Jul 29 21:41:10.036978 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:10.036934    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4e03e829f597401b8a6c2143d3e3d29739e87ccdaadcc84e3781e14b34710d1"} err="failed to get container status \"b4e03e829f597401b8a6c2143d3e3d29739e87ccdaadcc84e3781e14b34710d1\": rpc error: code = NotFound desc = could not find container \"b4e03e829f597401b8a6c2143d3e3d29739e87ccdaadcc84e3781e14b34710d1\": container with ID starting with b4e03e829f597401b8a6c2143d3e3d29739e87ccdaadcc84e3781e14b34710d1 not found: ID does not exist"
Jul 29 21:41:10.050187 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:10.050164    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"]
Jul 29 21:41:10.053044 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:10.053024    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-a6a723f4/e2e-lifecycle-model-a6a723f4-kserve-6cdf46f795-g6dpn"]
Jul 29 21:41:10.482722 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:10.482682    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="625c02a9-bb8f-45b9-bdcd-f169b5e871b7" path="/var/lib/kubelet/pods/625c02a9-bb8f-45b9-bdcd-f169b5e871b7/volumes"
Jul 29 21:41:28.638895 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:28.638863    2575 scope.go:117] "RemoveContainer" containerID="0b96653a2525c1e8fbc9e0b7b2ee91c0255c5ed929da3c2c79a3b3e87719b3bd"
Jul 29 21:41:28.647035 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:28.647014    2575 scope.go:117] "RemoveContainer" containerID="c95c21862deaac8bdd9932975fe6c030d49d48eca7b7bd7bb49c29418115f2c6"
Jul 29 21:41:31.415599 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:31.415567    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:41:32.750282 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:32.750245    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:41:37.566256 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:41:37.566224    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:00.679037 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:00.678997    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:00.742785 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:00.742752    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:00.924281 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:00.924247    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"]
Jul 29 21:42:00.924533 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:00.924504    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5" podUID="42e580c0-6a59-4927-b8e9-ca1d276fed7a" containerName="istio-proxy" containerID="cri-o://ca2d73cb68bd5e9a063e2fd6abc0fa417993cbfef0a15761e5496dd6a009d544" gracePeriod=30
Jul 29 21:42:00.953638 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:00.953569    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:01.214340 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:01.214248    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:02.399754 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:02.399719    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:02.499101 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:02.499059    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:02.597522 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:02.597487    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:03.426595 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:03.426558    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:03.524331 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:03.524304    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:03.623874 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:03.623837    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:05.041901 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:05.041860    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:05.781243 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:05.781206    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:06.181076 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.181052    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:42:06.293418 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.293339    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-credential-socket\") pod \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") "
Jul 29 21:42:06.293418 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.293379    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-token\") pod \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") "
Jul 29 21:42:06.293634 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.293439    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvj7s\" (UniqueName: \"kubernetes.io/projected/42e580c0-6a59-4927-b8e9-ca1d276fed7a-kube-api-access-dvj7s\") pod \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") "
Jul 29 21:42:06.293634 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.293469    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-workload-socket\") pod \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") "
Jul 29 21:42:06.293634 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.293497    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-envoy\") pod \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") "
Jul 29 21:42:06.293634 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.293542    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istiod-ca-cert\") pod \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") "
Jul 29 21:42:06.293634 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.293589    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-data\") pod \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") "
Jul 29 21:42:06.293895 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.293633    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "42e580c0-6a59-4927-b8e9-ca1d276fed7a" (UID: "42e580c0-6a59-4927-b8e9-ca1d276fed7a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:42:06.293895 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.293741    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-podinfo\") pod \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") "
Jul 29 21:42:06.293895 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.293788    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-workload-certs\") pod \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\" (UID: \"42e580c0-6a59-4927-b8e9-ca1d276fed7a\") "
Jul 29 21:42:06.294112 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.293786    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "42e580c0-6a59-4927-b8e9-ca1d276fed7a" (UID: "42e580c0-6a59-4927-b8e9-ca1d276fed7a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:42:06.294112 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.293977    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "42e580c0-6a59-4927-b8e9-ca1d276fed7a" (UID: "42e580c0-6a59-4927-b8e9-ca1d276fed7a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:42:06.294112 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.293998    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "42e580c0-6a59-4927-b8e9-ca1d276fed7a" (UID: "42e580c0-6a59-4927-b8e9-ca1d276fed7a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:42:06.294277 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.294200    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-credential-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:42:06.294277 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.294216    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-workload-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:42:06.294277 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.294230    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istiod-ca-cert\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:42:06.294277 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.294244    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-workload-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:42:06.294602 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.294578    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-data" (OuterVolumeSpecName: "istio-data") pod "42e580c0-6a59-4927-b8e9-ca1d276fed7a" (UID: "42e580c0-6a59-4927-b8e9-ca1d276fed7a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:42:06.295820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.295788    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "42e580c0-6a59-4927-b8e9-ca1d276fed7a" (UID: "42e580c0-6a59-4927-b8e9-ca1d276fed7a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:42:06.295933 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.295817    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-token" (OuterVolumeSpecName: "istio-token") pod "42e580c0-6a59-4927-b8e9-ca1d276fed7a" (UID: "42e580c0-6a59-4927-b8e9-ca1d276fed7a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:42:06.295933 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.295818    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e580c0-6a59-4927-b8e9-ca1d276fed7a-kube-api-access-dvj7s" (OuterVolumeSpecName: "kube-api-access-dvj7s") pod "42e580c0-6a59-4927-b8e9-ca1d276fed7a" (UID: "42e580c0-6a59-4927-b8e9-ca1d276fed7a"). InnerVolumeSpecName "kube-api-access-dvj7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:42:06.296102 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.296086    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "42e580c0-6a59-4927-b8e9-ca1d276fed7a" (UID: "42e580c0-6a59-4927-b8e9-ca1d276fed7a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:42:06.320250 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.320226    2575 generic.go:356] "Generic (PLEG): container finished" podID="42e580c0-6a59-4927-b8e9-ca1d276fed7a" containerID="ca2d73cb68bd5e9a063e2fd6abc0fa417993cbfef0a15761e5496dd6a009d544" exitCode=0
Jul 29 21:42:06.320353 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.320254    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5" event={"ID":"42e580c0-6a59-4927-b8e9-ca1d276fed7a","Type":"ContainerDied","Data":"ca2d73cb68bd5e9a063e2fd6abc0fa417993cbfef0a15761e5496dd6a009d544"}
Jul 29 21:42:06.320353 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.320277    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"
Jul 29 21:42:06.320353 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.320293    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5" event={"ID":"42e580c0-6a59-4927-b8e9-ca1d276fed7a","Type":"ContainerDied","Data":"ed9de3ed608906a22b092947121b3be8cd505a2446af350b56694f8603a48e86"}
Jul 29 21:42:06.320353 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.320316    2575 scope.go:117] "RemoveContainer" containerID="ca2d73cb68bd5e9a063e2fd6abc0fa417993cbfef0a15761e5496dd6a009d544"
Jul 29 21:42:06.329805 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.329789    2575 scope.go:117] "RemoveContainer" containerID="a92d2d0d219a30a1011349e04b9c0a5ce6806451e238835bcb851d20b844bc5a"
Jul 29 21:42:06.340047 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.340030    2575 scope.go:117] "RemoveContainer" containerID="ca2d73cb68bd5e9a063e2fd6abc0fa417993cbfef0a15761e5496dd6a009d544"
Jul 29 21:42:06.340288 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:42:06.340271    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca2d73cb68bd5e9a063e2fd6abc0fa417993cbfef0a15761e5496dd6a009d544\": container with ID starting with ca2d73cb68bd5e9a063e2fd6abc0fa417993cbfef0a15761e5496dd6a009d544 not found: ID does not exist" containerID="ca2d73cb68bd5e9a063e2fd6abc0fa417993cbfef0a15761e5496dd6a009d544"
Jul 29 21:42:06.340335 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.340296    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca2d73cb68bd5e9a063e2fd6abc0fa417993cbfef0a15761e5496dd6a009d544"} err="failed to get container status \"ca2d73cb68bd5e9a063e2fd6abc0fa417993cbfef0a15761e5496dd6a009d544\": rpc error: code = NotFound desc = could not find container \"ca2d73cb68bd5e9a063e2fd6abc0fa417993cbfef0a15761e5496dd6a009d544\": container with ID starting with ca2d73cb68bd5e9a063e2fd6abc0fa417993cbfef0a15761e5496dd6a009d544 not found: ID does not exist"
Jul 29 21:42:06.340335 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.340319    2575 scope.go:117] "RemoveContainer" containerID="a92d2d0d219a30a1011349e04b9c0a5ce6806451e238835bcb851d20b844bc5a"
Jul 29 21:42:06.340636 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:42:06.340617    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a92d2d0d219a30a1011349e04b9c0a5ce6806451e238835bcb851d20b844bc5a\": container with ID starting with a92d2d0d219a30a1011349e04b9c0a5ce6806451e238835bcb851d20b844bc5a not found: ID does not exist" containerID="a92d2d0d219a30a1011349e04b9c0a5ce6806451e238835bcb851d20b844bc5a"
Jul 29 21:42:06.340690 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.340644    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a92d2d0d219a30a1011349e04b9c0a5ce6806451e238835bcb851d20b844bc5a"} err="failed to get container status \"a92d2d0d219a30a1011349e04b9c0a5ce6806451e238835bcb851d20b844bc5a\": rpc error: code = NotFound desc = could not find container \"a92d2d0d219a30a1011349e04b9c0a5ce6806451e238835bcb851d20b844bc5a\": container with ID starting with a92d2d0d219a30a1011349e04b9c0a5ce6806451e238835bcb851d20b844bc5a not found: ID does not exist"
Jul 29 21:42:06.344032 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.344012    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"]
Jul 29 21:42:06.350536 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.350515    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a6a723f4-openshift-default-5cf9b55564-zf7h5"]
Jul 29 21:42:06.395355 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.395330    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-data\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:42:06.395355 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.395355    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-podinfo\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:42:06.395514 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.395368    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-token\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:42:06.395514 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.395381    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvj7s\" (UniqueName: \"kubernetes.io/projected/42e580c0-6a59-4927-b8e9-ca1d276fed7a-kube-api-access-dvj7s\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:42:06.395514 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.395394    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42e580c0-6a59-4927-b8e9-ca1d276fed7a-istio-envoy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:42:06.488268 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:06.488240    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42e580c0-6a59-4927-b8e9-ca1d276fed7a" path="/var/lib/kubelet/pods/42e580c0-6a59-4927-b8e9-ca1d276fed7a/volumes"
Jul 29 21:42:11.090113 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:11.090078    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:11.190701 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:11.190675    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:11.803654 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:11.803617    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:12.821108 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:12.821071    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:42:18.964774 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:18.964736    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:19.071255 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:19.071217    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:19.193344 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:19.193313    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:20.912426 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:20.912346    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:42:21.440656 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:21.440623    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:28.672826 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:28.672795    2575 scope.go:117] "RemoveContainer" containerID="22ccaf326b8eac29fadce0bdeeff87daa23ff0bdc6cce45b3a4957f60fed0a85"
Jul 29 21:42:28.680902 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:28.680874    2575 scope.go:117] "RemoveContainer" containerID="f22bc0789ba9429491fecf0eb47c94dadaaac1fb916d4617a808baa6e39521ef"
Jul 29 21:42:29.756917 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:29.756871    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:30.148758 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:30.148720    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:51.200829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:51.200790    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:58.047481 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.047425    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:58.148394 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.148361    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:58.408477 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.408390    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:58.716610 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.716527    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"]
Jul 29 21:42:58.716924 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.716911    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625c02a9-bb8f-45b9-bdcd-f169b5e871b7" containerName="main"
Jul 29 21:42:58.716983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.716924    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="625c02a9-bb8f-45b9-bdcd-f169b5e871b7" containerName="main"
Jul 29 21:42:58.716983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.716936    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e580c0-6a59-4927-b8e9-ca1d276fed7a" containerName="istio-proxy"
Jul 29 21:42:58.716983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.716942    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e580c0-6a59-4927-b8e9-ca1d276fed7a" containerName="istio-proxy"
Jul 29 21:42:58.716983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.716955    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e580c0-6a59-4927-b8e9-ca1d276fed7a" containerName="istio-proxy"
Jul 29 21:42:58.716983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.716962    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e580c0-6a59-4927-b8e9-ca1d276fed7a" containerName="istio-proxy"
Jul 29 21:42:58.716983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.716972    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4168799f-4d06-473a-9441-a3415fac4ed1" containerName="revoke-keys"
Jul 29 21:42:58.716983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.716977    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4168799f-4d06-473a-9441-a3415fac4ed1" containerName="revoke-keys"
Jul 29 21:42:58.717323 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.717028    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="42e580c0-6a59-4927-b8e9-ca1d276fed7a" containerName="istio-proxy"
Jul 29 21:42:58.717323 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.717036    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="42e580c0-6a59-4927-b8e9-ca1d276fed7a" containerName="istio-proxy"
Jul 29 21:42:58.717323 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.717048    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="625c02a9-bb8f-45b9-bdcd-f169b5e871b7" containerName="main"
Jul 29 21:42:58.717323 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.717054    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4168799f-4d06-473a-9441-a3415fac4ed1" containerName="revoke-keys"
Jul 29 21:42:58.720159 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.720141    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.723011 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.722991    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-69c0f1-openshift-default-dockercfg-p2zfk\""
Jul 29 21:42:58.735536 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.735512    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"]
Jul 29 21:42:58.746861 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.746833    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:58.839001 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.838968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-envoy\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.839151 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.839033    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94a7613f-ba91-4bd9-a6b2-94f445360416-istiod-ca-cert\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.839151 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.839071    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-credential-socket\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.839151 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.839108    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-data\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.839151 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.839135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-podinfo\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.839292 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.839154    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-workload-socket\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.839292 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.839214    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-token\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.839292 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.839235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7rh4\" (UniqueName: \"kubernetes.io/projected/94a7613f-ba91-4bd9-a6b2-94f445360416-kube-api-access-h7rh4\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.839387 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.839300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-workload-certs\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.940627 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.940593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94a7613f-ba91-4bd9-a6b2-94f445360416-istiod-ca-cert\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.940790 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.940637    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-credential-socket\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.940790 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.940666    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-data\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.940790 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.940757    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-podinfo\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.940790 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.940778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-workload-socket\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.941024 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.940812    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-token\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.941024 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.940840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7rh4\" (UniqueName: \"kubernetes.io/projected/94a7613f-ba91-4bd9-a6b2-94f445360416-kube-api-access-h7rh4\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.941024 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.940872    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-workload-certs\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.941024 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.940895    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-envoy\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.941241 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.941051    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-credential-socket\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.941341 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.941321    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-workload-certs\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.941478 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.941441    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-data\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.941557 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.941482    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94a7613f-ba91-4bd9-a6b2-94f445360416-istiod-ca-cert\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.941557 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.941514    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-workload-socket\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.943775 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.943755    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-envoy\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.943938 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.943918    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-podinfo\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.949079 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.949053    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-token\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:58.949584 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:58.949564    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7rh4\" (UniqueName: \"kubernetes.io/projected/94a7613f-ba91-4bd9-a6b2-94f445360416-kube-api-access-h7rh4\") pod \"e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") " pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:59.030853 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:59.030796    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:42:59.176426 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:59.176394    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"]
Jul 29 21:42:59.178762 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:42:59.178733    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a7613f_ba91_4bd9_a6b2_94f445360416.slice/crio-b401e9779daa95e1627ad68a5c9a421da6579184f6bc78b4ecfc71ba254664b2 WatchSource:0}: Error finding container b401e9779daa95e1627ad68a5c9a421da6579184f6bc78b4ecfc71ba254664b2: Status 404 returned error can't find the container with id b401e9779daa95e1627ad68a5c9a421da6579184f6bc78b4ecfc71ba254664b2
Jul 29 21:42:59.181105 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:59.181067    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:42:59.181190 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:59.181151    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:42:59.181235 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:59.181216    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:42:59.421356 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:59.421322    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:42:59.582609 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:59.582577    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc" event={"ID":"94a7613f-ba91-4bd9-a6b2-94f445360416","Type":"ContainerStarted","Data":"f06347cfa39e1ace2c520ba36e947ef04e4454fddc1907fa20869e667238da18"}
Jul 29 21:42:59.582772 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:59.582629    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc" event={"ID":"94a7613f-ba91-4bd9-a6b2-94f445360416","Type":"ContainerStarted","Data":"b401e9779daa95e1627ad68a5c9a421da6579184f6bc78b4ecfc71ba254664b2"}
Jul 29 21:42:59.606120 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:42:59.606067    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc" podStartSLOduration=1.606053059 podStartE2EDuration="1.606053059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:42:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:42:59.604936565 +0000 UTC m=+2371.610459934" watchObservedRunningTime="2026-07-29 21:42:59.606053059 +0000 UTC m=+2371.611576407"
Jul 29 21:43:00.031390 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:00.031350    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:43:00.036555 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:00.036525    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:43:00.587936 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:00.587903    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:43:00.588875 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:00.588855    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:43:01.690659 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:01.690617    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:01.790615 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:01.790581    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:03.028297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:03.028259    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:03.210678 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:03.210645    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:03.586398 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:03.586363    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:03.683691 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:03.683657    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:07.722093 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:07.722057    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:43:15.057810 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:15.057768    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:15.642544 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:15.642503    2575 patch_prober.go:28] interesting pod/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:52282->10.132.0.54:15021: read: connection reset by peer" start-of-body=
Jul 29 21:43:15.642720 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:15.642579    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc" podUID="94a7613f-ba91-4bd9-a6b2-94f445360416" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:52282->10.132.0.54:15021: read: connection reset by peer"
Jul 29 21:43:15.676130 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:15.676101    2575 generic.go:356] "Generic (PLEG): container finished" podID="94a7613f-ba91-4bd9-a6b2-94f445360416" containerID="f06347cfa39e1ace2c520ba36e947ef04e4454fddc1907fa20869e667238da18" exitCode=0
Jul 29 21:43:15.676240 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:15.676169    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc" event={"ID":"94a7613f-ba91-4bd9-a6b2-94f445360416","Type":"ContainerDied","Data":"f06347cfa39e1ace2c520ba36e947ef04e4454fddc1907fa20869e667238da18"}
Jul 29 21:43:15.676577 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:15.676560    2575 scope.go:117] "RemoveContainer" containerID="f06347cfa39e1ace2c520ba36e947ef04e4454fddc1907fa20869e667238da18"
Jul 29 21:43:15.677564 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:15.677538    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:43:15.677624 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:15.677604    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:43:15.677657 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:15.677632    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:43:16.683992 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:16.683959    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc" event={"ID":"94a7613f-ba91-4bd9-a6b2-94f445360416","Type":"ContainerStarted","Data":"89d7fad7a743c728379e903fac5cd65cc4f515363430c75a9ebb9264e8f1578a"}
Jul 29 21:43:16.800776 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:16.800736    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:17.032208 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:17.032118    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:43:17.032369 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:17.032238    2575 patch_prober.go:28] interesting pod/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 29 21:43:17.032369 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:17.032281    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc" podUID="94a7613f-ba91-4bd9-a6b2-94f445360416" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 29 21:43:18.031694 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:18.031657    2575 patch_prober.go:28] interesting pod/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 29 21:43:18.032188 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:18.031717    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc" podUID="94a7613f-ba91-4bd9-a6b2-94f445360416" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 29 21:43:19.031147 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:19.031111    2575 patch_prober.go:28] interesting pod/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 29 21:43:19.031310 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:19.031191    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc" podUID="94a7613f-ba91-4bd9-a6b2-94f445360416" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 29 21:43:20.031391 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:20.031356    2575 patch_prober.go:28] interesting pod/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 29 21:43:20.031924 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:20.031429    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc" podUID="94a7613f-ba91-4bd9-a6b2-94f445360416" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 29 21:43:21.034528 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:21.034494    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:43:21.034963 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:21.034769    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:43:21.035397 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:21.035382    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:43:26.685739 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:26.685701    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:27.052349 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.052311    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:27.338324 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.338241    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"]
Jul 29 21:43:27.342059 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.342035    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.344825 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.344798    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-8cd3f9-openshift-default-dockercfg-vcmbr\""
Jul 29 21:43:27.353366 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.353343    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"]
Jul 29 21:43:27.398805 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.398776    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-workload-socket\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.398923 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.398814    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzbk8\" (UniqueName: \"kubernetes.io/projected/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-kube-api-access-rzbk8\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.398923 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.398836    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-workload-certs\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.398923 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.398861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-token\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.399032 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.398933    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-credential-socket\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.399032 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.398969    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-envoy\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.399032 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.399004    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-data\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.399128 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.399049    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-podinfo\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.399128 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.399100    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istiod-ca-cert\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.416299 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.416275    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:27.500205 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.500172    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-token\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.500389 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.500213    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-credential-socket\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.500389 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.500232    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-envoy\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.500389 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.500251    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-data\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.500389 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.500371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-podinfo\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.500664 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.500479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istiod-ca-cert\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.500733 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.500665    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-data\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.500733 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.500696    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-workload-socket\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.500832 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.500747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzbk8\" (UniqueName: \"kubernetes.io/projected/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-kube-api-access-rzbk8\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.500832 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.500785    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-workload-certs\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.501225 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.501195    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istiod-ca-cert\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.501323 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.501267    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-workload-socket\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.501323 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.501298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-workload-certs\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.501323 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.501309    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-credential-socket\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.502720 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.502689    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-envoy\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.502933 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.502913    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-podinfo\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.508604 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.508581    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-token\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.508729 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.508711    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzbk8\" (UniqueName: \"kubernetes.io/projected/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-kube-api-access-rzbk8\") pod \"e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") " pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.553864 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.553835    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:27.653935 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.653864    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:27.791153 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.791128    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"]
Jul 29 21:43:27.793429 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:43:27.793392    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9cf4e5a_fdd5_43b0_87a4_d065010176ce.slice/crio-c7680d8ecbb0d20b6b0f896e52139658125ea7b0f2a7edf579710774b1be1202 WatchSource:0}: Error finding container c7680d8ecbb0d20b6b0f896e52139658125ea7b0f2a7edf579710774b1be1202: Status 404 returned error can't find the container with id c7680d8ecbb0d20b6b0f896e52139658125ea7b0f2a7edf579710774b1be1202
Jul 29 21:43:27.795626 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.795583    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:43:27.795698 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.795679    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:43:27.795745 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:27.795730    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:43:28.748506 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:28.748470    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb" event={"ID":"c9cf4e5a-fdd5-43b0-87a4-d065010176ce","Type":"ContainerStarted","Data":"767af7f5460156b84ba805ff3b54c8b94a0ba97c66658e6a8405f6953b582a96"}
Jul 29 21:43:28.748700 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:28.748559    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb" event={"ID":"c9cf4e5a-fdd5-43b0-87a4-d065010176ce","Type":"ContainerStarted","Data":"c7680d8ecbb0d20b6b0f896e52139658125ea7b0f2a7edf579710774b1be1202"}
Jul 29 21:43:28.774256 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:28.774200    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb" podStartSLOduration=1.774181818 podStartE2EDuration="1.774181818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:43:28.770201633 +0000 UTC m=+2400.775725001" watchObservedRunningTime="2026-07-29 21:43:28.774181818 +0000 UTC m=+2400.779705192"
Jul 29 21:43:29.654622 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:29.654588    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:29.659164 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:29.659142    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:29.753578 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:29.753551    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:29.754252 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:29.754233    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:30.746846 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:30.746810    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:30.837981 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:30.837937    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:31.877955 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:31.877924    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:31.977555 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:31.977519    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:32.529675 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:32.529645    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:32.628037 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:32.628009    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:43:38.819246 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:38.819210    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:43:45.794587 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:45.794549    2575 patch_prober.go:28] interesting pod/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 21:43:45.795088 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:45.794633    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb" podUID="c9cf4e5a-fdd5-43b0-87a4-d065010176ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 21:43:46.844120 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:46.844088    2575 generic.go:356] "Generic (PLEG): container finished" podID="c9cf4e5a-fdd5-43b0-87a4-d065010176ce" containerID="767af7f5460156b84ba805ff3b54c8b94a0ba97c66658e6a8405f6953b582a96" exitCode=0
Jul 29 21:43:46.844500 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:46.844159    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb" event={"ID":"c9cf4e5a-fdd5-43b0-87a4-d065010176ce","Type":"ContainerDied","Data":"767af7f5460156b84ba805ff3b54c8b94a0ba97c66658e6a8405f6953b582a96"}
Jul 29 21:43:46.844618 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:46.844601    2575 scope.go:117] "RemoveContainer" containerID="767af7f5460156b84ba805ff3b54c8b94a0ba97c66658e6a8405f6953b582a96"
Jul 29 21:43:46.845676 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:46.845648    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:43:46.845779 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:46.845713    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:43:46.845779 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:46.845744    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:43:47.857612 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:47.857576    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb" event={"ID":"c9cf4e5a-fdd5-43b0-87a4-d065010176ce","Type":"ContainerStarted","Data":"d3fe279f7a9d81453c167219fdee7094bac56bff47fb9ded575fc2f724cfea7f"}
Jul 29 21:43:48.654877 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:48.654835    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:48.655251 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:48.655222    2575 patch_prober.go:28] interesting pod/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 29 21:43:48.655468 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:48.655426    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb" podUID="c9cf4e5a-fdd5-43b0-87a4-d065010176ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 29 21:43:49.655160 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:49.655117    2575 patch_prober.go:28] interesting pod/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 29 21:43:49.655678 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:49.655183    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb" podUID="c9cf4e5a-fdd5-43b0-87a4-d065010176ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 29 21:43:50.655292 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:50.655205    2575 patch_prober.go:28] interesting pod/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 29 21:43:50.655857 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:50.655825    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb" podUID="c9cf4e5a-fdd5-43b0-87a4-d065010176ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 29 21:43:51.657641 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:51.657608    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:51.658116 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:51.658007    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:51.658747 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:51.658723    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:43:55.813963 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:43:55.813913    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:44:14.231080 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:14.231046    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:44:17.319029 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:17.318991    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:44:28.625146 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:28.625100    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:44:44.798060 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.798022    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"]
Jul 29 21:44:44.801670 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.801651    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.804615 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.804592    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8cd3f9\"/\"kube-root-ca.crt\""
Jul 29 21:44:44.804770 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.804753    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8cd3f9\"/\"default-dockercfg-4m4hd\""
Jul 29 21:44:44.806117 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.806098    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8cd3f9\"/\"test-model-8cd3f9-kserve-self-signed-certs\""
Jul 29 21:44:44.806221 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.806129    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8cd3f9\"/\"openshift-service-ca.crt\""
Jul 29 21:44:44.812680 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.812659    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"]
Jul 29 21:44:44.825088 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.825059    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:44:44.885389 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.885363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/705fd0dd-407e-454e-b08e-5a0f6555ee73-tls-certs\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.885504 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.885403    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-tmp-dir\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.885504 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.885439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-model-cache\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.885504 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.885495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-274wx\" (UniqueName: \"kubernetes.io/projected/705fd0dd-407e-454e-b08e-5a0f6555ee73-kube-api-access-274wx\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.885631 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.885550    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-home\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.885631 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.885590    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-dshm\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.986797 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.986760    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-dshm\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.986960 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.986848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/705fd0dd-407e-454e-b08e-5a0f6555ee73-tls-certs\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.986960 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.986888    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-tmp-dir\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.986960 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.986929    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-model-cache\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.987084 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.986973    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-274wx\" (UniqueName: \"kubernetes.io/projected/705fd0dd-407e-454e-b08e-5a0f6555ee73-kube-api-access-274wx\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.987169 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.987139    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-home\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.987307 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.987283    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-tmp-dir\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.987429 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.987351    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-model-cache\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.987520 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.987492    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-home\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.989141 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.989121    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-dshm\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.989406 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.989390    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/705fd0dd-407e-454e-b08e-5a0f6555ee73-tls-certs\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:44.995917 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:44.995894    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-274wx\" (UniqueName: \"kubernetes.io/projected/705fd0dd-407e-454e-b08e-5a0f6555ee73-kube-api-access-274wx\") pod \"test-model-8cd3f9-kserve-67548b8b75-x29b6\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") " pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:45.111720 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:45.111644    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:45.246016 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:45.245842    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"]
Jul 29 21:44:45.248965 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:44:45.248922    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod705fd0dd_407e_454e_b08e_5a0f6555ee73.slice/crio-c04f6e68558f49b70b2ce42de5d2a6f7db2dbf270a1a3e5891027122f1b10f08 WatchSource:0}: Error finding container c04f6e68558f49b70b2ce42de5d2a6f7db2dbf270a1a3e5891027122f1b10f08: Status 404 returned error can't find the container with id c04f6e68558f49b70b2ce42de5d2a6f7db2dbf270a1a3e5891027122f1b10f08
Jul 29 21:44:46.158613 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:46.158576    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6" event={"ID":"705fd0dd-407e-454e-b08e-5a0f6555ee73","Type":"ContainerStarted","Data":"eff2b8f20e9208e9b8d1b566b4081f1df3112d107eb8a8d249f70412d994cf1a"}
Jul 29 21:44:46.158613 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:46.158618    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6" event={"ID":"705fd0dd-407e-454e-b08e-5a0f6555ee73","Type":"ContainerStarted","Data":"c04f6e68558f49b70b2ce42de5d2a6f7db2dbf270a1a3e5891027122f1b10f08"}
Jul 29 21:44:46.179669 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:46.179363    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6" podStartSLOduration=2.179344748 podStartE2EDuration="2.179344748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:44:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:44:46.175189194 +0000 UTC m=+2478.180712579" watchObservedRunningTime="2026-07-29 21:44:46.179344748 +0000 UTC m=+2478.184868117"
Jul 29 21:44:49.518246 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:49.518212    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:44:55.111934 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:55.111899    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:55.112324 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:55.111950    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:55.124397 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:55.124372    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:44:55.214332 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:44:55.214301    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:45:00.130685 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:00.130649    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-69c0f1-29756025-vsdrs"]
Jul 29 21:45:00.134407 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:00.134387    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-69c0f1-29756025-vsdrs"
Jul 29 21:45:00.137243 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:00.137212    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8cd3f9-29756025-vkswm"]
Jul 29 21:45:00.137359 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:00.137297    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9wjvq\""
Jul 29 21:45:00.140612 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:00.140591    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756025-q7hfk"]
Jul 29 21:45:00.140729 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:00.140697    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8cd3f9-29756025-vkswm"
Jul 29 21:45:00.144598 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:00.144577    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756025-q7hfk"
Jul 29 21:45:00.144880 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:00.144860    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-69c0f1-29756025-vsdrs"]
Jul 29 21:45:00.146581 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:00.146559    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-69c0f1-29756025-vsdrs"
Jul 29 21:45:00.149397 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:00.149310    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756025-q7hfk"]
Jul 29 21:45:00.152101 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:00.152078    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8cd3f9-29756025-vkswm"]
Jul 29 21:45:00.157580 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:00.157558    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8cd3f9-29756025-vkswm"
Jul 29 21:45:00.196412 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:00.196385    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756025-q7hfk"
Jul 29 21:45:00.309535 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:00.309502    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-69c0f1-29756025-vsdrs"]
Jul 29 21:45:00.314779 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:45:00.314744    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82475316_ed85_4eb7_a535_2751f2512c8b.slice/crio-bd427737d07ec2e8afc54a521cba1254c1a3825287c0c00334e59558fa29e4d4 WatchSource:0}: Error finding container bd427737d07ec2e8afc54a521cba1254c1a3825287c0c00334e59558fa29e4d4: Status 404 returned error can't find the container with id bd427737d07ec2e8afc54a521cba1254c1a3825287c0c00334e59558fa29e4d4
Jul 29 21:45:00.338114 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:00.338087    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8cd3f9-29756025-vkswm"]
Jul 29 21:45:00.348730 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:45:00.348700    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f440090_7928_4e70_94c2_c7a9a17817e0.slice/crio-a4e61e877642bf76952caa61791613e673b275f7084fd87b459df95fd3c8d8aa WatchSource:0}: Error finding container a4e61e877642bf76952caa61791613e673b275f7084fd87b459df95fd3c8d8aa: Status 404 returned error can't find the container with id a4e61e877642bf76952caa61791613e673b275f7084fd87b459df95fd3c8d8aa
Jul 29 21:45:00.371137 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:00.371117    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756025-q7hfk"]
Jul 29 21:45:00.372075 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:45:00.372050    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dddc6c8_e115_4fdb_842a_a4eb9fdef159.slice/crio-c373ce22d51303e895a26b2c2a550fb3a6e7414655ec2716074c136a12120119 WatchSource:0}: Error finding container c373ce22d51303e895a26b2c2a550fb3a6e7414655ec2716074c136a12120119: Status 404 returned error can't find the container with id c373ce22d51303e895a26b2c2a550fb3a6e7414655ec2716074c136a12120119
Jul 29 21:45:01.245955 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:01.245920    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756025-q7hfk" event={"ID":"4dddc6c8-e115-4fdb-842a-a4eb9fdef159","Type":"ContainerStarted","Data":"8697653e93c9057e6899b000c773c1f051a6927a59858dc732eb39cd13292234"}
Jul 29 21:45:01.246417 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:01.246017    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756025-q7hfk" event={"ID":"4dddc6c8-e115-4fdb-842a-a4eb9fdef159","Type":"ContainerStarted","Data":"c373ce22d51303e895a26b2c2a550fb3a6e7414655ec2716074c136a12120119"}
Jul 29 21:45:01.247783 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:01.247750    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8cd3f9-29756025-vkswm" event={"ID":"9f440090-7928-4e70-94c2-c7a9a17817e0","Type":"ContainerStarted","Data":"eed11a4fcc458e19c4cc3cc99462003c62b661f1e58b14f551793c8c15b69438"}
Jul 29 21:45:01.247902 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:01.247807    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8cd3f9-29756025-vkswm" event={"ID":"9f440090-7928-4e70-94c2-c7a9a17817e0","Type":"ContainerStarted","Data":"a4e61e877642bf76952caa61791613e673b275f7084fd87b459df95fd3c8d8aa"}
Jul 29 21:45:01.249312 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:01.249289    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-69c0f1-29756025-vsdrs" event={"ID":"82475316-ed85-4eb7-a535-2751f2512c8b","Type":"ContainerStarted","Data":"6a6075f118d4356a4a61ee40e32277b2e48b09f48100879a9157f260884d4b51"}
Jul 29 21:45:01.249410 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:01.249333    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-69c0f1-29756025-vsdrs" event={"ID":"82475316-ed85-4eb7-a535-2751f2512c8b","Type":"ContainerStarted","Data":"bd427737d07ec2e8afc54a521cba1254c1a3825287c0c00334e59558fa29e4d4"}
Jul 29 21:45:01.277090 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:01.277050    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8cd3f9-29756025-vkswm" podStartSLOduration=1.277036891 podStartE2EDuration="1.277036891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:45:01.276299201 +0000 UTC m=+2493.281822570" watchObservedRunningTime="2026-07-29 21:45:01.277036891 +0000 UTC m=+2493.282560258"
Jul 29 21:45:01.278230 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:01.278201    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756025-q7hfk" podStartSLOduration=1.278192639 podStartE2EDuration="1.278192639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:45:01.261060992 +0000 UTC m=+2493.266584360" watchObservedRunningTime="2026-07-29 21:45:01.278192639 +0000 UTC m=+2493.283716004"
Jul 29 21:45:01.294671 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:01.294624    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-69c0f1-29756025-vsdrs" podStartSLOduration=1.294609932 podStartE2EDuration="1.294609932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:45:01.293709791 +0000 UTC m=+2493.299233160" watchObservedRunningTime="2026-07-29 21:45:01.294609932 +0000 UTC m=+2493.300133299"
Jul 29 21:45:02.255977 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:02.255941    2575 generic.go:356] "Generic (PLEG): container finished" podID="82475316-ed85-4eb7-a535-2751f2512c8b" containerID="6a6075f118d4356a4a61ee40e32277b2e48b09f48100879a9157f260884d4b51" exitCode=0
Jul 29 21:45:02.256413 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:02.256025    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-69c0f1-29756025-vsdrs" event={"ID":"82475316-ed85-4eb7-a535-2751f2512c8b","Type":"ContainerDied","Data":"6a6075f118d4356a4a61ee40e32277b2e48b09f48100879a9157f260884d4b51"}
Jul 29 21:45:02.257408 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:02.257386    2575 generic.go:356] "Generic (PLEG): container finished" podID="4dddc6c8-e115-4fdb-842a-a4eb9fdef159" containerID="8697653e93c9057e6899b000c773c1f051a6927a59858dc732eb39cd13292234" exitCode=0
Jul 29 21:45:02.257526 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:02.257415    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756025-q7hfk" event={"ID":"4dddc6c8-e115-4fdb-842a-a4eb9fdef159","Type":"ContainerDied","Data":"8697653e93c9057e6899b000c773c1f051a6927a59858dc732eb39cd13292234"}
Jul 29 21:45:02.258738 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:02.258718    2575 generic.go:356] "Generic (PLEG): container finished" podID="9f440090-7928-4e70-94c2-c7a9a17817e0" containerID="eed11a4fcc458e19c4cc3cc99462003c62b661f1e58b14f551793c8c15b69438" exitCode=0
Jul 29 21:45:02.258834 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:02.258738    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8cd3f9-29756025-vkswm" event={"ID":"9f440090-7928-4e70-94c2-c7a9a17817e0","Type":"ContainerDied","Data":"eed11a4fcc458e19c4cc3cc99462003c62b661f1e58b14f551793c8c15b69438"}
Jul 29 21:45:03.011279 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:03.011251    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:45:03.217024 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:03.216983    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:45:03.416238 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:03.416208    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756025-q7hfk"
Jul 29 21:45:03.472078 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:03.472058    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8cd3f9-29756025-vkswm"
Jul 29 21:45:03.475244 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:03.475223    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-69c0f1-29756025-vsdrs"
Jul 29 21:45:04.271006 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:04.270973    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756025-q7hfk"
Jul 29 21:45:04.271006 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:04.270979    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756025-q7hfk" event={"ID":"4dddc6c8-e115-4fdb-842a-a4eb9fdef159","Type":"ContainerDied","Data":"c373ce22d51303e895a26b2c2a550fb3a6e7414655ec2716074c136a12120119"}
Jul 29 21:45:04.271219 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:04.271023    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c373ce22d51303e895a26b2c2a550fb3a6e7414655ec2716074c136a12120119"
Jul 29 21:45:04.272259 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:04.272241    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8cd3f9-29756025-vkswm"
Jul 29 21:45:04.272375 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:04.272289    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8cd3f9-29756025-vkswm" event={"ID":"9f440090-7928-4e70-94c2-c7a9a17817e0","Type":"ContainerDied","Data":"a4e61e877642bf76952caa61791613e673b275f7084fd87b459df95fd3c8d8aa"}
Jul 29 21:45:04.272375 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:04.272332    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4e61e877642bf76952caa61791613e673b275f7084fd87b459df95fd3c8d8aa"
Jul 29 21:45:04.273645 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:04.273623    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-69c0f1-29756025-vsdrs"
Jul 29 21:45:04.273645 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:04.273631    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-69c0f1-29756025-vsdrs" event={"ID":"82475316-ed85-4eb7-a535-2751f2512c8b","Type":"ContainerDied","Data":"bd427737d07ec2e8afc54a521cba1254c1a3825287c0c00334e59558fa29e4d4"}
Jul 29 21:45:04.273775 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:04.273667    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd427737d07ec2e8afc54a521cba1254c1a3825287c0c00334e59558fa29e4d4"
Jul 29 21:45:26.135104 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:26.135065    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:45:27.062095 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.062063    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"]
Jul 29 21:45:27.082604 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.082573    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:45:27.217789 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.217757    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v"]
Jul 29 21:45:27.218195 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.218180    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dddc6c8-e115-4fdb-842a-a4eb9fdef159" containerName="cleanup"
Jul 29 21:45:27.218195 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.218196    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dddc6c8-e115-4fdb-842a-a4eb9fdef159" containerName="cleanup"
Jul 29 21:45:27.218271 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.218207    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f440090-7928-4e70-94c2-c7a9a17817e0" containerName="cleanup"
Jul 29 21:45:27.218271 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.218213    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f440090-7928-4e70-94c2-c7a9a17817e0" containerName="cleanup"
Jul 29 21:45:27.218271 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.218236    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82475316-ed85-4eb7-a535-2751f2512c8b" containerName="cleanup"
Jul 29 21:45:27.218271 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.218242    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="82475316-ed85-4eb7-a535-2751f2512c8b" containerName="cleanup"
Jul 29 21:45:27.218393 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.218308    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dddc6c8-e115-4fdb-842a-a4eb9fdef159" containerName="cleanup"
Jul 29 21:45:27.218393 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.218315    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f440090-7928-4e70-94c2-c7a9a17817e0" containerName="cleanup"
Jul 29 21:45:27.218393 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.218325    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="82475316-ed85-4eb7-a535-2751f2512c8b" containerName="cleanup"
Jul 29 21:45:27.221579 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.221562    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v"
Jul 29 21:45:27.224289 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.224271    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 21:45:27.224433 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.224407    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9wjvq\""
Jul 29 21:45:27.228678 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.228622    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v"]
Jul 29 21:45:27.365252 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.365177    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7063a5d7-bec7-456b-b67d-a23c0ced09b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v\" (UID: \"7063a5d7-bec7-456b-b67d-a23c0ced09b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v"
Jul 29 21:45:27.466550 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.466521    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7063a5d7-bec7-456b-b67d-a23c0ced09b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v\" (UID: \"7063a5d7-bec7-456b-b67d-a23c0ced09b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v"
Jul 29 21:45:27.467093 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.467073    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7063a5d7-bec7-456b-b67d-a23c0ced09b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v\" (UID: \"7063a5d7-bec7-456b-b67d-a23c0ced09b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v"
Jul 29 21:45:27.533745 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.533720    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v"
Jul 29 21:45:27.872671 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:27.872642    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v"]
Jul 29 21:45:27.873915 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:45:27.873892    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7063a5d7_bec7_456b_b67d_a23c0ced09b2.slice/crio-96984913385cf445ce15528ca38a8517dae9a6009500d5e4063ee2d0879d803a WatchSource:0}: Error finding container 96984913385cf445ce15528ca38a8517dae9a6009500d5e4063ee2d0879d803a: Status 404 returned error can't find the container with id 96984913385cf445ce15528ca38a8517dae9a6009500d5e4063ee2d0879d803a
Jul 29 21:45:28.407353 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:28.407272    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v" event={"ID":"7063a5d7-bec7-456b-b67d-a23c0ced09b2","Type":"ContainerStarted","Data":"235ece25bdeee24847be3b9f4e766557d3fcc50823f1fe0a352742301666ab2c"}
Jul 29 21:45:28.407353 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:28.407332    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v" event={"ID":"7063a5d7-bec7-456b-b67d-a23c0ced09b2","Type":"ContainerStarted","Data":"96984913385cf445ce15528ca38a8517dae9a6009500d5e4063ee2d0879d803a"}
Jul 29 21:45:28.423032 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:28.422989    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v" podStartSLOduration=1.422974454 podStartE2EDuration="1.422974454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:45:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:45:28.422128002 +0000 UTC m=+2520.427651370" watchObservedRunningTime="2026-07-29 21:45:28.422974454 +0000 UTC m=+2520.428497821"
Jul 29 21:45:28.722920 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:28.722850    2575 scope.go:117] "RemoveContainer" containerID="91c08d8314d828b245e296bc1591c6e135b4a128404151d2a1427f9f7bb127b9"
Jul 29 21:45:29.414345 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:29.414313    2575 generic.go:356] "Generic (PLEG): container finished" podID="7063a5d7-bec7-456b-b67d-a23c0ced09b2" containerID="235ece25bdeee24847be3b9f4e766557d3fcc50823f1fe0a352742301666ab2c" exitCode=0
Jul 29 21:45:29.414725 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:29.414401    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v" event={"ID":"7063a5d7-bec7-456b-b67d-a23c0ced09b2","Type":"ContainerDied","Data":"235ece25bdeee24847be3b9f4e766557d3fcc50823f1fe0a352742301666ab2c"}
Jul 29 21:45:30.557747 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:30.557720    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v"
Jul 29 21:45:30.695291 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:30.695224    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7063a5d7-bec7-456b-b67d-a23c0ced09b2-maas-api-service-ca\") pod \"7063a5d7-bec7-456b-b67d-a23c0ced09b2\" (UID: \"7063a5d7-bec7-456b-b67d-a23c0ced09b2\") "
Jul 29 21:45:30.695622 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:30.695601    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7063a5d7-bec7-456b-b67d-a23c0ced09b2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7063a5d7-bec7-456b-b67d-a23c0ced09b2" (UID: "7063a5d7-bec7-456b-b67d-a23c0ced09b2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:45:30.796285 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:30.796260    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7063a5d7-bec7-456b-b67d-a23c0ced09b2-maas-api-service-ca\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:31.427357 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:31.427328    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v"
Jul 29 21:45:31.427549 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:31.427330    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v" event={"ID":"7063a5d7-bec7-456b-b67d-a23c0ced09b2","Type":"ContainerDied","Data":"96984913385cf445ce15528ca38a8517dae9a6009500d5e4063ee2d0879d803a"}
Jul 29 21:45:31.427549 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:31.427459    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96984913385cf445ce15528ca38a8517dae9a6009500d5e4063ee2d0879d803a"
Jul 29 21:45:33.912303 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:33.912269    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:45:37.684984 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:37.684953    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-69c0f1-29756025-vsdrs"]
Jul 29 21:45:37.688293 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:37.688267    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-69c0f1-29756025-vsdrs"]
Jul 29 21:45:37.694844 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:37.694811    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:45:37.779412 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:37.779383    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:45:37.882757 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:37.882726    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:45:37.896607 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:37.896575    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v"]
Jul 29 21:45:37.900478 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:37.900438    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-69c0f1-bds7v"]
Jul 29 21:45:38.330366 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:38.330334    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:45:38.482787 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:38.482756    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7063a5d7-bec7-456b-b67d-a23c0ced09b2" path="/var/lib/kubelet/pods/7063a5d7-bec7-456b-b67d-a23c0ced09b2/volumes"
Jul 29 21:45:38.483077 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:38.483063    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82475316-ed85-4eb7-a535-2751f2512c8b" path="/var/lib/kubelet/pods/82475316-ed85-4eb7-a535-2751f2512c8b/volumes"
Jul 29 21:45:42.080632 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.080592    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6" podUID="705fd0dd-407e-454e-b08e-5a0f6555ee73" containerName="main" containerID="cri-o://eff2b8f20e9208e9b8d1b566b4081f1df3112d107eb8a8d249f70412d994cf1a" gracePeriod=45
Jul 29 21:45:42.221592 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.221562    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:45:42.340848 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.340792    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:45:42.486635 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.486604    2575 generic.go:356] "Generic (PLEG): container finished" podID="705fd0dd-407e-454e-b08e-5a0f6555ee73" containerID="eff2b8f20e9208e9b8d1b566b4081f1df3112d107eb8a8d249f70412d994cf1a" exitCode=0
Jul 29 21:45:42.486787 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.486648    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"
Jul 29 21:45:42.486787 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.486650    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6" event={"ID":"705fd0dd-407e-454e-b08e-5a0f6555ee73","Type":"ContainerDied","Data":"eff2b8f20e9208e9b8d1b566b4081f1df3112d107eb8a8d249f70412d994cf1a"}
Jul 29 21:45:42.486787 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.486745    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6" event={"ID":"705fd0dd-407e-454e-b08e-5a0f6555ee73","Type":"ContainerDied","Data":"c04f6e68558f49b70b2ce42de5d2a6f7db2dbf270a1a3e5891027122f1b10f08"}
Jul 29 21:45:42.486787 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.486767    2575 scope.go:117] "RemoveContainer" containerID="eff2b8f20e9208e9b8d1b566b4081f1df3112d107eb8a8d249f70412d994cf1a"
Jul 29 21:45:42.493424 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.493400    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-home\") pod \"705fd0dd-407e-454e-b08e-5a0f6555ee73\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") "
Jul 29 21:45:42.493559 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.493499    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-model-cache\") pod \"705fd0dd-407e-454e-b08e-5a0f6555ee73\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") "
Jul 29 21:45:42.493559 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.493537    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-dshm\") pod \"705fd0dd-407e-454e-b08e-5a0f6555ee73\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") "
Jul 29 21:45:42.493638 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.493577    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-274wx\" (UniqueName: \"kubernetes.io/projected/705fd0dd-407e-454e-b08e-5a0f6555ee73-kube-api-access-274wx\") pod \"705fd0dd-407e-454e-b08e-5a0f6555ee73\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") "
Jul 29 21:45:42.493638 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.493597    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/705fd0dd-407e-454e-b08e-5a0f6555ee73-tls-certs\") pod \"705fd0dd-407e-454e-b08e-5a0f6555ee73\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") "
Jul 29 21:45:42.493638 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.493617    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-tmp-dir\") pod \"705fd0dd-407e-454e-b08e-5a0f6555ee73\" (UID: \"705fd0dd-407e-454e-b08e-5a0f6555ee73\") "
Jul 29 21:45:42.493774 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.493661    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-home" (OuterVolumeSpecName: "home") pod "705fd0dd-407e-454e-b08e-5a0f6555ee73" (UID: "705fd0dd-407e-454e-b08e-5a0f6555ee73"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:45:42.493948 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.493903    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-home\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:42.493948 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.493905    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-model-cache" (OuterVolumeSpecName: "model-cache") pod "705fd0dd-407e-454e-b08e-5a0f6555ee73" (UID: "705fd0dd-407e-454e-b08e-5a0f6555ee73"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:45:42.494102 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.494008    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "705fd0dd-407e-454e-b08e-5a0f6555ee73" (UID: "705fd0dd-407e-454e-b08e-5a0f6555ee73"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:45:42.495781 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.495757    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/705fd0dd-407e-454e-b08e-5a0f6555ee73-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "705fd0dd-407e-454e-b08e-5a0f6555ee73" (UID: "705fd0dd-407e-454e-b08e-5a0f6555ee73"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 21:45:42.495886 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.495803    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/705fd0dd-407e-454e-b08e-5a0f6555ee73-kube-api-access-274wx" (OuterVolumeSpecName: "kube-api-access-274wx") pod "705fd0dd-407e-454e-b08e-5a0f6555ee73" (UID: "705fd0dd-407e-454e-b08e-5a0f6555ee73"). InnerVolumeSpecName "kube-api-access-274wx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:45:42.496049 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.496034    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-dshm" (OuterVolumeSpecName: "dshm") pod "705fd0dd-407e-454e-b08e-5a0f6555ee73" (UID: "705fd0dd-407e-454e-b08e-5a0f6555ee73"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:45:42.496412 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.496397    2575 scope.go:117] "RemoveContainer" containerID="eff2b8f20e9208e9b8d1b566b4081f1df3112d107eb8a8d249f70412d994cf1a"
Jul 29 21:45:42.496733 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:45:42.496714    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eff2b8f20e9208e9b8d1b566b4081f1df3112d107eb8a8d249f70412d994cf1a\": container with ID starting with eff2b8f20e9208e9b8d1b566b4081f1df3112d107eb8a8d249f70412d994cf1a not found: ID does not exist" containerID="eff2b8f20e9208e9b8d1b566b4081f1df3112d107eb8a8d249f70412d994cf1a"
Jul 29 21:45:42.496807 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.496738    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eff2b8f20e9208e9b8d1b566b4081f1df3112d107eb8a8d249f70412d994cf1a"} err="failed to get container status \"eff2b8f20e9208e9b8d1b566b4081f1df3112d107eb8a8d249f70412d994cf1a\": rpc error: code = NotFound desc = could not find container \"eff2b8f20e9208e9b8d1b566b4081f1df3112d107eb8a8d249f70412d994cf1a\": container with ID starting with eff2b8f20e9208e9b8d1b566b4081f1df3112d107eb8a8d249f70412d994cf1a not found: ID does not exist"
Jul 29 21:45:42.594904 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.594855    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-model-cache\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:42.594904 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.594873    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-dshm\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:42.594904 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.594882    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-274wx\" (UniqueName: \"kubernetes.io/projected/705fd0dd-407e-454e-b08e-5a0f6555ee73-kube-api-access-274wx\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:42.594904 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.594890    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/705fd0dd-407e-454e-b08e-5a0f6555ee73-tls-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:42.594904 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.594900    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/705fd0dd-407e-454e-b08e-5a0f6555ee73-tmp-dir\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:42.809688 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.809656    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"]
Jul 29 21:45:42.815517 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:42.815491    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-8cd3f9/test-model-8cd3f9-kserve-67548b8b75-x29b6"]
Jul 29 21:45:44.146914 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.146875    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:45:44.216954 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.216925    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:45:44.483623 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.483532    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="705fd0dd-407e-454e-b08e-5a0f6555ee73" path="/var/lib/kubelet/pods/705fd0dd-407e-454e-b08e-5a0f6555ee73/volumes"
Jul 29 21:45:44.501262 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.501233    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"]
Jul 29 21:45:44.501494 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.501458    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc" podUID="94a7613f-ba91-4bd9-a6b2-94f445360416" containerName="istio-proxy" containerID="cri-o://89d7fad7a743c728379e903fac5cd65cc4f515363430c75a9ebb9264e8f1578a" gracePeriod=30
Jul 29 21:45:44.516436 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.516414    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:45:44.749226 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.749143    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:45:44.879148 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.879119    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx"]
Jul 29 21:45:44.879535 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.879522    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="705fd0dd-407e-454e-b08e-5a0f6555ee73" containerName="main"
Jul 29 21:45:44.879584 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.879536    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="705fd0dd-407e-454e-b08e-5a0f6555ee73" containerName="main"
Jul 29 21:45:44.879584 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.879554    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7063a5d7-bec7-456b-b67d-a23c0ced09b2" containerName="revoke-keys"
Jul 29 21:45:44.879584 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.879560    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7063a5d7-bec7-456b-b67d-a23c0ced09b2" containerName="revoke-keys"
Jul 29 21:45:44.879683 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.879630    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7063a5d7-bec7-456b-b67d-a23c0ced09b2" containerName="revoke-keys"
Jul 29 21:45:44.879683 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.879640    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="705fd0dd-407e-454e-b08e-5a0f6555ee73" containerName="main"
Jul 29 21:45:44.882805 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.882790    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx"
Jul 29 21:45:44.885406 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.885387    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 21:45:44.885406 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.885395    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9wjvq\""
Jul 29 21:45:44.891325 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:44.891286    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx"]
Jul 29 21:45:45.017664 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:45.017593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a473a3a-fbe5-436b-be2f-669c5e647387-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx\" (UID: \"6a473a3a-fbe5-436b-be2f-669c5e647387\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx"
Jul 29 21:45:45.118118 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:45.118089    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a473a3a-fbe5-436b-be2f-669c5e647387-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx\" (UID: \"6a473a3a-fbe5-436b-be2f-669c5e647387\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx"
Jul 29 21:45:45.118698 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:45.118680    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a473a3a-fbe5-436b-be2f-669c5e647387-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx\" (UID: \"6a473a3a-fbe5-436b-be2f-669c5e647387\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx"
Jul 29 21:45:45.195377 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:45.195347    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx"
Jul 29 21:45:45.533909 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:45.533883    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx"]
Jul 29 21:45:45.535968 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:45:45.535941    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a473a3a_fbe5_436b_be2f_669c5e647387.slice/crio-9844cc8f18a230124e1fb12169a2e49ceebce73b51038b24331577784305ee13 WatchSource:0}: Error finding container 9844cc8f18a230124e1fb12169a2e49ceebce73b51038b24331577784305ee13: Status 404 returned error can't find the container with id 9844cc8f18a230124e1fb12169a2e49ceebce73b51038b24331577784305ee13
Jul 29 21:45:46.509465 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:46.509367    2575 generic.go:356] "Generic (PLEG): container finished" podID="6a473a3a-fbe5-436b-be2f-669c5e647387" containerID="e557fbea26eb379aba7599d286839e6da70ae59b1df5eb2a9a94361715b342e7" exitCode=0
Jul 29 21:45:46.509816 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:46.509470    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx" event={"ID":"6a473a3a-fbe5-436b-be2f-669c5e647387","Type":"ContainerDied","Data":"e557fbea26eb379aba7599d286839e6da70ae59b1df5eb2a9a94361715b342e7"}
Jul 29 21:45:46.509816 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:46.509521    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx" event={"ID":"6a473a3a-fbe5-436b-be2f-669c5e647387","Type":"ContainerStarted","Data":"9844cc8f18a230124e1fb12169a2e49ceebce73b51038b24331577784305ee13"}
Jul 29 21:45:47.646859 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:47.646833    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx"
Jul 29 21:45:47.744696 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:47.744667    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a473a3a-fbe5-436b-be2f-669c5e647387-maas-api-service-ca\") pod \"6a473a3a-fbe5-436b-be2f-669c5e647387\" (UID: \"6a473a3a-fbe5-436b-be2f-669c5e647387\") "
Jul 29 21:45:47.744991 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:47.744970    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a473a3a-fbe5-436b-be2f-669c5e647387-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6a473a3a-fbe5-436b-be2f-669c5e647387" (UID: "6a473a3a-fbe5-436b-be2f-669c5e647387"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:45:47.845576 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:47.845545    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a473a3a-fbe5-436b-be2f-669c5e647387-maas-api-service-ca\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:48.521437 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:48.521404    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx" event={"ID":"6a473a3a-fbe5-436b-be2f-669c5e647387","Type":"ContainerDied","Data":"9844cc8f18a230124e1fb12169a2e49ceebce73b51038b24331577784305ee13"}
Jul 29 21:45:48.521437 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:48.521435    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx"
Jul 29 21:45:48.521623 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:48.521479    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9844cc8f18a230124e1fb12169a2e49ceebce73b51038b24331577784305ee13"
Jul 29 21:45:49.758536 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.758512    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:45:49.863526 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.863490    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-token\") pod \"94a7613f-ba91-4bd9-a6b2-94f445360416\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") "
Jul 29 21:45:49.863722 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.863567    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-credential-socket\") pod \"94a7613f-ba91-4bd9-a6b2-94f445360416\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") "
Jul 29 21:45:49.863722 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.863597    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-workload-certs\") pod \"94a7613f-ba91-4bd9-a6b2-94f445360416\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") "
Jul 29 21:45:49.863722 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.863626    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-envoy\") pod \"94a7613f-ba91-4bd9-a6b2-94f445360416\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") "
Jul 29 21:45:49.863722 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.863670    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7rh4\" (UniqueName: \"kubernetes.io/projected/94a7613f-ba91-4bd9-a6b2-94f445360416-kube-api-access-h7rh4\") pod \"94a7613f-ba91-4bd9-a6b2-94f445360416\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") "
Jul 29 21:45:49.863722 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.863690    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-data\") pod \"94a7613f-ba91-4bd9-a6b2-94f445360416\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") "
Jul 29 21:45:49.863722 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.863712    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-workload-socket\") pod \"94a7613f-ba91-4bd9-a6b2-94f445360416\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") "
Jul 29 21:45:49.864031 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.863854    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-podinfo\") pod \"94a7613f-ba91-4bd9-a6b2-94f445360416\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") "
Jul 29 21:45:49.864031 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.863896    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94a7613f-ba91-4bd9-a6b2-94f445360416-istiod-ca-cert\") pod \"94a7613f-ba91-4bd9-a6b2-94f445360416\" (UID: \"94a7613f-ba91-4bd9-a6b2-94f445360416\") "
Jul 29 21:45:49.864031 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.863902    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94a7613f-ba91-4bd9-a6b2-94f445360416" (UID: "94a7613f-ba91-4bd9-a6b2-94f445360416"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:45:49.864031 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.863915    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94a7613f-ba91-4bd9-a6b2-94f445360416" (UID: "94a7613f-ba91-4bd9-a6b2-94f445360416"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:45:49.864289 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.864032    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94a7613f-ba91-4bd9-a6b2-94f445360416" (UID: "94a7613f-ba91-4bd9-a6b2-94f445360416"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:45:49.864289 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.864279    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-credential-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:49.864396 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.864300    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-workload-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:49.864396 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.864316    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-workload-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:49.864567 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.864400    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94a7613f-ba91-4bd9-a6b2-94f445360416-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94a7613f-ba91-4bd9-a6b2-94f445360416" (UID: "94a7613f-ba91-4bd9-a6b2-94f445360416"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:45:49.864829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.864809    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-data" (OuterVolumeSpecName: "istio-data") pod "94a7613f-ba91-4bd9-a6b2-94f445360416" (UID: "94a7613f-ba91-4bd9-a6b2-94f445360416"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:45:49.866012 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.865977    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94a7613f-ba91-4bd9-a6b2-94f445360416" (UID: "94a7613f-ba91-4bd9-a6b2-94f445360416"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:45:49.866110 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.866058    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94a7613f-ba91-4bd9-a6b2-94f445360416" (UID: "94a7613f-ba91-4bd9-a6b2-94f445360416"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:45:49.866216 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.866199    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-token" (OuterVolumeSpecName: "istio-token") pod "94a7613f-ba91-4bd9-a6b2-94f445360416" (UID: "94a7613f-ba91-4bd9-a6b2-94f445360416"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:45:49.866269 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.866243    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94a7613f-ba91-4bd9-a6b2-94f445360416-kube-api-access-h7rh4" (OuterVolumeSpecName: "kube-api-access-h7rh4") pod "94a7613f-ba91-4bd9-a6b2-94f445360416" (UID: "94a7613f-ba91-4bd9-a6b2-94f445360416"). InnerVolumeSpecName "kube-api-access-h7rh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:45:49.965688 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.965652    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94a7613f-ba91-4bd9-a6b2-94f445360416-istiod-ca-cert\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:49.965688 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.965682    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-token\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:49.965688 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.965694    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-envoy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:49.965898 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.965705    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7rh4\" (UniqueName: \"kubernetes.io/projected/94a7613f-ba91-4bd9-a6b2-94f445360416-kube-api-access-h7rh4\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:49.965898 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.965717    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-data\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:49.965898 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:49.965729    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94a7613f-ba91-4bd9-a6b2-94f445360416-istio-podinfo\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:45:50.534109 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:50.534079    2575 generic.go:356] "Generic (PLEG): container finished" podID="94a7613f-ba91-4bd9-a6b2-94f445360416" containerID="89d7fad7a743c728379e903fac5cd65cc4f515363430c75a9ebb9264e8f1578a" exitCode=0
Jul 29 21:45:50.534261 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:50.534135    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"
Jul 29 21:45:50.534261 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:50.534168    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc" event={"ID":"94a7613f-ba91-4bd9-a6b2-94f445360416","Type":"ContainerDied","Data":"89d7fad7a743c728379e903fac5cd65cc4f515363430c75a9ebb9264e8f1578a"}
Jul 29 21:45:50.534261 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:50.534225    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc" event={"ID":"94a7613f-ba91-4bd9-a6b2-94f445360416","Type":"ContainerDied","Data":"b401e9779daa95e1627ad68a5c9a421da6579184f6bc78b4ecfc71ba254664b2"}
Jul 29 21:45:50.534261 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:50.534248    2575 scope.go:117] "RemoveContainer" containerID="89d7fad7a743c728379e903fac5cd65cc4f515363430c75a9ebb9264e8f1578a"
Jul 29 21:45:50.543550 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:50.543533    2575 scope.go:117] "RemoveContainer" containerID="f06347cfa39e1ace2c520ba36e947ef04e4454fddc1907fa20869e667238da18"
Jul 29 21:45:50.551497 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:50.551481    2575 scope.go:117] "RemoveContainer" containerID="89d7fad7a743c728379e903fac5cd65cc4f515363430c75a9ebb9264e8f1578a"
Jul 29 21:45:50.551766 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:45:50.551749    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89d7fad7a743c728379e903fac5cd65cc4f515363430c75a9ebb9264e8f1578a\": container with ID starting with 89d7fad7a743c728379e903fac5cd65cc4f515363430c75a9ebb9264e8f1578a not found: ID does not exist" containerID="89d7fad7a743c728379e903fac5cd65cc4f515363430c75a9ebb9264e8f1578a"
Jul 29 21:45:50.551816 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:50.551773    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d7fad7a743c728379e903fac5cd65cc4f515363430c75a9ebb9264e8f1578a"} err="failed to get container status \"89d7fad7a743c728379e903fac5cd65cc4f515363430c75a9ebb9264e8f1578a\": rpc error: code = NotFound desc = could not find container \"89d7fad7a743c728379e903fac5cd65cc4f515363430c75a9ebb9264e8f1578a\": container with ID starting with 89d7fad7a743c728379e903fac5cd65cc4f515363430c75a9ebb9264e8f1578a not found: ID does not exist"
Jul 29 21:45:50.551816 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:50.551788    2575 scope.go:117] "RemoveContainer" containerID="f06347cfa39e1ace2c520ba36e947ef04e4454fddc1907fa20869e667238da18"
Jul 29 21:45:50.552024 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:45:50.552009    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f06347cfa39e1ace2c520ba36e947ef04e4454fddc1907fa20869e667238da18\": container with ID starting with f06347cfa39e1ace2c520ba36e947ef04e4454fddc1907fa20869e667238da18 not found: ID does not exist" containerID="f06347cfa39e1ace2c520ba36e947ef04e4454fddc1907fa20869e667238da18"
Jul 29 21:45:50.552079 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:50.552026    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f06347cfa39e1ace2c520ba36e947ef04e4454fddc1907fa20869e667238da18"} err="failed to get container status \"f06347cfa39e1ace2c520ba36e947ef04e4454fddc1907fa20869e667238da18\": rpc error: code = NotFound desc = could not find container \"f06347cfa39e1ace2c520ba36e947ef04e4454fddc1907fa20869e667238da18\": container with ID starting with f06347cfa39e1ace2c520ba36e947ef04e4454fddc1907fa20869e667238da18 not found: ID does not exist"
Jul 29 21:45:50.555673 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:50.555650    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"]
Jul 29 21:45:50.560360 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:50.560335    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-69c0f1-openshift-default-7c7f476cd4-z9zqc"]
Jul 29 21:45:52.483066 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:52.483032    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94a7613f-ba91-4bd9-a6b2-94f445360416" path="/var/lib/kubelet/pods/94a7613f-ba91-4bd9-a6b2-94f445360416/volumes"
Jul 29 21:45:55.320106 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:55.320071    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:45:55.324466 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:55.324426    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8cd3f9-29756025-vkswm"]
Jul 29 21:45:55.326457 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:55.326416    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8cd3f9-29756025-vkswm"]
Jul 29 21:45:55.397865 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:55.397829    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:45:55.470766 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:55.470729    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:45:55.502142 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:55.502110    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx"]
Jul 29 21:45:55.504436 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:55.504413    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8cd3f9-6ccqx"]
Jul 29 21:45:55.582382 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:55.582264    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:45:55.913953 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:55.913869    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:45:56.482732 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:56.482700    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a473a3a-fbe5-436b-be2f-669c5e647387" path="/var/lib/kubelet/pods/6a473a3a-fbe5-436b-be2f-669c5e647387/volumes"
Jul 29 21:45:56.483105 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:56.482979    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f440090-7928-4e70-94c2-c7a9a17817e0" path="/var/lib/kubelet/pods/9f440090-7928-4e70-94c2-c7a9a17817e0/volumes"
Jul 29 21:45:58.720419 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:45:58.720384    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:46:02.199223 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:02.199183    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:02.325225 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:02.325189    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:02.463431 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:02.463350    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"]
Jul 29 21:46:02.463669 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:02.463642    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb" podUID="c9cf4e5a-fdd5-43b0-87a4-d065010176ce" containerName="istio-proxy" containerID="cri-o://d3fe279f7a9d81453c167219fdee7094bac56bff47fb9ded575fc2f724cfea7f" gracePeriod=30
Jul 29 21:46:02.480522 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:02.480491    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:02.748555 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:02.748462    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:03.135522 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.135487    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:03.456649 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.456566    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"]
Jul 29 21:46:03.457230 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.457214    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94a7613f-ba91-4bd9-a6b2-94f445360416" containerName="istio-proxy"
Jul 29 21:46:03.457273 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.457233    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="94a7613f-ba91-4bd9-a6b2-94f445360416" containerName="istio-proxy"
Jul 29 21:46:03.457273 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.457260    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94a7613f-ba91-4bd9-a6b2-94f445360416" containerName="istio-proxy"
Jul 29 21:46:03.457273 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.457268    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="94a7613f-ba91-4bd9-a6b2-94f445360416" containerName="istio-proxy"
Jul 29 21:46:03.457364 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.457279    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a473a3a-fbe5-436b-be2f-669c5e647387" containerName="revoke-keys"
Jul 29 21:46:03.457364 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.457289    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a473a3a-fbe5-436b-be2f-669c5e647387" containerName="revoke-keys"
Jul 29 21:46:03.457431 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.457381    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="94a7613f-ba91-4bd9-a6b2-94f445360416" containerName="istio-proxy"
Jul 29 21:46:03.457431 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.457393    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a473a3a-fbe5-436b-be2f-669c5e647387" containerName="revoke-keys"
Jul 29 21:46:03.457431 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.457402    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="94a7613f-ba91-4bd9-a6b2-94f445360416" containerName="istio-proxy"
Jul 29 21:46:03.462696 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.462678    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.466283 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.466255    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-6a8fa4-openshift-default-dockercfg-2vqz2\""
Jul 29 21:46:03.473837 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.473812    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"]
Jul 29 21:46:03.487516 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.487488    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-envoy\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.487627 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.487520    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-podinfo\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.487627 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.487555    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-credential-socket\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.487723 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.487671    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-data\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.487769 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.487726    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-workload-certs\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.487812 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.487784    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgbkf\" (UniqueName: \"kubernetes.io/projected/983565f1-66f4-4dc1-b5b3-1d132eb88229-kube-api-access-jgbkf\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.487866 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.487850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-workload-socket\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.487911 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.487877    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/983565f1-66f4-4dc1-b5b3-1d132eb88229-istiod-ca-cert\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.487947 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.487927    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-token\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.494154 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.494124    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:03.589339 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.589304    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-workload-socket\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.589339 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.589340    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/983565f1-66f4-4dc1-b5b3-1d132eb88229-istiod-ca-cert\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.589567 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.589499    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-token\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.589614 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.589584    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-envoy\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.589660 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.589614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-podinfo\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.589713 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.589656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-credential-socket\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.589772 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.589727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-data\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.589827 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.589771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-workload-certs\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.589827 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.589778    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-workload-socket\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.589827 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.589799    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgbkf\" (UniqueName: \"kubernetes.io/projected/983565f1-66f4-4dc1-b5b3-1d132eb88229-kube-api-access-jgbkf\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.590067 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.590025    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-workload-certs\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.590195 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.590100    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-data\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.590195 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.590130    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/983565f1-66f4-4dc1-b5b3-1d132eb88229-istiod-ca-cert\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.590302 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.590282    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-credential-socket\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.592516 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.592487    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-envoy\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.592637 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.592618    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-podinfo\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.598867 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.598845    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-token\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.599457 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.599417    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgbkf\" (UniqueName: \"kubernetes.io/projected/983565f1-66f4-4dc1-b5b3-1d132eb88229-kube-api-access-jgbkf\") pod \"e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") " pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.730499 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.730387    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:03.774094 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.774056    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:03.924146 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.924114    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"]
Jul 29 21:46:03.926537 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:46:03.926513    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod983565f1_66f4_4dc1_b5b3_1d132eb88229.slice/crio-d47e9937654b54ec4991757865c2d4fd7f8abcbc56d8c4bc9e9c811aed7a4d55 WatchSource:0}: Error finding container d47e9937654b54ec4991757865c2d4fd7f8abcbc56d8c4bc9e9c811aed7a4d55: Status 404 returned error can't find the container with id d47e9937654b54ec4991757865c2d4fd7f8abcbc56d8c4bc9e9c811aed7a4d55
Jul 29 21:46:03.929161 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.929129    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:46:03.929232 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.929188    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:46:03.929232 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:03.929218    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:46:04.609057 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:04.609014    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6" event={"ID":"983565f1-66f4-4dc1-b5b3-1d132eb88229","Type":"ContainerStarted","Data":"02f3f57f72ef41d83d4e0384262fc561bb71a8ef7385d92730230575f9130e6a"}
Jul 29 21:46:04.609563 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:04.609076    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6" event={"ID":"983565f1-66f4-4dc1-b5b3-1d132eb88229","Type":"ContainerStarted","Data":"d47e9937654b54ec4991757865c2d4fd7f8abcbc56d8c4bc9e9c811aed7a4d55"}
Jul 29 21:46:04.631038 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:04.630983    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6" podStartSLOduration=1.630965665 podStartE2EDuration="1.630965665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:46:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:46:04.629582552 +0000 UTC m=+2556.635105921" watchObservedRunningTime="2026-07-29 21:46:04.630965665 +0000 UTC m=+2556.636489032"
Jul 29 21:46:04.775013 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:04.774982    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:04.779769 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:04.779743    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:05.613882 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:05.613853    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:05.614870 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:05.614847    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:06.623905 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:06.623868    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:06.659741 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:06.659696    2575 patch_prober.go:28] interesting pod/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 21:46:06.659896 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:06.659779    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb" podUID="c9cf4e5a-fdd5-43b0-87a4-d065010176ce" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 21:46:06.779555 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:06.779515    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:07.627965 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.627921    2575 generic.go:356] "Generic (PLEG): container finished" podID="c9cf4e5a-fdd5-43b0-87a4-d065010176ce" containerID="d3fe279f7a9d81453c167219fdee7094bac56bff47fb9ded575fc2f724cfea7f" exitCode=0
Jul 29 21:46:07.628375 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.627987    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb" event={"ID":"c9cf4e5a-fdd5-43b0-87a4-d065010176ce","Type":"ContainerDied","Data":"d3fe279f7a9d81453c167219fdee7094bac56bff47fb9ded575fc2f724cfea7f"}
Jul 29 21:46:07.628375 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.628078    2575 scope.go:117] "RemoveContainer" containerID="767af7f5460156b84ba805ff3b54c8b94a0ba97c66658e6a8405f6953b582a96"
Jul 29 21:46:07.720659 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.720632    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:46:07.828306 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.828273    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-envoy\") pod \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") "
Jul 29 21:46:07.828504 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.828317    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-podinfo\") pod \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") "
Jul 29 21:46:07.828504 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.828338    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-token\") pod \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") "
Jul 29 21:46:07.828504 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.828372    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-workload-certs\") pod \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") "
Jul 29 21:46:07.828504 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.828407    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istiod-ca-cert\") pod \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") "
Jul 29 21:46:07.828504 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.828441    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-workload-socket\") pod \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") "
Jul 29 21:46:07.828771 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.828627    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzbk8\" (UniqueName: \"kubernetes.io/projected/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-kube-api-access-rzbk8\") pod \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") "
Jul 29 21:46:07.828771 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.828683    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-data\") pod \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") "
Jul 29 21:46:07.828771 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.828709    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-credential-socket\") pod \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\" (UID: \"c9cf4e5a-fdd5-43b0-87a4-d065010176ce\") "
Jul 29 21:46:07.828929 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.828839    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c9cf4e5a-fdd5-43b0-87a4-d065010176ce" (UID: "c9cf4e5a-fdd5-43b0-87a4-d065010176ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:46:07.828929 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.828880    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c9cf4e5a-fdd5-43b0-87a4-d065010176ce" (UID: "c9cf4e5a-fdd5-43b0-87a4-d065010176ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:46:07.829079 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.829056    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c9cf4e5a-fdd5-43b0-87a4-d065010176ce" (UID: "c9cf4e5a-fdd5-43b0-87a4-d065010176ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:46:07.829253 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.829229    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c9cf4e5a-fdd5-43b0-87a4-d065010176ce" (UID: "c9cf4e5a-fdd5-43b0-87a4-d065010176ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:46:07.829253 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.829246    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istiod-ca-cert\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:46:07.829387 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.829264    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-credential-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:46:07.829387 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.829278    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-workload-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:46:07.829737 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.829713    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "c9cf4e5a-fdd5-43b0-87a4-d065010176ce" (UID: "c9cf4e5a-fdd5-43b0-87a4-d065010176ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:46:07.830761 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.830733    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c9cf4e5a-fdd5-43b0-87a4-d065010176ce" (UID: "c9cf4e5a-fdd5-43b0-87a4-d065010176ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:46:07.830761 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.830755    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "c9cf4e5a-fdd5-43b0-87a4-d065010176ce" (UID: "c9cf4e5a-fdd5-43b0-87a4-d065010176ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:46:07.831297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.831269    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c9cf4e5a-fdd5-43b0-87a4-d065010176ce" (UID: "c9cf4e5a-fdd5-43b0-87a4-d065010176ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:46:07.831297 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.831281    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-kube-api-access-rzbk8" (OuterVolumeSpecName: "kube-api-access-rzbk8") pod "c9cf4e5a-fdd5-43b0-87a4-d065010176ce" (UID: "c9cf4e5a-fdd5-43b0-87a4-d065010176ce"). InnerVolumeSpecName "kube-api-access-rzbk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:46:07.919853 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.919816    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:07.929893 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.929867    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-workload-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:46:07.929893 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.929889    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzbk8\" (UniqueName: \"kubernetes.io/projected/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-kube-api-access-rzbk8\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:46:07.930051 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.929900    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-data\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:46:07.930051 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.929909    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-envoy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:46:07.930051 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.929916    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-podinfo\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:46:07.930051 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:07.929924    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cf4e5a-fdd5-43b0-87a4-d065010176ce-istio-token\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:46:08.116904 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:08.116815    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:08.400595 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:08.400505    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:08.500087 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:08.500050    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:08.638310 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:08.638275    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb" event={"ID":"c9cf4e5a-fdd5-43b0-87a4-d065010176ce","Type":"ContainerDied","Data":"c7680d8ecbb0d20b6b0f896e52139658125ea7b0f2a7edf579710774b1be1202"}
Jul 29 21:46:08.638807 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:08.638520    2575 scope.go:117] "RemoveContainer" containerID="d3fe279f7a9d81453c167219fdee7094bac56bff47fb9ded575fc2f724cfea7f"
Jul 29 21:46:08.638807 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:08.638424    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"
Jul 29 21:46:08.663694 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:08.663610    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"]
Jul 29 21:46:08.665465 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:08.665430    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-8cd3f9-openshift-default-78cc87cf8-d9rlb"]
Jul 29 21:46:10.483058 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:10.483024    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9cf4e5a-fdd5-43b0-87a4-d065010176ce" path="/var/lib/kubelet/pods/c9cf4e5a-fdd5-43b0-87a4-d065010176ce/volumes"
Jul 29 21:46:11.576209 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:11.576173    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:46:19.701007 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:19.700980    2575 generic.go:356] "Generic (PLEG): container finished" podID="983565f1-66f4-4dc1-b5b3-1d132eb88229" containerID="02f3f57f72ef41d83d4e0384262fc561bb71a8ef7385d92730230575f9130e6a" exitCode=0
Jul 29 21:46:19.701364 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:19.701037    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6" event={"ID":"983565f1-66f4-4dc1-b5b3-1d132eb88229","Type":"ContainerDied","Data":"02f3f57f72ef41d83d4e0384262fc561bb71a8ef7385d92730230575f9130e6a"}
Jul 29 21:46:19.701405 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:19.701396    2575 scope.go:117] "RemoveContainer" containerID="02f3f57f72ef41d83d4e0384262fc561bb71a8ef7385d92730230575f9130e6a"
Jul 29 21:46:19.702359 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:19.702334    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:46:19.702416 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:19.702396    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:46:19.702467 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:19.702427    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:46:20.613948 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:20.613910    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:20.708384 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:20.708353    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6" event={"ID":"983565f1-66f4-4dc1-b5b3-1d132eb88229","Type":"ContainerStarted","Data":"eeeaae2e8992779722181e8dd7ae06d21db5b3137b2f7553e807e68ec96d3368"}
Jul 29 21:46:20.774608 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:20.774571    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:20.775678 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:20.775653    2575 patch_prober.go:28] interesting pod/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 29 21:46:20.775819 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:20.775709    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6" podUID="983565f1-66f4-4dc1-b5b3-1d132eb88229" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 29 21:46:21.774973 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:21.774931    2575 patch_prober.go:28] interesting pod/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 29 21:46:21.775577 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:21.775002    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6" podUID="983565f1-66f4-4dc1-b5b3-1d132eb88229" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 29 21:46:22.774715 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:22.774674    2575 patch_prober.go:28] interesting pod/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 29 21:46:22.774919 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:22.774740    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6" podUID="983565f1-66f4-4dc1-b5b3-1d132eb88229" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 29 21:46:23.775121 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:23.775080    2575 patch_prober.go:28] interesting pod/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 29 21:46:23.775535 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:23.775143    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6" podUID="983565f1-66f4-4dc1-b5b3-1d132eb88229" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 29 21:46:24.778222 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:24.778190    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:24.778619 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:24.778474    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:24.779139 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:24.779118    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:46:31.731289 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:31.731240    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:32.220615 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.220573    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:32.522245 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.522161    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"]
Jul 29 21:46:32.522609 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.522594    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9cf4e5a-fdd5-43b0-87a4-d065010176ce" containerName="istio-proxy"
Jul 29 21:46:32.522666 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.522610    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9cf4e5a-fdd5-43b0-87a4-d065010176ce" containerName="istio-proxy"
Jul 29 21:46:32.522666 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.522620    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9cf4e5a-fdd5-43b0-87a4-d065010176ce" containerName="istio-proxy"
Jul 29 21:46:32.522666 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.522625    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9cf4e5a-fdd5-43b0-87a4-d065010176ce" containerName="istio-proxy"
Jul 29 21:46:32.522775 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.522691    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9cf4e5a-fdd5-43b0-87a4-d065010176ce" containerName="istio-proxy"
Jul 29 21:46:32.522775 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.522701    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9cf4e5a-fdd5-43b0-87a4-d065010176ce" containerName="istio-proxy"
Jul 29 21:46:32.527270 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.527253    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.530797 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.530776    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-881a99-openshift-default-dockercfg-xb528\""
Jul 29 21:46:32.554462 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.554419    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"]
Jul 29 21:46:32.569276 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.569246    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:32.672096 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.672060    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-data\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.672296 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.672101    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-workload-certs\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.672296 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.672140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfbv8\" (UniqueName: \"kubernetes.io/projected/3fe9b456-1da7-4ab5-88e6-e247118cacbc-kube-api-access-rfbv8\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.672296 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.672170    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-envoy\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.672296 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.672199    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istiod-ca-cert\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.672552 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.672295    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-podinfo\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.672552 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.672337    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-credential-socket\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.672552 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.672389    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-workload-socket\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.672552 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.672439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-token\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.774023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.773927    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-data\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.774023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.773962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-workload-certs\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.774023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.773988    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfbv8\" (UniqueName: \"kubernetes.io/projected/3fe9b456-1da7-4ab5-88e6-e247118cacbc-kube-api-access-rfbv8\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.774023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.774016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-envoy\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.774694 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.774056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istiod-ca-cert\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.774694 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.774187    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-podinfo\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.774694 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.774227    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-credential-socket\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.774694 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.774254    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-workload-socket\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.774694 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.774308    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-token\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.774694 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.774417    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-data\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.774694 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.774467    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-workload-certs\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.774694 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.774546    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-credential-socket\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.774694 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.774687    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-workload-socket\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.775022 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.774849    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istiod-ca-cert\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.776501 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.776481    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-envoy\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.776814 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.776794    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-podinfo\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.781755 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.781724    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-token\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.781860 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.781798    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfbv8\" (UniqueName: \"kubernetes.io/projected/3fe9b456-1da7-4ab5-88e6-e247118cacbc-kube-api-access-rfbv8\") pod \"e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") " pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.837913 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.837879    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:32.977920 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.977895    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"]
Jul 29 21:46:32.979487 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:46:32.979439    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fe9b456_1da7_4ab5_88e6_e247118cacbc.slice/crio-2fba851fd2e992e8b2e15c71df24111f5eb608d2470330e6b6a1a6a7f26f3922 WatchSource:0}: Error finding container 2fba851fd2e992e8b2e15c71df24111f5eb608d2470330e6b6a1a6a7f26f3922: Status 404 returned error can't find the container with id 2fba851fd2e992e8b2e15c71df24111f5eb608d2470330e6b6a1a6a7f26f3922
Jul 29 21:46:32.981728 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.981694    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:46:32.981829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.981757    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:46:32.981829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:32.981788    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:46:33.107392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:33.107353    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:33.779681 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:33.779649    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b" event={"ID":"3fe9b456-1da7-4ab5-88e6-e247118cacbc","Type":"ContainerStarted","Data":"be2bc5c8c84429775f02fc2ba67ee433861b0ba39192bd3c62e1818a3ecae5f0"}
Jul 29 21:46:33.780071 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:33.779708    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b" event={"ID":"3fe9b456-1da7-4ab5-88e6-e247118cacbc","Type":"ContainerStarted","Data":"2fba851fd2e992e8b2e15c71df24111f5eb608d2470330e6b6a1a6a7f26f3922"}
Jul 29 21:46:33.803831 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:33.803781    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b" podStartSLOduration=1.803765206 podStartE2EDuration="1.803765206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:46:33.801619781 +0000 UTC m=+2585.807143161" watchObservedRunningTime="2026-07-29 21:46:33.803765206 +0000 UTC m=+2585.809288574"
Jul 29 21:46:33.838268 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:33.838238    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:34.844101 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:34.844070    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:35.749196 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:35.749160    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:35.790211 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:35.790178    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:35.791189 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:35.791167    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:35.825180 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:35.825139    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:36.894337 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:36.894304    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:37.343910 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:37.343872    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:37.606330 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:37.606249    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:37.697493 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:37.697458    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:43.613574 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:43.613528    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:46:51.382753 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:51.381388    2575 patch_prober.go:28] interesting pod/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": read tcp 10.132.0.2:49158->10.132.0.63:15021: read: connection reset by peer" start-of-body=
Jul 29 21:46:51.382753 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:51.381470    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b" podUID="3fe9b456-1da7-4ab5-88e6-e247118cacbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": read tcp 10.132.0.2:49158->10.132.0.63:15021: read: connection reset by peer"
Jul 29 21:46:51.895816 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:51.895777    2575 generic.go:356] "Generic (PLEG): container finished" podID="3fe9b456-1da7-4ab5-88e6-e247118cacbc" containerID="be2bc5c8c84429775f02fc2ba67ee433861b0ba39192bd3c62e1818a3ecae5f0" exitCode=0
Jul 29 21:46:51.895989 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:51.895859    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b" event={"ID":"3fe9b456-1da7-4ab5-88e6-e247118cacbc","Type":"ContainerDied","Data":"be2bc5c8c84429775f02fc2ba67ee433861b0ba39192bd3c62e1818a3ecae5f0"}
Jul 29 21:46:51.896263 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:51.896250    2575 scope.go:117] "RemoveContainer" containerID="be2bc5c8c84429775f02fc2ba67ee433861b0ba39192bd3c62e1818a3ecae5f0"
Jul 29 21:46:51.897265 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:51.897239    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:46:51.897316 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:51.897308    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:46:51.897351 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:51.897340    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:46:52.903126 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:52.903087    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b" event={"ID":"3fe9b456-1da7-4ab5-88e6-e247118cacbc","Type":"ContainerStarted","Data":"4ff773f4320349653c6f0657de66bd6725854f1fd90184756e9408fc83d53130"}
Jul 29 21:46:53.839109 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:53.839064    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:53.839328 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:53.839202    2575 patch_prober.go:28] interesting pod/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 29 21:46:53.839328 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:53.839247    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b" podUID="3fe9b456-1da7-4ab5-88e6-e247118cacbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 29 21:46:54.838394 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:54.838348    2575 patch_prober.go:28] interesting pod/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 29 21:46:54.838898 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:54.838423    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b" podUID="3fe9b456-1da7-4ab5-88e6-e247118cacbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 29 21:46:55.838876 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:55.838827    2575 patch_prober.go:28] interesting pod/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 29 21:46:55.839360 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:55.838897    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b" podUID="3fe9b456-1da7-4ab5-88e6-e247118cacbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 29 21:46:56.391654 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:56.391608    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:46:56.842309 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:56.842277    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:56.842728 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:56.842561    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:46:56.843286 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:46:56.843270    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:47:00.856274 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:00.856236    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:04.068279 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:04.068245    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt"]
Jul 29 21:47:04.072132 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:04.072107    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt"
Jul 29 21:47:04.074948 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:04.074925    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9wjvq\""
Jul 29 21:47:04.075070 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:04.074970    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 21:47:04.079503 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:04.079480    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt"]
Jul 29 21:47:04.172997 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:04.172967    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab70b66d-705a-4490-a7cb-e01787843ef5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt\" (UID: \"ab70b66d-705a-4490-a7cb-e01787843ef5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt"
Jul 29 21:47:04.273729 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:04.273693    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab70b66d-705a-4490-a7cb-e01787843ef5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt\" (UID: \"ab70b66d-705a-4490-a7cb-e01787843ef5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt"
Jul 29 21:47:04.274329 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:04.274304    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab70b66d-705a-4490-a7cb-e01787843ef5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt\" (UID: \"ab70b66d-705a-4490-a7cb-e01787843ef5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt"
Jul 29 21:47:04.384706 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:04.384629    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt"
Jul 29 21:47:04.517664 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:04.517639    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt"]
Jul 29 21:47:04.519534 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:47:04.519503    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab70b66d_705a_4490_a7cb_e01787843ef5.slice/crio-6ddd8cc6cde9cfaf6ba3a78e77561c281566ec5550cfe027a4f9a4d6a00c87b4 WatchSource:0}: Error finding container 6ddd8cc6cde9cfaf6ba3a78e77561c281566ec5550cfe027a4f9a4d6a00c87b4: Status 404 returned error can't find the container with id 6ddd8cc6cde9cfaf6ba3a78e77561c281566ec5550cfe027a4f9a4d6a00c87b4
Jul 29 21:47:04.969460 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:04.969410    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt" event={"ID":"ab70b66d-705a-4490-a7cb-e01787843ef5","Type":"ContainerStarted","Data":"b2bf7cad272311dab3fa1ccdb97778bfe3c41b0f51eb0ad5f0288086218460a9"}
Jul 29 21:47:04.969638 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:04.969489    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt" event={"ID":"ab70b66d-705a-4490-a7cb-e01787843ef5","Type":"ContainerStarted","Data":"6ddd8cc6cde9cfaf6ba3a78e77561c281566ec5550cfe027a4f9a4d6a00c87b4"}
Jul 29 21:47:04.985365 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:04.985322    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt" podStartSLOduration=0.985306307 podStartE2EDuration="985.306307ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:47:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:47:04.98454191 +0000 UTC m=+2616.990065291" watchObservedRunningTime="2026-07-29 21:47:04.985306307 +0000 UTC m=+2616.990829675"
Jul 29 21:47:05.976528 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:05.976491    2575 generic.go:356] "Generic (PLEG): container finished" podID="ab70b66d-705a-4490-a7cb-e01787843ef5" containerID="b2bf7cad272311dab3fa1ccdb97778bfe3c41b0f51eb0ad5f0288086218460a9" exitCode=0
Jul 29 21:47:05.976908 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:05.976577    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt" event={"ID":"ab70b66d-705a-4490-a7cb-e01787843ef5","Type":"ContainerDied","Data":"b2bf7cad272311dab3fa1ccdb97778bfe3c41b0f51eb0ad5f0288086218460a9"}
Jul 29 21:47:07.119720 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:07.119692    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt"
Jul 29 21:47:07.201353 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:07.201308    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab70b66d-705a-4490-a7cb-e01787843ef5-maas-api-service-ca\") pod \"ab70b66d-705a-4490-a7cb-e01787843ef5\" (UID: \"ab70b66d-705a-4490-a7cb-e01787843ef5\") "
Jul 29 21:47:07.201684 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:07.201661    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab70b66d-705a-4490-a7cb-e01787843ef5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ab70b66d-705a-4490-a7cb-e01787843ef5" (UID: "ab70b66d-705a-4490-a7cb-e01787843ef5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:47:07.303050 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:07.303019    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab70b66d-705a-4490-a7cb-e01787843ef5-maas-api-service-ca\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:07.989420 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:07.989387    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt"
Jul 29 21:47:07.989615 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:07.989419    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt" event={"ID":"ab70b66d-705a-4490-a7cb-e01787843ef5","Type":"ContainerDied","Data":"6ddd8cc6cde9cfaf6ba3a78e77561c281566ec5550cfe027a4f9a4d6a00c87b4"}
Jul 29 21:47:07.989615 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:07.989489    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ddd8cc6cde9cfaf6ba3a78e77561c281566ec5550cfe027a4f9a4d6a00c87b4"
Jul 29 21:47:19.686897 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:19.686854    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:19.756287 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:19.756248    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:19.842376 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:19.842346    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:19.882979 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:19.882941    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt"]
Jul 29 21:47:19.888584 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:19.887671    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6a8fa4-x5gvt"]
Jul 29 21:47:19.922261 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:19.922220    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:20.313498 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:20.313439    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:20.483589 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:20.483555    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab70b66d-705a-4490-a7cb-e01787843ef5" path="/var/lib/kubelet/pods/ab70b66d-705a-4490-a7cb-e01787843ef5/volumes"
Jul 29 21:47:22.224498 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:22.224459    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:47:25.999517 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:25.999481    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:26.072201 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:26.072158    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:26.272346 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:26.272251    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"]
Jul 29 21:47:26.276325 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:26.276287    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6" podUID="983565f1-66f4-4dc1-b5b3-1d132eb88229" containerName="istio-proxy" containerID="cri-o://eeeaae2e8992779722181e8dd7ae06d21db5b3137b2f7553e807e68ec96d3368" gracePeriod=30
Jul 29 21:47:26.294216 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:26.294183    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:26.571168 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:26.571131    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:26.688518 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:26.688476    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-881a99-wfm79"]
Jul 29 21:47:26.688979 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:26.688961    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab70b66d-705a-4490-a7cb-e01787843ef5" containerName="revoke-keys"
Jul 29 21:47:26.689073 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:26.688982    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab70b66d-705a-4490-a7cb-e01787843ef5" containerName="revoke-keys"
Jul 29 21:47:26.689135 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:26.689085    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab70b66d-705a-4490-a7cb-e01787843ef5" containerName="revoke-keys"
Jul 29 21:47:26.693579 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:26.693557    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-881a99-wfm79"
Jul 29 21:47:26.696880 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:26.696850    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9wjvq\""
Jul 29 21:47:26.697250 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:26.697232    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 21:47:26.701807 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:26.701777    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-881a99-wfm79"]
Jul 29 21:47:26.788593 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:26.788553    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/415c1794-6d6d-4c6e-9664-0cf138bf3791-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-881a99-wfm79\" (UID: \"415c1794-6d6d-4c6e-9664-0cf138bf3791\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-881a99-wfm79"
Jul 29 21:47:26.889840 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:26.889751    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/415c1794-6d6d-4c6e-9664-0cf138bf3791-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-881a99-wfm79\" (UID: \"415c1794-6d6d-4c6e-9664-0cf138bf3791\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-881a99-wfm79"
Jul 29 21:47:26.890395 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:26.890373    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/415c1794-6d6d-4c6e-9664-0cf138bf3791-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-881a99-wfm79\" (UID: \"415c1794-6d6d-4c6e-9664-0cf138bf3791\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-881a99-wfm79"
Jul 29 21:47:27.014639 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:27.014603    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-881a99-wfm79"
Jul 29 21:47:27.145067 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:27.145016    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-881a99-wfm79"]
Jul 29 21:47:27.147672 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:47:27.147642    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415c1794_6d6d_4c6e_9664_0cf138bf3791.slice/crio-e9d7104b89099e8a1f52b7a868360fd21dff78da6d7cec4821bfab1fa1a21546 WatchSource:0}: Error finding container e9d7104b89099e8a1f52b7a868360fd21dff78da6d7cec4821bfab1fa1a21546: Status 404 returned error can't find the container with id e9d7104b89099e8a1f52b7a868360fd21dff78da6d7cec4821bfab1fa1a21546
Jul 29 21:47:28.103160 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:28.103067    2575 generic.go:356] "Generic (PLEG): container finished" podID="415c1794-6d6d-4c6e-9664-0cf138bf3791" containerID="1e99af0414f38c5ecb9e892bf34233ecf6e8d3b102a620c8e7150d2f19ad2ed1" exitCode=0
Jul 29 21:47:28.103553 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:28.103158    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-881a99-wfm79" event={"ID":"415c1794-6d6d-4c6e-9664-0cf138bf3791","Type":"ContainerDied","Data":"1e99af0414f38c5ecb9e892bf34233ecf6e8d3b102a620c8e7150d2f19ad2ed1"}
Jul 29 21:47:28.103553 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:28.103224    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-881a99-wfm79" event={"ID":"415c1794-6d6d-4c6e-9664-0cf138bf3791","Type":"ContainerStarted","Data":"e9d7104b89099e8a1f52b7a868360fd21dff78da6d7cec4821bfab1fa1a21546"}
Jul 29 21:47:28.765839 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:28.765811    2575 scope.go:117] "RemoveContainer" containerID="3fa7bbc00ff32268dd212aafdb0001cfa52b4fb3e3e113caf9007d36ab5f95de"
Jul 29 21:47:29.253721 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:29.253693    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-881a99-wfm79"
Jul 29 21:47:29.312195 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:29.312167    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/415c1794-6d6d-4c6e-9664-0cf138bf3791-maas-api-service-ca\") pod \"415c1794-6d6d-4c6e-9664-0cf138bf3791\" (UID: \"415c1794-6d6d-4c6e-9664-0cf138bf3791\") "
Jul 29 21:47:29.312520 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:29.312498    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/415c1794-6d6d-4c6e-9664-0cf138bf3791-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "415c1794-6d6d-4c6e-9664-0cf138bf3791" (UID: "415c1794-6d6d-4c6e-9664-0cf138bf3791"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:47:29.413052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:29.412990    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/415c1794-6d6d-4c6e-9664-0cf138bf3791-maas-api-service-ca\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:30.115182 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:30.115146    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-881a99-wfm79" event={"ID":"415c1794-6d6d-4c6e-9664-0cf138bf3791","Type":"ContainerDied","Data":"e9d7104b89099e8a1f52b7a868360fd21dff78da6d7cec4821bfab1fa1a21546"}
Jul 29 21:47:30.115425 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:30.115194    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9d7104b89099e8a1f52b7a868360fd21dff78da6d7cec4821bfab1fa1a21546"
Jul 29 21:47:30.115425 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:30.115157    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-881a99-wfm79"
Jul 29 21:47:31.540745 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.540720    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:47:31.631427 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.631346    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-envoy\") pod \"983565f1-66f4-4dc1-b5b3-1d132eb88229\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") "
Jul 29 21:47:31.631427 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.631391    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-token\") pod \"983565f1-66f4-4dc1-b5b3-1d132eb88229\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") "
Jul 29 21:47:31.631427 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.631417    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-workload-certs\") pod \"983565f1-66f4-4dc1-b5b3-1d132eb88229\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") "
Jul 29 21:47:31.631705 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.631467    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-workload-socket\") pod \"983565f1-66f4-4dc1-b5b3-1d132eb88229\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") "
Jul 29 21:47:31.631705 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.631492    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-credential-socket\") pod \"983565f1-66f4-4dc1-b5b3-1d132eb88229\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") "
Jul 29 21:47:31.631705 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.631551    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/983565f1-66f4-4dc1-b5b3-1d132eb88229-istiod-ca-cert\") pod \"983565f1-66f4-4dc1-b5b3-1d132eb88229\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") "
Jul 29 21:47:31.631705 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.631603    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-podinfo\") pod \"983565f1-66f4-4dc1-b5b3-1d132eb88229\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") "
Jul 29 21:47:31.631705 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.631664    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-data\") pod \"983565f1-66f4-4dc1-b5b3-1d132eb88229\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") "
Jul 29 21:47:31.631705 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.631695    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgbkf\" (UniqueName: \"kubernetes.io/projected/983565f1-66f4-4dc1-b5b3-1d132eb88229-kube-api-access-jgbkf\") pod \"983565f1-66f4-4dc1-b5b3-1d132eb88229\" (UID: \"983565f1-66f4-4dc1-b5b3-1d132eb88229\") "
Jul 29 21:47:31.632038 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.631789    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "983565f1-66f4-4dc1-b5b3-1d132eb88229" (UID: "983565f1-66f4-4dc1-b5b3-1d132eb88229"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:47:31.632038 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.631806    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "983565f1-66f4-4dc1-b5b3-1d132eb88229" (UID: "983565f1-66f4-4dc1-b5b3-1d132eb88229"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:47:31.632038 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.631830    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "983565f1-66f4-4dc1-b5b3-1d132eb88229" (UID: "983565f1-66f4-4dc1-b5b3-1d132eb88229"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:47:31.632201 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.632061    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/983565f1-66f4-4dc1-b5b3-1d132eb88229-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "983565f1-66f4-4dc1-b5b3-1d132eb88229" (UID: "983565f1-66f4-4dc1-b5b3-1d132eb88229"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:47:31.632201 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.632094    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-workload-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:31.632201 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.632116    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-credential-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:31.632201 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.632131    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-workload-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:31.632671 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.632643    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-data" (OuterVolumeSpecName: "istio-data") pod "983565f1-66f4-4dc1-b5b3-1d132eb88229" (UID: "983565f1-66f4-4dc1-b5b3-1d132eb88229"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:47:31.633561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.633536    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "983565f1-66f4-4dc1-b5b3-1d132eb88229" (UID: "983565f1-66f4-4dc1-b5b3-1d132eb88229"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:47:31.633729 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.633710    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-token" (OuterVolumeSpecName: "istio-token") pod "983565f1-66f4-4dc1-b5b3-1d132eb88229" (UID: "983565f1-66f4-4dc1-b5b3-1d132eb88229"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:47:31.633773 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.633742    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "983565f1-66f4-4dc1-b5b3-1d132eb88229" (UID: "983565f1-66f4-4dc1-b5b3-1d132eb88229"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:47:31.633878 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.633862    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/983565f1-66f4-4dc1-b5b3-1d132eb88229-kube-api-access-jgbkf" (OuterVolumeSpecName: "kube-api-access-jgbkf") pod "983565f1-66f4-4dc1-b5b3-1d132eb88229" (UID: "983565f1-66f4-4dc1-b5b3-1d132eb88229"). InnerVolumeSpecName "kube-api-access-jgbkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:47:31.732942 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.732901    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-data\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:31.732942 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.732937    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgbkf\" (UniqueName: \"kubernetes.io/projected/983565f1-66f4-4dc1-b5b3-1d132eb88229-kube-api-access-jgbkf\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:31.732942 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.732948    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-envoy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:31.732942 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.732957    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-token\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:31.733185 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.732965    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/983565f1-66f4-4dc1-b5b3-1d132eb88229-istiod-ca-cert\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:31.733185 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:31.732972    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/983565f1-66f4-4dc1-b5b3-1d132eb88229-istio-podinfo\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:32.127419 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:32.127389    2575 generic.go:356] "Generic (PLEG): container finished" podID="983565f1-66f4-4dc1-b5b3-1d132eb88229" containerID="eeeaae2e8992779722181e8dd7ae06d21db5b3137b2f7553e807e68ec96d3368" exitCode=0
Jul 29 21:47:32.127628 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:32.127432    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6" event={"ID":"983565f1-66f4-4dc1-b5b3-1d132eb88229","Type":"ContainerDied","Data":"eeeaae2e8992779722181e8dd7ae06d21db5b3137b2f7553e807e68ec96d3368"}
Jul 29 21:47:32.127628 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:32.127440    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"
Jul 29 21:47:32.127628 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:32.127500    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6" event={"ID":"983565f1-66f4-4dc1-b5b3-1d132eb88229","Type":"ContainerDied","Data":"d47e9937654b54ec4991757865c2d4fd7f8abcbc56d8c4bc9e9c811aed7a4d55"}
Jul 29 21:47:32.127628 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:32.127532    2575 scope.go:117] "RemoveContainer" containerID="eeeaae2e8992779722181e8dd7ae06d21db5b3137b2f7553e807e68ec96d3368"
Jul 29 21:47:32.139289 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:32.139269    2575 scope.go:117] "RemoveContainer" containerID="02f3f57f72ef41d83d4e0384262fc561bb71a8ef7385d92730230575f9130e6a"
Jul 29 21:47:32.147617 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:32.147593    2575 scope.go:117] "RemoveContainer" containerID="eeeaae2e8992779722181e8dd7ae06d21db5b3137b2f7553e807e68ec96d3368"
Jul 29 21:47:32.147871 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:47:32.147852    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeeaae2e8992779722181e8dd7ae06d21db5b3137b2f7553e807e68ec96d3368\": container with ID starting with eeeaae2e8992779722181e8dd7ae06d21db5b3137b2f7553e807e68ec96d3368 not found: ID does not exist" containerID="eeeaae2e8992779722181e8dd7ae06d21db5b3137b2f7553e807e68ec96d3368"
Jul 29 21:47:32.147917 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:32.147880    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeeaae2e8992779722181e8dd7ae06d21db5b3137b2f7553e807e68ec96d3368"} err="failed to get container status \"eeeaae2e8992779722181e8dd7ae06d21db5b3137b2f7553e807e68ec96d3368\": rpc error: code = NotFound desc = could not find container \"eeeaae2e8992779722181e8dd7ae06d21db5b3137b2f7553e807e68ec96d3368\": container with ID starting with eeeaae2e8992779722181e8dd7ae06d21db5b3137b2f7553e807e68ec96d3368 not found: ID does not exist"
Jul 29 21:47:32.147917 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:32.147897    2575 scope.go:117] "RemoveContainer" containerID="02f3f57f72ef41d83d4e0384262fc561bb71a8ef7385d92730230575f9130e6a"
Jul 29 21:47:32.148115 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:47:32.148098    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02f3f57f72ef41d83d4e0384262fc561bb71a8ef7385d92730230575f9130e6a\": container with ID starting with 02f3f57f72ef41d83d4e0384262fc561bb71a8ef7385d92730230575f9130e6a not found: ID does not exist" containerID="02f3f57f72ef41d83d4e0384262fc561bb71a8ef7385d92730230575f9130e6a"
Jul 29 21:47:32.148156 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:32.148119    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f3f57f72ef41d83d4e0384262fc561bb71a8ef7385d92730230575f9130e6a"} err="failed to get container status \"02f3f57f72ef41d83d4e0384262fc561bb71a8ef7385d92730230575f9130e6a\": rpc error: code = NotFound desc = could not find container \"02f3f57f72ef41d83d4e0384262fc561bb71a8ef7385d92730230575f9130e6a\": container with ID starting with 02f3f57f72ef41d83d4e0384262fc561bb71a8ef7385d92730230575f9130e6a not found: ID does not exist"
Jul 29 21:47:32.153350 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:32.153328    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"]
Jul 29 21:47:32.159979 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:32.159957    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-6a8fa4-openshift-default-5d6c4c6b64-sgll6"]
Jul 29 21:47:32.483196 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:32.483106    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="983565f1-66f4-4dc1-b5b3-1d132eb88229" path="/var/lib/kubelet/pods/983565f1-66f4-4dc1-b5b3-1d132eb88229/volumes"
Jul 29 21:47:42.311174 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:42.311128    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:42.387561 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:42.387505    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:42.469907 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:42.469873    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:42.484166 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:42.484139    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-881a99-wfm79"]
Jul 29 21:47:42.484166 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:42.484171    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-881a99-wfm79"]
Jul 29 21:47:42.572301 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:42.572205    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:42.911185 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:42.911099    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:44.482984 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:44.482949    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="415c1794-6d6d-4c6e-9664-0cf138bf3791" path="/var/lib/kubelet/pods/415c1794-6d6d-4c6e-9664-0cf138bf3791/volumes"
Jul 29 21:47:47.511252 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:47.511215    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:47:48.909576 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:48.909541    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:49.009366 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:49.009310    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:49.188858 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:49.188765    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"]
Jul 29 21:47:49.189044 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:49.189018    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b" podUID="3fe9b456-1da7-4ab5-88e6-e247118cacbc" containerName="istio-proxy" containerID="cri-o://4ff773f4320349653c6f0657de66bd6725854f1fd90184756e9408fc83d53130" gracePeriod=30
Jul 29 21:47:49.215194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:49.215159    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:49.450627 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:49.450537    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:49.866142 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:49.866112    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:50.158635 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.158550    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"]
Jul 29 21:47:50.158999 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.158946    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="983565f1-66f4-4dc1-b5b3-1d132eb88229" containerName="istio-proxy"
Jul 29 21:47:50.158999 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.158957    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="983565f1-66f4-4dc1-b5b3-1d132eb88229" containerName="istio-proxy"
Jul 29 21:47:50.158999 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.158975    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="983565f1-66f4-4dc1-b5b3-1d132eb88229" containerName="istio-proxy"
Jul 29 21:47:50.158999 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.158981    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="983565f1-66f4-4dc1-b5b3-1d132eb88229" containerName="istio-proxy"
Jul 29 21:47:50.158999 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.158999    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="415c1794-6d6d-4c6e-9664-0cf138bf3791" containerName="revoke-keys"
Jul 29 21:47:50.159183 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.159005    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="415c1794-6d6d-4c6e-9664-0cf138bf3791" containerName="revoke-keys"
Jul 29 21:47:50.159183 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.159078    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="415c1794-6d6d-4c6e-9664-0cf138bf3791" containerName="revoke-keys"
Jul 29 21:47:50.159183 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.159086    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="983565f1-66f4-4dc1-b5b3-1d132eb88229" containerName="istio-proxy"
Jul 29 21:47:50.159183 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.159092    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="983565f1-66f4-4dc1-b5b3-1d132eb88229" containerName="istio-proxy"
Jul 29 21:47:50.162354 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.162334    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.165295 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.165279    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-fe32bc-openshift-default-dockercfg-27jnh\""
Jul 29 21:47:50.179160 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.179134    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"]
Jul 29 21:47:50.189112 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.189083    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:50.301767 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.301726    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4js5\" (UniqueName: \"kubernetes.io/projected/f00e8810-cf51-428c-90a9-e875d7b4feec-kube-api-access-c4js5\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.301767 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.301770    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-workload-socket\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.302018 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.301847    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-credential-socket\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.302018 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.301897    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-envoy\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.302018 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.301942    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-workload-certs\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.302018 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.301978    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-podinfo\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.302227 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.302040    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-token\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.302227 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.302065    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-data\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.302227 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.302092    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f00e8810-cf51-428c-90a9-e875d7b4feec-istiod-ca-cert\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.402776 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.402735    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-workload-certs\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.402776 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.402779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-podinfo\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.403042 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.402930    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-token\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.403042 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.402982    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-data\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.403042 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.403009    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f00e8810-cf51-428c-90a9-e875d7b4feec-istiod-ca-cert\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.403228 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.403097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4js5\" (UniqueName: \"kubernetes.io/projected/f00e8810-cf51-428c-90a9-e875d7b4feec-kube-api-access-c4js5\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.403228 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.403133    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-workload-socket\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.403228 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.403189    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-credential-socket\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.403228 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.403197    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-workload-certs\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.403432 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.403260    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-envoy\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.403432 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.403354    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-data\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.403572 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.403553    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-credential-socket\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.403700 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.403676    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-workload-socket\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.403861 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.403817    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f00e8810-cf51-428c-90a9-e875d7b4feec-istiod-ca-cert\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.405375 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.405357    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-podinfo\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.405484 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.405427    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-envoy\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.411602 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.411535    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-token\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.411761 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.411742    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4js5\" (UniqueName: \"kubernetes.io/projected/f00e8810-cf51-428c-90a9-e875d7b4feec-kube-api-access-c4js5\") pod \"e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") " pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.473287 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.473256    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:50.487114 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.487080    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:50.618380 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.618356    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"]
Jul 29 21:47:50.620556 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:47:50.620521    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00e8810_cf51_428c_90a9_e875d7b4feec.slice/crio-0373dc869085a035f455c32d4ce94b6ea2157957047accc47e41d6470dd72333 WatchSource:0}: Error finding container 0373dc869085a035f455c32d4ce94b6ea2157957047accc47e41d6470dd72333: Status 404 returned error can't find the container with id 0373dc869085a035f455c32d4ce94b6ea2157957047accc47e41d6470dd72333
Jul 29 21:47:50.622689 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.622651    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:47:50.622765 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.622735    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:47:50.622829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:50.622805    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:47:51.231658 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:51.231618    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5" event={"ID":"f00e8810-cf51-428c-90a9-e875d7b4feec","Type":"ContainerStarted","Data":"dce5fa53b3e59627f07ed568c0dfedc28520a4c11d190377bf2558dd3ec488bc"}
Jul 29 21:47:51.232063 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:51.231680    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5" event={"ID":"f00e8810-cf51-428c-90a9-e875d7b4feec","Type":"ContainerStarted","Data":"0373dc869085a035f455c32d4ce94b6ea2157957047accc47e41d6470dd72333"}
Jul 29 21:47:51.251958 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:51.251899    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5" podStartSLOduration=1.25188337 podStartE2EDuration="1.25188337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:47:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:47:51.251161608 +0000 UTC m=+2663.256684977" watchObservedRunningTime="2026-07-29 21:47:51.25188337 +0000 UTC m=+2663.257406734"
Jul 29 21:47:51.473499 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:51.473433    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:51.478407 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:51.478381    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:52.238225 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:52.238184    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:52.239290 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:52.239270    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:47:53.205642 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:53.205584    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:53.308145 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:53.308101    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:54.326898 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.326860    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:54.450705 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.450635    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:47:54.542829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.542784    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-credential-socket\") pod \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") "
Jul 29 21:47:54.543032 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.542890    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfbv8\" (UniqueName: \"kubernetes.io/projected/3fe9b456-1da7-4ab5-88e6-e247118cacbc-kube-api-access-rfbv8\") pod \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") "
Jul 29 21:47:54.543032 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.542921    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-workload-socket\") pod \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") "
Jul 29 21:47:54.543032 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.542953    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-workload-certs\") pod \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") "
Jul 29 21:47:54.543032 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.542997    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istiod-ca-cert\") pod \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") "
Jul 29 21:47:54.543032 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.543031    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-data\") pod \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") "
Jul 29 21:47:54.543304 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.543056    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-envoy\") pod \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") "
Jul 29 21:47:54.543304 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.543098    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-podinfo\") pod \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") "
Jul 29 21:47:54.543304 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.543093    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3fe9b456-1da7-4ab5-88e6-e247118cacbc" (UID: "3fe9b456-1da7-4ab5-88e6-e247118cacbc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:47:54.543304 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.543129    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-token\") pod \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\" (UID: \"3fe9b456-1da7-4ab5-88e6-e247118cacbc\") "
Jul 29 21:47:54.543304 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.543228    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3fe9b456-1da7-4ab5-88e6-e247118cacbc" (UID: "3fe9b456-1da7-4ab5-88e6-e247118cacbc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:47:54.543599 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.543306    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3fe9b456-1da7-4ab5-88e6-e247118cacbc" (UID: "3fe9b456-1da7-4ab5-88e6-e247118cacbc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:47:54.543599 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.543393    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3fe9b456-1da7-4ab5-88e6-e247118cacbc" (UID: "3fe9b456-1da7-4ab5-88e6-e247118cacbc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 21:47:54.543599 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.543569    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-workload-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:54.543599 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.543589    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-workload-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:54.543808 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.543604    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-credential-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:54.544132 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.544102    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-data" (OuterVolumeSpecName: "istio-data") pod "3fe9b456-1da7-4ab5-88e6-e247118cacbc" (UID: "3fe9b456-1da7-4ab5-88e6-e247118cacbc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:47:54.545437 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.545410    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fe9b456-1da7-4ab5-88e6-e247118cacbc-kube-api-access-rfbv8" (OuterVolumeSpecName: "kube-api-access-rfbv8") pod "3fe9b456-1da7-4ab5-88e6-e247118cacbc" (UID: "3fe9b456-1da7-4ab5-88e6-e247118cacbc"). InnerVolumeSpecName "kube-api-access-rfbv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:47:54.545437 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.545412    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3fe9b456-1da7-4ab5-88e6-e247118cacbc" (UID: "3fe9b456-1da7-4ab5-88e6-e247118cacbc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 21:47:54.545618 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.545493    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3fe9b456-1da7-4ab5-88e6-e247118cacbc" (UID: "3fe9b456-1da7-4ab5-88e6-e247118cacbc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 21:47:54.545692 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.545676    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-token" (OuterVolumeSpecName: "istio-token") pod "3fe9b456-1da7-4ab5-88e6-e247118cacbc" (UID: "3fe9b456-1da7-4ab5-88e6-e247118cacbc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:47:54.644707 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.644668    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfbv8\" (UniqueName: \"kubernetes.io/projected/3fe9b456-1da7-4ab5-88e6-e247118cacbc-kube-api-access-rfbv8\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:54.644707 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.644698    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istiod-ca-cert\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:54.644707 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.644710    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-data\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:54.644707 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.644718    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-envoy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:54.644979 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.644726    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-podinfo\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:54.644979 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.644733    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fe9b456-1da7-4ab5-88e6-e247118cacbc-istio-token\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:47:54.695804 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:54.695768    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:55.027494 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:55.027460    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:55.119346 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:55.119311    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:47:55.257334 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:55.257301    2575 generic.go:356] "Generic (PLEG): container finished" podID="3fe9b456-1da7-4ab5-88e6-e247118cacbc" containerID="4ff773f4320349653c6f0657de66bd6725854f1fd90184756e9408fc83d53130" exitCode=0
Jul 29 21:47:55.257555 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:55.257370    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"
Jul 29 21:47:55.257555 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:55.257379    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b" event={"ID":"3fe9b456-1da7-4ab5-88e6-e247118cacbc","Type":"ContainerDied","Data":"4ff773f4320349653c6f0657de66bd6725854f1fd90184756e9408fc83d53130"}
Jul 29 21:47:55.257555 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:55.257456    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b" event={"ID":"3fe9b456-1da7-4ab5-88e6-e247118cacbc","Type":"ContainerDied","Data":"2fba851fd2e992e8b2e15c71df24111f5eb608d2470330e6b6a1a6a7f26f3922"}
Jul 29 21:47:55.257555 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:55.257486    2575 scope.go:117] "RemoveContainer" containerID="4ff773f4320349653c6f0657de66bd6725854f1fd90184756e9408fc83d53130"
Jul 29 21:47:55.270657 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:55.270634    2575 scope.go:117] "RemoveContainer" containerID="be2bc5c8c84429775f02fc2ba67ee433861b0ba39192bd3c62e1818a3ecae5f0"
Jul 29 21:47:55.279358 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:55.279336    2575 scope.go:117] "RemoveContainer" containerID="4ff773f4320349653c6f0657de66bd6725854f1fd90184756e9408fc83d53130"
Jul 29 21:47:55.279696 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:47:55.279674    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ff773f4320349653c6f0657de66bd6725854f1fd90184756e9408fc83d53130\": container with ID starting with 4ff773f4320349653c6f0657de66bd6725854f1fd90184756e9408fc83d53130 not found: ID does not exist" containerID="4ff773f4320349653c6f0657de66bd6725854f1fd90184756e9408fc83d53130"
Jul 29 21:47:55.279770 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:55.279709    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ff773f4320349653c6f0657de66bd6725854f1fd90184756e9408fc83d53130"} err="failed to get container status \"4ff773f4320349653c6f0657de66bd6725854f1fd90184756e9408fc83d53130\": rpc error: code = NotFound desc = could not find container \"4ff773f4320349653c6f0657de66bd6725854f1fd90184756e9408fc83d53130\": container with ID starting with 4ff773f4320349653c6f0657de66bd6725854f1fd90184756e9408fc83d53130 not found: ID does not exist"
Jul 29 21:47:55.279770 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:55.279737    2575 scope.go:117] "RemoveContainer" containerID="be2bc5c8c84429775f02fc2ba67ee433861b0ba39192bd3c62e1818a3ecae5f0"
Jul 29 21:47:55.280018 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:47:55.280002    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be2bc5c8c84429775f02fc2ba67ee433861b0ba39192bd3c62e1818a3ecae5f0\": container with ID starting with be2bc5c8c84429775f02fc2ba67ee433861b0ba39192bd3c62e1818a3ecae5f0 not found: ID does not exist" containerID="be2bc5c8c84429775f02fc2ba67ee433861b0ba39192bd3c62e1818a3ecae5f0"
Jul 29 21:47:55.280066 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:55.280023    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be2bc5c8c84429775f02fc2ba67ee433861b0ba39192bd3c62e1818a3ecae5f0"} err="failed to get container status \"be2bc5c8c84429775f02fc2ba67ee433861b0ba39192bd3c62e1818a3ecae5f0\": rpc error: code = NotFound desc = could not find container \"be2bc5c8c84429775f02fc2ba67ee433861b0ba39192bd3c62e1818a3ecae5f0\": container with ID starting with be2bc5c8c84429775f02fc2ba67ee433861b0ba39192bd3c62e1818a3ecae5f0 not found: ID does not exist"
Jul 29 21:47:55.284588 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:55.284565    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"]
Jul 29 21:47:55.290556 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:55.290534    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-881a99-openshift-default-f9764c6db-gvv6b"]
Jul 29 21:47:56.483328 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:56.483293    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fe9b456-1da7-4ab5-88e6-e247118cacbc" path="/var/lib/kubelet/pods/3fe9b456-1da7-4ab5-88e6-e247118cacbc/volumes"
Jul 29 21:47:58.824644 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:47:58.824607    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:48:06.319211 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:06.319181    2575 generic.go:356] "Generic (PLEG): container finished" podID="f00e8810-cf51-428c-90a9-e875d7b4feec" containerID="dce5fa53b3e59627f07ed568c0dfedc28520a4c11d190377bf2558dd3ec488bc" exitCode=0
Jul 29 21:48:06.319609 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:06.319251    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5" event={"ID":"f00e8810-cf51-428c-90a9-e875d7b4feec","Type":"ContainerDied","Data":"dce5fa53b3e59627f07ed568c0dfedc28520a4c11d190377bf2558dd3ec488bc"}
Jul 29 21:48:06.319692 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:06.319678    2575 scope.go:117] "RemoveContainer" containerID="dce5fa53b3e59627f07ed568c0dfedc28520a4c11d190377bf2558dd3ec488bc"
Jul 29 21:48:06.320726 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:06.320687    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:48:06.320829 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:06.320780    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:48:06.320892 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:06.320840    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:48:07.238602 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:07.238551    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:48:07.326819 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:07.326786    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5" event={"ID":"f00e8810-cf51-428c-90a9-e875d7b4feec","Type":"ContainerStarted","Data":"b4ce63a28154c7fbee569263262d61a5b39975bdbc4520f49ded46999df3e9ee"}
Jul 29 21:48:07.473797 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:07.473760    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:48:07.475023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:07.474994    2575 patch_prober.go:28] interesting pod/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 29 21:48:07.475146 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:07.475070    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5" podUID="f00e8810-cf51-428c-90a9-e875d7b4feec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 29 21:48:08.473727 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:08.473690    2575 patch_prober.go:28] interesting pod/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 29 21:48:08.474104 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:08.473781    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5" podUID="f00e8810-cf51-428c-90a9-e875d7b4feec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 29 21:48:09.474493 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:09.474437    2575 patch_prober.go:28] interesting pod/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 29 21:48:09.474862 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:09.474545    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5" podUID="f00e8810-cf51-428c-90a9-e875d7b4feec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 29 21:48:10.474330 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:10.474293    2575 patch_prober.go:28] interesting pod/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 29 21:48:10.474532 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:10.474348    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5" podUID="f00e8810-cf51-428c-90a9-e875d7b4feec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 29 21:48:11.478003 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:11.477972    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:48:11.478409 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:11.478203    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:48:11.478810 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:11.478791    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 21:48:18.326993 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:18.326957    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:48:18.676376 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:18.676276    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:48:18.966591 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:18.966503    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"]
Jul 29 21:48:18.966933 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:18.966920    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe9b456-1da7-4ab5-88e6-e247118cacbc" containerName="istio-proxy"
Jul 29 21:48:18.966997 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:18.966935    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe9b456-1da7-4ab5-88e6-e247118cacbc" containerName="istio-proxy"
Jul 29 21:48:18.967052 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:18.967021    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fe9b456-1da7-4ab5-88e6-e247118cacbc" containerName="istio-proxy"
Jul 29 21:48:18.970354 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:18.970334    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:18.973372 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:18.973352    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-670ddc-openshift-default-dockercfg-gjpq9\""
Jul 29 21:48:18.985349 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:18.985320    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"]
Jul 29 21:48:18.995204 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:18.995167    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:48:19.071588 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.071553    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-workload-certs\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.071822 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.071605    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsr5v\" (UniqueName: \"kubernetes.io/projected/b96f21ad-56e8-4b03-a293-82bcc55bc24b-kube-api-access-wsr5v\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.071822 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.071648    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-podinfo\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.071822 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.071703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istiod-ca-cert\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.071822 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.071743    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-workload-socket\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.071822 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.071788    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-credential-socket\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.071822 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.071809    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-token\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.071822 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.071827    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-envoy\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.072227 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.071891    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-data\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.173225 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.173189    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-workload-socket\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.173411 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.173231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-credential-socket\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.173411 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.173253    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-token\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.173411 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.173273    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-envoy\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.173411 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.173301    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-data\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.173411 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.173358    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-workload-certs\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.173411 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.173401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsr5v\" (UniqueName: \"kubernetes.io/projected/b96f21ad-56e8-4b03-a293-82bcc55bc24b-kube-api-access-wsr5v\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.173761 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.173474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-podinfo\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.173761 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.173524    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istiod-ca-cert\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.173761 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.173612    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-workload-socket\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.173761 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.173664    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-credential-socket\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.173761 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.173727    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-data\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.174039 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.173838    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-workload-certs\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.174267 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.174248    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istiod-ca-cert\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.175884 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.175860    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-envoy\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.176043 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.176025    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-podinfo\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.180758 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.180732    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-token\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.181012 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.180996    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsr5v\" (UniqueName: \"kubernetes.io/projected/b96f21ad-56e8-4b03-a293-82bcc55bc24b-kube-api-access-wsr5v\") pod \"e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") " pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.280706 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.280621    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:19.423741 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.423716    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"]
Jul 29 21:48:19.426324 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:48:19.426281    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96f21ad_56e8_4b03_a293_82bcc55bc24b.slice/crio-2c913cd1674bc616e4fb1c1dfced0f3e72d4859437d9af0a5cbe115be0f9294e WatchSource:0}: Error finding container 2c913cd1674bc616e4fb1c1dfced0f3e72d4859437d9af0a5cbe115be0f9294e: Status 404 returned error can't find the container with id 2c913cd1674bc616e4fb1c1dfced0f3e72d4859437d9af0a5cbe115be0f9294e
Jul 29 21:48:19.428913 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.428876    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:48:19.429005 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.428962    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:48:19.429046 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.429003    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:48:19.499010 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:19.498969    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:48:20.413515 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:20.413422    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49" event={"ID":"b96f21ad-56e8-4b03-a293-82bcc55bc24b","Type":"ContainerStarted","Data":"e21ab05ef9b795900124fe4d09d8b8ebd975f30f5d4e28fc4fae7346a812e85f"}
Jul 29 21:48:20.413515 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:20.413502    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49" event={"ID":"b96f21ad-56e8-4b03-a293-82bcc55bc24b","Type":"ContainerStarted","Data":"2c913cd1674bc616e4fb1c1dfced0f3e72d4859437d9af0a5cbe115be0f9294e"}
Jul 29 21:48:20.434685 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:20.434626    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49" podStartSLOduration=2.4346109 podStartE2EDuration="2.4346109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:48:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:48:20.432579525 +0000 UTC m=+2692.438102892" watchObservedRunningTime="2026-07-29 21:48:20.4346109 +0000 UTC m=+2692.440134269"
Jul 29 21:48:21.281260 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:21.281216    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:21.286201 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:21.286173    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:21.419576 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:21.419543    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:21.420512 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:21.420493    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:22.440041 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:22.440003    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:48:22.526690 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:22.526654    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:48:23.663847 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:23.663809    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:48:23.923513 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:23.923402    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:48:24.132552 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:24.132508    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:48:24.228064 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:24.227966    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:48:30.017519 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:30.017481    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:48:37.461591 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:37.461555    2575 patch_prober.go:28] interesting pod/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 21:48:37.461980 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:37.461626    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49" podUID="b96f21ad-56e8-4b03-a293-82bcc55bc24b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 21:48:38.509701 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:38.509616    2575 generic.go:356] "Generic (PLEG): container finished" podID="b96f21ad-56e8-4b03-a293-82bcc55bc24b" containerID="e21ab05ef9b795900124fe4d09d8b8ebd975f30f5d4e28fc4fae7346a812e85f" exitCode=0
Jul 29 21:48:38.510089 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:38.509695    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49" event={"ID":"b96f21ad-56e8-4b03-a293-82bcc55bc24b","Type":"ContainerDied","Data":"e21ab05ef9b795900124fe4d09d8b8ebd975f30f5d4e28fc4fae7346a812e85f"}
Jul 29 21:48:38.510089 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:38.510032    2575 scope.go:117] "RemoveContainer" containerID="e21ab05ef9b795900124fe4d09d8b8ebd975f30f5d4e28fc4fae7346a812e85f"
Jul 29 21:48:38.511109 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:38.511079    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:48:38.511180 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:38.511163    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:48:38.511221 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:38.511202    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:48:39.516681 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:39.516649    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49" event={"ID":"b96f21ad-56e8-4b03-a293-82bcc55bc24b","Type":"ContainerStarted","Data":"3e953185cdb1c37c072f84127ba579d2e34990a0f5740dfc55bb68bc8a7502fd"}
Jul 29 21:48:40.281325 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:40.281280    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:40.281545 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:40.281517    2575 patch_prober.go:28] interesting pod/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 29 21:48:40.281598 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:40.281573    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49" podUID="b96f21ad-56e8-4b03-a293-82bcc55bc24b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 29 21:48:41.281728 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:41.281687    2575 patch_prober.go:28] interesting pod/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 29 21:48:41.282124 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:41.281751    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49" podUID="b96f21ad-56e8-4b03-a293-82bcc55bc24b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 29 21:48:42.281345 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:42.281307    2575 patch_prober.go:28] interesting pod/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 29 21:48:42.281568 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:42.281367    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49" podUID="b96f21ad-56e8-4b03-a293-82bcc55bc24b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 29 21:48:43.282003 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:43.281967    2575 patch_prober.go:28] interesting pod/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 29 21:48:43.282398 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:43.282026    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49" podUID="b96f21ad-56e8-4b03-a293-82bcc55bc24b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 29 21:48:44.284887 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:44.284852    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:44.285347 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:44.285215    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:44.285951 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:44.285932    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 21:48:47.547985 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:47.547939    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:48:52.120989 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:52.120951    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:48:55.422711 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:48:55.422676    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:49:21.039118 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:49:21.039079    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:49:24.075574 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:49:24.075533    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:49:24.716809 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:49:24.716776    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:49:35.788703 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:49:35.788665    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:49:35.889822 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:49:35.889789    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:49:54.427562 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:49:54.427477    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:50:20.516107 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:50:20.516069    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:50:37.357272 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:50:37.357235    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:51:02.615374 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:51:02.615339    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:51:20.926062 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:51:20.925986    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:51:28.826439 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:51:28.826405    2575 scope.go:117] "RemoveContainer" containerID="6a6075f118d4356a4a61ee40e32277b2e48b09f48100879a9157f260884d4b51"
Jul 29 21:51:28.835691 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:51:28.835671    2575 scope.go:117] "RemoveContainer" containerID="235ece25bdeee24847be3b9f4e766557d3fcc50823f1fe0a352742301666ab2c"
Jul 29 21:51:28.844381 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:51:28.844358    2575 scope.go:117] "RemoveContainer" containerID="eed11a4fcc458e19c4cc3cc99462003c62b661f1e58b14f551793c8c15b69438"
Jul 29 21:51:43.324441 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:51:43.324398    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:52:03.117095 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:52:03.117056    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:52:28.873741 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:52:28.873710    2575 scope.go:117] "RemoveContainer" containerID="e557fbea26eb379aba7599d286839e6da70ae59b1df5eb2a9a94361715b342e7"
Jul 29 21:52:29.819321 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:52:29.819289    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:52:48.117600 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:52:48.117561    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:53:11.182958 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:53:11.182877    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:53:15.117806 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:53:15.117765    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:53:28.893992 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:53:28.893961    2575 scope.go:117] "RemoveContainer" containerID="b2bf7cad272311dab3fa1ccdb97778bfe3c41b0f51eb0ad5f0288086218460a9"
Jul 29 21:53:28.902390 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:53:28.902367    2575 scope.go:117] "RemoveContainer" containerID="1e99af0414f38c5ecb9e892bf34233ecf6e8d3b102a620c8e7150d2f19ad2ed1"
Jul 29 21:53:32.164828 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:53:32.164793    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:53:49.685646 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:53:49.685611    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:53:58.220136 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:53:58.220098    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:53:59.115091 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:53:59.115054    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:54:04.245531 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:54:04.245497    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:54:05.041141 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:54:05.041096    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:54:15.615223 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:54:15.615191    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:54:31.730884 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:54:31.730800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:54:35.167980 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:54:35.167949    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:54:50.227756 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:54:50.227716    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:54:53.633654 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:54:53.633619    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:55:37.025039 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:55:37.025005    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:55:55.221960 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:55:55.221880    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:56:01.995708 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:56:01.995675    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:56:02.058513 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:56:02.058480    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:56:15.920930 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:56:15.920893    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:56:22.739874 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:56:22.739836    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:56:23.634543 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:56:23.634504    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:56:28.962537 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:56:28.962497    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:56:30.322965 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:56:30.322932    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:56:40.726311 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:56:40.726270    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:57:15.614843 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:57:15.614813    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:57:19.327361 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:57:19.327322    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:57:28.312090 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:57:28.312002    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:57:47.435394 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:57:47.435356    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:58:08.814721 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:08.814685    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:58:15.359658 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:15.359622    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:58:16.861477 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:16.861406    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:58:17.147415 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.147334    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7730-139747280961584"]
Jul 29 21:58:17.147809 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.147793    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe9b456-1da7-4ab5-88e6-e247118cacbc" containerName="istio-proxy"
Jul 29 21:58:17.147858 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.147810    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe9b456-1da7-4ab5-88e6-e247118cacbc" containerName="istio-proxy"
Jul 29 21:58:17.147894 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.147879    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fe9b456-1da7-4ab5-88e6-e247118cacbc" containerName="istio-proxy"
Jul 29 21:58:17.150933 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.150916    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280961584"
Jul 29 21:58:17.153881 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.153856    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rxjvh\""
Jul 29 21:58:17.160596 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.160569    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7730-139747280961584"]
Jul 29 21:58:17.198846 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.198804    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4xmq\" (UniqueName: \"kubernetes.io/projected/f31ade4d-bf7f-46f2-90b2-5656112718e6-kube-api-access-z4xmq\") pod \"test-curl-7730-139747280961584\" (UID: \"f31ade4d-bf7f-46f2-90b2-5656112718e6\") " pod="opendatahub/test-curl-7730-139747280961584"
Jul 29 21:58:17.256319 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.256269    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ft956"]
Jul 29 21:58:17.259836 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.259818    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ft956"
Jul 29 21:58:17.263360 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.263340    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-brbft\""
Jul 29 21:58:17.271899 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.271876    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ft956"]
Jul 29 21:58:17.299466 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.299419    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4xmq\" (UniqueName: \"kubernetes.io/projected/f31ade4d-bf7f-46f2-90b2-5656112718e6-kube-api-access-z4xmq\") pod \"test-curl-7730-139747280961584\" (UID: \"f31ade4d-bf7f-46f2-90b2-5656112718e6\") " pod="opendatahub/test-curl-7730-139747280961584"
Jul 29 21:58:17.299619 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.299593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgkrw\" (UniqueName: \"kubernetes.io/projected/9b96ef70-718f-4710-b258-22bd103c10ff-kube-api-access-rgkrw\") pod \"kuadrant-operator-catalog-ft956\" (UID: \"9b96ef70-718f-4710-b258-22bd103c10ff\") " pod="kuadrant-system/kuadrant-operator-catalog-ft956"
Jul 29 21:58:17.309430 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.309401    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4xmq\" (UniqueName: \"kubernetes.io/projected/f31ade4d-bf7f-46f2-90b2-5656112718e6-kube-api-access-z4xmq\") pod \"test-curl-7730-139747280961584\" (UID: \"f31ade4d-bf7f-46f2-90b2-5656112718e6\") " pod="opendatahub/test-curl-7730-139747280961584"
Jul 29 21:58:17.400186 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.400094    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgkrw\" (UniqueName: \"kubernetes.io/projected/9b96ef70-718f-4710-b258-22bd103c10ff-kube-api-access-rgkrw\") pod \"kuadrant-operator-catalog-ft956\" (UID: \"9b96ef70-718f-4710-b258-22bd103c10ff\") " pod="kuadrant-system/kuadrant-operator-catalog-ft956"
Jul 29 21:58:17.413389 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.413360    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgkrw\" (UniqueName: \"kubernetes.io/projected/9b96ef70-718f-4710-b258-22bd103c10ff-kube-api-access-rgkrw\") pod \"kuadrant-operator-catalog-ft956\" (UID: \"9b96ef70-718f-4710-b258-22bd103c10ff\") " pod="kuadrant-system/kuadrant-operator-catalog-ft956"
Jul 29 21:58:17.461121 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.461083    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280961584"
Jul 29 21:58:17.572316 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.572236    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ft956"
Jul 29 21:58:17.616927 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.616889    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7730-139747280961584"]
Jul 29 21:58:17.619012 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:58:17.618984    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf31ade4d_bf7f_46f2_90b2_5656112718e6.slice/crio-de3475f9f69c5185967991f9c7cec6c85b8ac82c866fe68e83a1bd4975180fec WatchSource:0}: Error finding container de3475f9f69c5185967991f9c7cec6c85b8ac82c866fe68e83a1bd4975180fec: Status 404 returned error can't find the container with id de3475f9f69c5185967991f9c7cec6c85b8ac82c866fe68e83a1bd4975180fec
Jul 29 21:58:17.620164 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.620149    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 21:58:17.727695 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:17.727656    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ft956"]
Jul 29 21:58:17.730574 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:58:17.730532    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b96ef70_718f_4710_b258_22bd103c10ff.slice/crio-84b098a045515e1b8e3cedd93559c7ec0eec14e44ba3894e8fe20f548fbc2848 WatchSource:0}: Error finding container 84b098a045515e1b8e3cedd93559c7ec0eec14e44ba3894e8fe20f548fbc2848: Status 404 returned error can't find the container with id 84b098a045515e1b8e3cedd93559c7ec0eec14e44ba3894e8fe20f548fbc2848
Jul 29 21:58:18.541089 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:18.541055    2575 generic.go:356] "Generic (PLEG): container finished" podID="f31ade4d-bf7f-46f2-90b2-5656112718e6" containerID="522a624221d548e17afbfdeb2b2bc4092a34424afb6bcd8b8bfb72488b1b45a1" exitCode=0
Jul 29 21:58:18.541617 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:18.541106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7730-139747280961584" event={"ID":"f31ade4d-bf7f-46f2-90b2-5656112718e6","Type":"ContainerDied","Data":"522a624221d548e17afbfdeb2b2bc4092a34424afb6bcd8b8bfb72488b1b45a1"}
Jul 29 21:58:18.541617 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:18.541152    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7730-139747280961584" event={"ID":"f31ade4d-bf7f-46f2-90b2-5656112718e6","Type":"ContainerStarted","Data":"de3475f9f69c5185967991f9c7cec6c85b8ac82c866fe68e83a1bd4975180fec"}
Jul 29 21:58:18.542594 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:18.542562    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ft956" event={"ID":"9b96ef70-718f-4710-b258-22bd103c10ff","Type":"ContainerStarted","Data":"84b098a045515e1b8e3cedd93559c7ec0eec14e44ba3894e8fe20f548fbc2848"}
Jul 29 21:58:19.882738 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:19.882701    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280961584"
Jul 29 21:58:19.905307 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:19.905276    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7730-139747280961584_f31ade4d-bf7f-46f2-90b2-5656112718e6/test-curl-7730-139747280961584/0.log"
Jul 29 21:58:19.925591 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:19.925562    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4xmq\" (UniqueName: \"kubernetes.io/projected/f31ade4d-bf7f-46f2-90b2-5656112718e6-kube-api-access-z4xmq\") pod \"f31ade4d-bf7f-46f2-90b2-5656112718e6\" (UID: \"f31ade4d-bf7f-46f2-90b2-5656112718e6\") "
Jul 29 21:58:19.927995 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:19.927960    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f31ade4d-bf7f-46f2-90b2-5656112718e6-kube-api-access-z4xmq" (OuterVolumeSpecName: "kube-api-access-z4xmq") pod "f31ade4d-bf7f-46f2-90b2-5656112718e6" (UID: "f31ade4d-bf7f-46f2-90b2-5656112718e6"). InnerVolumeSpecName "kube-api-access-z4xmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:58:19.929182 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:19.929160    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7730-139747280961584"]
Jul 29 21:58:19.933259 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:19.933223    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7730-139747280961584"]
Jul 29 21:58:20.027201 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.027169    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4xmq\" (UniqueName: \"kubernetes.io/projected/f31ade4d-bf7f-46f2-90b2-5656112718e6-kube-api-access-z4xmq\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:58:20.064006 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.063968    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7730-139747280909488"]
Jul 29 21:58:20.064494 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.064463    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f31ade4d-bf7f-46f2-90b2-5656112718e6" containerName="test-curl-7730-139747280961584"
Jul 29 21:58:20.064494 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.064495    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f31ade4d-bf7f-46f2-90b2-5656112718e6" containerName="test-curl-7730-139747280961584"
Jul 29 21:58:20.064656 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.064587    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f31ade4d-bf7f-46f2-90b2-5656112718e6" containerName="test-curl-7730-139747280961584"
Jul 29 21:58:20.067968 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.067949    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280909488"
Jul 29 21:58:20.075995 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.075967    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7730-139747280909488"]
Jul 29 21:58:20.127972 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.127883    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6t64\" (UniqueName: \"kubernetes.io/projected/399b8ccf-0856-4872-82bc-780ce3b2e4fa-kube-api-access-p6t64\") pod \"test-curl-7730-139747280909488\" (UID: \"399b8ccf-0856-4872-82bc-780ce3b2e4fa\") " pod="opendatahub/test-curl-7730-139747280909488"
Jul 29 21:58:20.229497 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.229427    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6t64\" (UniqueName: \"kubernetes.io/projected/399b8ccf-0856-4872-82bc-780ce3b2e4fa-kube-api-access-p6t64\") pod \"test-curl-7730-139747280909488\" (UID: \"399b8ccf-0856-4872-82bc-780ce3b2e4fa\") " pod="opendatahub/test-curl-7730-139747280909488"
Jul 29 21:58:20.238176 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.238141    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6t64\" (UniqueName: \"kubernetes.io/projected/399b8ccf-0856-4872-82bc-780ce3b2e4fa-kube-api-access-p6t64\") pod \"test-curl-7730-139747280909488\" (UID: \"399b8ccf-0856-4872-82bc-780ce3b2e4fa\") " pod="opendatahub/test-curl-7730-139747280909488"
Jul 29 21:58:20.377885 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.377841    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280909488"
Jul 29 21:58:20.484170 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.484119    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f31ade4d-bf7f-46f2-90b2-5656112718e6" path="/var/lib/kubelet/pods/f31ade4d-bf7f-46f2-90b2-5656112718e6/volumes"
Jul 29 21:58:20.525021 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.524993    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7730-139747280909488"]
Jul 29 21:58:20.526469 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:58:20.526432    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod399b8ccf_0856_4872_82bc_780ce3b2e4fa.slice/crio-4c5eb2e755c79acd4e2724abf2d638848daf9fd4142434af3d0eeac76cf4ab27 WatchSource:0}: Error finding container 4c5eb2e755c79acd4e2724abf2d638848daf9fd4142434af3d0eeac76cf4ab27: Status 404 returned error can't find the container with id 4c5eb2e755c79acd4e2724abf2d638848daf9fd4142434af3d0eeac76cf4ab27
Jul 29 21:58:20.556460 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.556420    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7730-139747280909488" event={"ID":"399b8ccf-0856-4872-82bc-780ce3b2e4fa","Type":"ContainerStarted","Data":"4c5eb2e755c79acd4e2724abf2d638848daf9fd4142434af3d0eeac76cf4ab27"}
Jul 29 21:58:20.557574 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.557553    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280961584"
Jul 29 21:58:20.557574 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.557571    2575 scope.go:117] "RemoveContainer" containerID="522a624221d548e17afbfdeb2b2bc4092a34424afb6bcd8b8bfb72488b1b45a1"
Jul 29 21:58:20.559138 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.559110    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ft956" event={"ID":"9b96ef70-718f-4710-b258-22bd103c10ff","Type":"ContainerStarted","Data":"29d917da5fb71a883909397f39f7e11dc7d757cb1e33ee77e63eeb567e5889ac"}
Jul 29 21:58:20.616668 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:20.616615    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ft956" podStartSLOduration=1.413418038 podStartE2EDuration="3.616599882s" totalImagesPullingTime="2.203181844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:58:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:58:20.616006273 +0000 UTC m=+3292.621529632" watchObservedRunningTime="2026-07-29 21:58:20.616599882 +0000 UTC m=+3292.622123250"
Jul 29 21:58:21.565891 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:21.565857    2575 generic.go:356] "Generic (PLEG): container finished" podID="399b8ccf-0856-4872-82bc-780ce3b2e4fa" containerID="5f427ea8d6e1defa721942bc61b2c1d11bb90bc559fb57f3beba44b9ea3f6616" exitCode=0
Jul 29 21:58:21.566291 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:21.565939    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7730-139747280909488" event={"ID":"399b8ccf-0856-4872-82bc-780ce3b2e4fa","Type":"ContainerDied","Data":"5f427ea8d6e1defa721942bc61b2c1d11bb90bc559fb57f3beba44b9ea3f6616"}
Jul 29 21:58:22.707380 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:22.707355    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280909488"
Jul 29 21:58:22.726761 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:22.726740    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7730-139747280909488_399b8ccf-0856-4872-82bc-780ce3b2e4fa/test-curl-7730-139747280909488/0.log"
Jul 29 21:58:22.751602 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:22.751569    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7730-139747280909488"]
Jul 29 21:58:22.752262 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:22.752241    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6t64\" (UniqueName: \"kubernetes.io/projected/399b8ccf-0856-4872-82bc-780ce3b2e4fa-kube-api-access-p6t64\") pod \"399b8ccf-0856-4872-82bc-780ce3b2e4fa\" (UID: \"399b8ccf-0856-4872-82bc-780ce3b2e4fa\") "
Jul 29 21:58:22.754340 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:22.754310    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/399b8ccf-0856-4872-82bc-780ce3b2e4fa-kube-api-access-p6t64" (OuterVolumeSpecName: "kube-api-access-p6t64") pod "399b8ccf-0856-4872-82bc-780ce3b2e4fa" (UID: "399b8ccf-0856-4872-82bc-780ce3b2e4fa"). InnerVolumeSpecName "kube-api-access-p6t64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:58:22.758843 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:22.758818    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7730-139747280909488"]
Jul 29 21:58:22.853803 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:22.853717    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6t64\" (UniqueName: \"kubernetes.io/projected/399b8ccf-0856-4872-82bc-780ce3b2e4fa-kube-api-access-p6t64\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:58:22.917315 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:22.917278    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7730-139747280795664"]
Jul 29 21:58:22.917733 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:22.917719    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="399b8ccf-0856-4872-82bc-780ce3b2e4fa" containerName="test-curl-7730-139747280909488"
Jul 29 21:58:22.917784 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:22.917734    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="399b8ccf-0856-4872-82bc-780ce3b2e4fa" containerName="test-curl-7730-139747280909488"
Jul 29 21:58:22.917820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:22.917812    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="399b8ccf-0856-4872-82bc-780ce3b2e4fa" containerName="test-curl-7730-139747280909488"
Jul 29 21:58:22.920867 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:22.920852    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280795664"
Jul 29 21:58:22.924606 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:22.924576    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7730-139747280795664"]
Jul 29 21:58:22.954346 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:22.954309    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kchns\" (UniqueName: \"kubernetes.io/projected/6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc-kube-api-access-kchns\") pod \"test-curl-7730-139747280795664\" (UID: \"6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc\") " pod="opendatahub/test-curl-7730-139747280795664"
Jul 29 21:58:23.055251 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:23.055214    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kchns\" (UniqueName: \"kubernetes.io/projected/6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc-kube-api-access-kchns\") pod \"test-curl-7730-139747280795664\" (UID: \"6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc\") " pod="opendatahub/test-curl-7730-139747280795664"
Jul 29 21:58:23.064983 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:23.064947    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kchns\" (UniqueName: \"kubernetes.io/projected/6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc-kube-api-access-kchns\") pod \"test-curl-7730-139747280795664\" (UID: \"6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc\") " pod="opendatahub/test-curl-7730-139747280795664"
Jul 29 21:58:23.231013 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:23.230930    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280795664"
Jul 29 21:58:23.361614 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:23.361582    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7730-139747280795664"]
Jul 29 21:58:23.364794 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:58:23.364759    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d4b6e82_c66c_4a06_80f8_b37cc9fdf3dc.slice/crio-2a1108a5197eb4a50a10877b0b4d6b64f0c2e3e90f8a1c27924fe7011a255dc1 WatchSource:0}: Error finding container 2a1108a5197eb4a50a10877b0b4d6b64f0c2e3e90f8a1c27924fe7011a255dc1: Status 404 returned error can't find the container with id 2a1108a5197eb4a50a10877b0b4d6b64f0c2e3e90f8a1c27924fe7011a255dc1
Jul 29 21:58:23.579775 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:23.579739    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280909488"
Jul 29 21:58:23.579936 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:23.579796    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c5eb2e755c79acd4e2724abf2d638848daf9fd4142434af3d0eeac76cf4ab27"
Jul 29 21:58:23.580885 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:23.580860    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7730-139747280795664" event={"ID":"6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc","Type":"ContainerStarted","Data":"2a1108a5197eb4a50a10877b0b4d6b64f0c2e3e90f8a1c27924fe7011a255dc1"}
Jul 29 21:58:23.590666 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:58:23.590642    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7730-139747280909488\" is forbidden: User \"system:node:ip-10-0-134-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-66.ec2.internal' and this object" podUID="399b8ccf-0856-4872-82bc-780ce3b2e4fa" pod="opendatahub/test-curl-7730-139747280909488"
Jul 29 21:58:24.482973 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:24.482942    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="399b8ccf-0856-4872-82bc-780ce3b2e4fa" path="/var/lib/kubelet/pods/399b8ccf-0856-4872-82bc-780ce3b2e4fa/volumes"
Jul 29 21:58:24.594380 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:24.594336    2575 generic.go:356] "Generic (PLEG): container finished" podID="6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc" containerID="40a77d94f5e704664f07dd9d14880f139178b5e0e5f3a8b34a183494ad4e72eb" exitCode=0
Jul 29 21:58:24.594567 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:24.594423    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7730-139747280795664" event={"ID":"6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc","Type":"ContainerDied","Data":"40a77d94f5e704664f07dd9d14880f139178b5e0e5f3a8b34a183494ad4e72eb"}
Jul 29 21:58:25.736403 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:25.736372    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280795664"
Jul 29 21:58:25.756824 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:25.756786    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7730-139747280795664_6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc/test-curl-7730-139747280795664/0.log"
Jul 29 21:58:25.781045 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:25.781006    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7730-139747280795664"]
Jul 29 21:58:25.781873 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:25.781849    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kchns\" (UniqueName: \"kubernetes.io/projected/6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc-kube-api-access-kchns\") pod \"6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc\" (UID: \"6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc\") "
Jul 29 21:58:25.783428 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:25.783406    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7730-139747280795664"]
Jul 29 21:58:25.784124 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:25.784093    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc-kube-api-access-kchns" (OuterVolumeSpecName: "kube-api-access-kchns") pod "6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc" (UID: "6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc"). InnerVolumeSpecName "kube-api-access-kchns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:58:25.883168 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:25.883095    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kchns\" (UniqueName: \"kubernetes.io/projected/6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc-kube-api-access-kchns\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:58:25.901714 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:25.901679    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7730-139747280795664"]
Jul 29 21:58:25.902181 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:25.902162    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc" containerName="test-curl-7730-139747280795664"
Jul 29 21:58:25.902258 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:25.902184    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc" containerName="test-curl-7730-139747280795664"
Jul 29 21:58:25.902330 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:25.902296    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc" containerName="test-curl-7730-139747280795664"
Jul 29 21:58:25.905392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:25.905373    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280795664"
Jul 29 21:58:25.909410 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:25.909390    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7730-139747280795664"]
Jul 29 21:58:25.983804 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:25.983774    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlbgp\" (UniqueName: \"kubernetes.io/projected/0dac8c6e-7682-4deb-a5f8-93152ed8712c-kube-api-access-dlbgp\") pod \"test-curl-7730-139747280795664\" (UID: \"0dac8c6e-7682-4deb-a5f8-93152ed8712c\") " pod="opendatahub/test-curl-7730-139747280795664"
Jul 29 21:58:26.085240 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:26.085203    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlbgp\" (UniqueName: \"kubernetes.io/projected/0dac8c6e-7682-4deb-a5f8-93152ed8712c-kube-api-access-dlbgp\") pod \"test-curl-7730-139747280795664\" (UID: \"0dac8c6e-7682-4deb-a5f8-93152ed8712c\") " pod="opendatahub/test-curl-7730-139747280795664"
Jul 29 21:58:26.093276 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:26.093246    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlbgp\" (UniqueName: \"kubernetes.io/projected/0dac8c6e-7682-4deb-a5f8-93152ed8712c-kube-api-access-dlbgp\") pod \"test-curl-7730-139747280795664\" (UID: \"0dac8c6e-7682-4deb-a5f8-93152ed8712c\") " pod="opendatahub/test-curl-7730-139747280795664"
Jul 29 21:58:26.216346 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:26.216275    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280795664"
Jul 29 21:58:26.351067 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:26.351041    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7730-139747280795664"]
Jul 29 21:58:26.352948 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:58:26.352922    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0dac8c6e_7682_4deb_a5f8_93152ed8712c.slice/crio-2796dadd61a80170f3b7d77d74b456e78b7442b66ad9da98748b223c5ccf587e WatchSource:0}: Error finding container 2796dadd61a80170f3b7d77d74b456e78b7442b66ad9da98748b223c5ccf587e: Status 404 returned error can't find the container with id 2796dadd61a80170f3b7d77d74b456e78b7442b66ad9da98748b223c5ccf587e
Jul 29 21:58:26.482944 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:26.482860    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc" path="/var/lib/kubelet/pods/6d4b6e82-c66c-4a06-80f8-b37cc9fdf3dc/volumes"
Jul 29 21:58:26.606222 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:26.606179    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7730-139747280795664" event={"ID":"0dac8c6e-7682-4deb-a5f8-93152ed8712c","Type":"ContainerStarted","Data":"2796dadd61a80170f3b7d77d74b456e78b7442b66ad9da98748b223c5ccf587e"}
Jul 29 21:58:26.607319 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:26.607300    2575 scope.go:117] "RemoveContainer" containerID="40a77d94f5e704664f07dd9d14880f139178b5e0e5f3a8b34a183494ad4e72eb"
Jul 29 21:58:26.607426 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:26.607322    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280795664"
Jul 29 21:58:27.572387 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:27.572351    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ft956"
Jul 29 21:58:27.572839 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:27.572628    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ft956"
Jul 29 21:58:27.595143 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:27.595114    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ft956"
Jul 29 21:58:27.614762 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:27.614737    2575 generic.go:356] "Generic (PLEG): container finished" podID="0dac8c6e-7682-4deb-a5f8-93152ed8712c" containerID="7e3965011bf411bf43038d2bed89a15d16bd60d7b63f68d1d54c011779ab71b8" exitCode=0
Jul 29 21:58:27.614901 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:27.614798    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7730-139747280795664" event={"ID":"0dac8c6e-7682-4deb-a5f8-93152ed8712c","Type":"ContainerDied","Data":"7e3965011bf411bf43038d2bed89a15d16bd60d7b63f68d1d54c011779ab71b8"}
Jul 29 21:58:27.636120 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:27.636095    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ft956"
Jul 29 21:58:27.822488 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:27.822373    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ft956"]
Jul 29 21:58:28.116940 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:28.116847    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:58:28.753363 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:28.753338    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280795664"
Jul 29 21:58:28.775396 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:28.775369    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7730-139747280795664_0dac8c6e-7682-4deb-a5f8-93152ed8712c/test-curl-7730-139747280795664/0.log"
Jul 29 21:58:28.798552 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:28.798522    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7730-139747280795664"]
Jul 29 21:58:28.804101 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:28.804077    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7730-139747280795664"]
Jul 29 21:58:28.813270 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:28.813251    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlbgp\" (UniqueName: \"kubernetes.io/projected/0dac8c6e-7682-4deb-a5f8-93152ed8712c-kube-api-access-dlbgp\") pod \"0dac8c6e-7682-4deb-a5f8-93152ed8712c\" (UID: \"0dac8c6e-7682-4deb-a5f8-93152ed8712c\") "
Jul 29 21:58:28.815286 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:28.815258    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dac8c6e-7682-4deb-a5f8-93152ed8712c-kube-api-access-dlbgp" (OuterVolumeSpecName: "kube-api-access-dlbgp") pod "0dac8c6e-7682-4deb-a5f8-93152ed8712c" (UID: "0dac8c6e-7682-4deb-a5f8-93152ed8712c"). InnerVolumeSpecName "kube-api-access-dlbgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:58:28.914225 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:28.914139    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlbgp\" (UniqueName: \"kubernetes.io/projected/0dac8c6e-7682-4deb-a5f8-93152ed8712c-kube-api-access-dlbgp\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:58:28.938194 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:28.938163    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7730-139747280796672"]
Jul 29 21:58:28.938576 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:28.938564    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dac8c6e-7682-4deb-a5f8-93152ed8712c" containerName="test-curl-7730-139747280795664"
Jul 29 21:58:28.938635 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:28.938578    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dac8c6e-7682-4deb-a5f8-93152ed8712c" containerName="test-curl-7730-139747280795664"
Jul 29 21:58:28.938673 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:28.938664    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dac8c6e-7682-4deb-a5f8-93152ed8712c" containerName="test-curl-7730-139747280795664"
Jul 29 21:58:28.941730 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:28.941714    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280796672"
Jul 29 21:58:28.946201 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:28.946180    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7730-139747280796672"]
Jul 29 21:58:29.015215 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:29.015175    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndpnd\" (UniqueName: \"kubernetes.io/projected/fa3c9201-a891-4244-b6d2-6465df95f37d-kube-api-access-ndpnd\") pod \"test-curl-7730-139747280796672\" (UID: \"fa3c9201-a891-4244-b6d2-6465df95f37d\") " pod="opendatahub/test-curl-7730-139747280796672"
Jul 29 21:58:29.116749 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:29.116700    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndpnd\" (UniqueName: \"kubernetes.io/projected/fa3c9201-a891-4244-b6d2-6465df95f37d-kube-api-access-ndpnd\") pod \"test-curl-7730-139747280796672\" (UID: \"fa3c9201-a891-4244-b6d2-6465df95f37d\") " pod="opendatahub/test-curl-7730-139747280796672"
Jul 29 21:58:29.126631 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:29.126605    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndpnd\" (UniqueName: \"kubernetes.io/projected/fa3c9201-a891-4244-b6d2-6465df95f37d-kube-api-access-ndpnd\") pod \"test-curl-7730-139747280796672\" (UID: \"fa3c9201-a891-4244-b6d2-6465df95f37d\") " pod="opendatahub/test-curl-7730-139747280796672"
Jul 29 21:58:29.252928 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:29.252848    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280796672"
Jul 29 21:58:29.387365 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:29.387336    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7730-139747280796672"]
Jul 29 21:58:29.388984 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:58:29.388956    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa3c9201_a891_4244_b6d2_6465df95f37d.slice/crio-be5f310d6f5964e4d6f5f5ae8d84a5fa13424f67444b2d4b121d32ba34ddbf0f WatchSource:0}: Error finding container be5f310d6f5964e4d6f5f5ae8d84a5fa13424f67444b2d4b121d32ba34ddbf0f: Status 404 returned error can't find the container with id be5f310d6f5964e4d6f5f5ae8d84a5fa13424f67444b2d4b121d32ba34ddbf0f
Jul 29 21:58:29.625880 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:29.625844    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7730-139747280796672" event={"ID":"fa3c9201-a891-4244-b6d2-6465df95f37d","Type":"ContainerStarted","Data":"be5f310d6f5964e4d6f5f5ae8d84a5fa13424f67444b2d4b121d32ba34ddbf0f"}
Jul 29 21:58:29.627120 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:29.627098    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280795664"
Jul 29 21:58:29.627248 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:29.627135    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2796dadd61a80170f3b7d77d74b456e78b7442b66ad9da98748b223c5ccf587e"
Jul 29 21:58:29.627248 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:29.627166    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ft956" podUID="9b96ef70-718f-4710-b258-22bd103c10ff" containerName="registry-server" containerID="cri-o://29d917da5fb71a883909397f39f7e11dc7d757cb1e33ee77e63eeb567e5889ac" gracePeriod=2
Jul 29 21:58:29.646481 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:58:29.646454    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7730-139747280795664\" is forbidden: User \"system:node:ip-10-0-134-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-66.ec2.internal' and this object" podUID="0dac8c6e-7682-4deb-a5f8-93152ed8712c" pod="opendatahub/test-curl-7730-139747280795664"
Jul 29 21:58:29.899177 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:29.899154    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ft956"
Jul 29 21:58:29.918405 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:58:29.918373    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7730-139747280795664\" is forbidden: User \"system:node:ip-10-0-134-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-66.ec2.internal' and this object" podUID="0dac8c6e-7682-4deb-a5f8-93152ed8712c" pod="opendatahub/test-curl-7730-139747280795664"
Jul 29 21:58:30.026785 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:30.026754    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgkrw\" (UniqueName: \"kubernetes.io/projected/9b96ef70-718f-4710-b258-22bd103c10ff-kube-api-access-rgkrw\") pod \"9b96ef70-718f-4710-b258-22bd103c10ff\" (UID: \"9b96ef70-718f-4710-b258-22bd103c10ff\") "
Jul 29 21:58:30.029019 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:30.028990    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b96ef70-718f-4710-b258-22bd103c10ff-kube-api-access-rgkrw" (OuterVolumeSpecName: "kube-api-access-rgkrw") pod "9b96ef70-718f-4710-b258-22bd103c10ff" (UID: "9b96ef70-718f-4710-b258-22bd103c10ff"). InnerVolumeSpecName "kube-api-access-rgkrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:58:30.127831 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:30.127801    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgkrw\" (UniqueName: \"kubernetes.io/projected/9b96ef70-718f-4710-b258-22bd103c10ff-kube-api-access-rgkrw\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:58:30.489357 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:30.489314    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dac8c6e-7682-4deb-a5f8-93152ed8712c" path="/var/lib/kubelet/pods/0dac8c6e-7682-4deb-a5f8-93152ed8712c/volumes"
Jul 29 21:58:30.633833 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:30.633801    2575 generic.go:356] "Generic (PLEG): container finished" podID="9b96ef70-718f-4710-b258-22bd103c10ff" containerID="29d917da5fb71a883909397f39f7e11dc7d757cb1e33ee77e63eeb567e5889ac" exitCode=0
Jul 29 21:58:30.634020 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:30.633873    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ft956"
Jul 29 21:58:30.634020 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:30.633891    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ft956" event={"ID":"9b96ef70-718f-4710-b258-22bd103c10ff","Type":"ContainerDied","Data":"29d917da5fb71a883909397f39f7e11dc7d757cb1e33ee77e63eeb567e5889ac"}
Jul 29 21:58:30.634020 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:30.633949    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ft956" event={"ID":"9b96ef70-718f-4710-b258-22bd103c10ff","Type":"ContainerDied","Data":"84b098a045515e1b8e3cedd93559c7ec0eec14e44ba3894e8fe20f548fbc2848"}
Jul 29 21:58:30.634020 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:30.633972    2575 scope.go:117] "RemoveContainer" containerID="29d917da5fb71a883909397f39f7e11dc7d757cb1e33ee77e63eeb567e5889ac"
Jul 29 21:58:30.635585 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:30.635559    2575 generic.go:356] "Generic (PLEG): container finished" podID="fa3c9201-a891-4244-b6d2-6465df95f37d" containerID="9172552154a2a91ceb8ad4134584a4bd5f0e0b122d14c8ca5bbede5a39dc1c9d" exitCode=0
Jul 29 21:58:30.635704 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:30.635676    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7730-139747280796672" event={"ID":"fa3c9201-a891-4244-b6d2-6465df95f37d","Type":"ContainerDied","Data":"9172552154a2a91ceb8ad4134584a4bd5f0e0b122d14c8ca5bbede5a39dc1c9d"}
Jul 29 21:58:30.643866 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:30.643843    2575 scope.go:117] "RemoveContainer" containerID="29d917da5fb71a883909397f39f7e11dc7d757cb1e33ee77e63eeb567e5889ac"
Jul 29 21:58:30.644119 ip-10-0-134-66 kubenswrapper[2575]: E0729 21:58:30.644097    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29d917da5fb71a883909397f39f7e11dc7d757cb1e33ee77e63eeb567e5889ac\": container with ID starting with 29d917da5fb71a883909397f39f7e11dc7d757cb1e33ee77e63eeb567e5889ac not found: ID does not exist" containerID="29d917da5fb71a883909397f39f7e11dc7d757cb1e33ee77e63eeb567e5889ac"
Jul 29 21:58:30.644198 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:30.644125    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29d917da5fb71a883909397f39f7e11dc7d757cb1e33ee77e63eeb567e5889ac"} err="failed to get container status \"29d917da5fb71a883909397f39f7e11dc7d757cb1e33ee77e63eeb567e5889ac\": rpc error: code = NotFound desc = could not find container \"29d917da5fb71a883909397f39f7e11dc7d757cb1e33ee77e63eeb567e5889ac\": container with ID starting with 29d917da5fb71a883909397f39f7e11dc7d757cb1e33ee77e63eeb567e5889ac not found: ID does not exist"
Jul 29 21:58:30.651922 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:30.651900    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ft956"]
Jul 29 21:58:30.656127 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:30.656099    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ft956"]
Jul 29 21:58:31.784588 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:31.784560    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280796672"
Jul 29 21:58:31.805338 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:31.805311    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7730-139747280796672_fa3c9201-a891-4244-b6d2-6465df95f37d/test-curl-7730-139747280796672/0.log"
Jul 29 21:58:31.829584 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:31.829555    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7730-139747280796672"]
Jul 29 21:58:31.833976 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:31.833951    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7730-139747280796672"]
Jul 29 21:58:31.844119 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:31.844099    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndpnd\" (UniqueName: \"kubernetes.io/projected/fa3c9201-a891-4244-b6d2-6465df95f37d-kube-api-access-ndpnd\") pod \"fa3c9201-a891-4244-b6d2-6465df95f37d\" (UID: \"fa3c9201-a891-4244-b6d2-6465df95f37d\") "
Jul 29 21:58:31.846209 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:31.846183    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa3c9201-a891-4244-b6d2-6465df95f37d-kube-api-access-ndpnd" (OuterVolumeSpecName: "kube-api-access-ndpnd") pod "fa3c9201-a891-4244-b6d2-6465df95f37d" (UID: "fa3c9201-a891-4244-b6d2-6465df95f37d"). InnerVolumeSpecName "kube-api-access-ndpnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 21:58:31.945949 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:31.945866    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndpnd\" (UniqueName: \"kubernetes.io/projected/fa3c9201-a891-4244-b6d2-6465df95f37d-kube-api-access-ndpnd\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 21:58:32.485171 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:32.485140    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b96ef70-718f-4710-b258-22bd103c10ff" path="/var/lib/kubelet/pods/9b96ef70-718f-4710-b258-22bd103c10ff/volumes"
Jul 29 21:58:32.485533 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:32.485519    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa3c9201-a891-4244-b6d2-6465df95f37d" path="/var/lib/kubelet/pods/fa3c9201-a891-4244-b6d2-6465df95f37d/volumes"
Jul 29 21:58:32.648792 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:32.648761    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7730-139747280796672"
Jul 29 21:58:32.648792 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:32.648789    2575 scope.go:117] "RemoveContainer" containerID="9172552154a2a91ceb8ad4134584a4bd5f0e0b122d14c8ca5bbede5a39dc1c9d"
Jul 29 21:58:35.210578 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.210527    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:58:35.558562 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.558528    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"]
Jul 29 21:58:35.558990 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.558977    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b96ef70-718f-4710-b258-22bd103c10ff" containerName="registry-server"
Jul 29 21:58:35.559045 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.558995    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b96ef70-718f-4710-b258-22bd103c10ff" containerName="registry-server"
Jul 29 21:58:35.559045 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.559018    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa3c9201-a891-4244-b6d2-6465df95f37d" containerName="test-curl-7730-139747280796672"
Jul 29 21:58:35.559045 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.559025    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa3c9201-a891-4244-b6d2-6465df95f37d" containerName="test-curl-7730-139747280796672"
Jul 29 21:58:35.559145 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.559105    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa3c9201-a891-4244-b6d2-6465df95f37d" containerName="test-curl-7730-139747280796672"
Jul 29 21:58:35.559145 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.559114    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b96ef70-718f-4710-b258-22bd103c10ff" containerName="registry-server"
Jul 29 21:58:35.563513 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.563494    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.567574 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.567554    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-a0dedf-openshift-default-dockercfg-hznb8\""
Jul 29 21:58:35.583472 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.583431    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"]
Jul 29 21:58:35.589914 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.589881    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:58:35.683787 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.683737    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istiod-ca-cert\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.683968 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.683816    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-token\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.683968 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.683850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-envoy\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.683968 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.683887    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-workload-socket\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.684179 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.683957    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-podinfo\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.684179 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.684009    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-data\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.684179 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.684077    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-credential-socket\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.684179 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.684143    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnqt7\" (UniqueName: \"kubernetes.io/projected/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-kube-api-access-rnqt7\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.684333 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.684192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-workload-certs\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.785347 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.785308    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-data\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.785548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.785363    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-credential-socket\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.785548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.785400    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnqt7\" (UniqueName: \"kubernetes.io/projected/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-kube-api-access-rnqt7\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.785548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.785439    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-workload-certs\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.785548 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.785509    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istiod-ca-cert\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.785787 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.785552    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-token\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.785787 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.785580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-envoy\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.785787 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.785616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-workload-socket\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.785787 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.785644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-podinfo\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.785971 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.785846    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-credential-socket\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.785971 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.785891    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-data\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.786076 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.786050    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-workload-socket\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.786197 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.786175    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-workload-certs\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.786568 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.786549    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istiod-ca-cert\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.788115 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.788088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-envoy\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.788253 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.788234    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-podinfo\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.793804 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.793780    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-token\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.794392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.794368    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnqt7\" (UniqueName: \"kubernetes.io/projected/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-kube-api-access-rnqt7\") pod \"e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") " pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.873241 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.873169    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:35.970996 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:35.970964    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:58:36.043217 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:36.043192    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"]
Jul 29 21:58:36.046029 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:58:36.045995    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93ed99f5_3b9d_47ce_917e_fe574fa4e5c2.slice/crio-7220cb3759797c98d97d904d36f03455e4ee0faa6b9bb6d2d2032fe173bca84c WatchSource:0}: Error finding container 7220cb3759797c98d97d904d36f03455e4ee0faa6b9bb6d2d2032fe173bca84c: Status 404 returned error can't find the container with id 7220cb3759797c98d97d904d36f03455e4ee0faa6b9bb6d2d2032fe173bca84c
Jul 29 21:58:36.048360 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:36.048322    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:58:36.048468 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:36.048406    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:58:36.048468 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:36.048462    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:58:36.677600 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:36.677554    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r" event={"ID":"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2","Type":"ContainerStarted","Data":"35a7f36398f89d4a52d9ebef7e302a7b691120013de150276338ceb619749d18"}
Jul 29 21:58:36.677981 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:36.677619    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r" event={"ID":"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2","Type":"ContainerStarted","Data":"7220cb3759797c98d97d904d36f03455e4ee0faa6b9bb6d2d2032fe173bca84c"}
Jul 29 21:58:36.698344 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:36.698283    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r" podStartSLOduration=1.698268838 podStartE2EDuration="1.698268838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:58:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:58:36.697257551 +0000 UTC m=+3308.702780948" watchObservedRunningTime="2026-07-29 21:58:36.698268838 +0000 UTC m=+3308.703792267"
Jul 29 21:58:36.873419 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:36.873381    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:37.878585 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:37.878554    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:38.678240 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:38.678206    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:58:38.688979 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:38.688952    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:38.689788 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:38.689767    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:38.786329 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:38.786296    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:58:39.903783 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:39.903745    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:58:40.078728 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:40.078699    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:58:40.545169 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:40.545134    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:58:40.652991 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:40.652961    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:58:43.174529 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:43.174490    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:58:47.618883 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:47.618836    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:58:54.731635 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:54.731592    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 21:58:54.732198 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:54.731665    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r" podUID="93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 21:58:55.797503 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:55.797471    2575 generic.go:356] "Generic (PLEG): container finished" podID="93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" containerID="35a7f36398f89d4a52d9ebef7e302a7b691120013de150276338ceb619749d18" exitCode=0
Jul 29 21:58:55.798033 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:55.797536    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r" event={"ID":"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2","Type":"ContainerDied","Data":"35a7f36398f89d4a52d9ebef7e302a7b691120013de150276338ceb619749d18"}
Jul 29 21:58:55.798103 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:55.798085    2575 scope.go:117] "RemoveContainer" containerID="35a7f36398f89d4a52d9ebef7e302a7b691120013de150276338ceb619749d18"
Jul 29 21:58:55.799172 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:55.799142    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:58:55.799274 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:55.799218    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:58:55.799274 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:55.799259    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:58:56.804414 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:56.804378    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r" event={"ID":"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2","Type":"ContainerStarted","Data":"59a7845e60a309b3123f8793798cadf92caa18051909734ec4104df1d5858610"}
Jul 29 21:58:56.874147 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:56.874104    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:58:56.874329 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:56.874307    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 29 21:58:56.874397 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:56.874377    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r" podUID="93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 29 21:58:57.874331 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:57.874297    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 29 21:58:57.874737 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:57.874354    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r" podUID="93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 29 21:58:58.874274 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:58.874232    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 29 21:58:58.874481 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:58.874296    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r" podUID="93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 29 21:58:59.874296 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:59.874260    2575 patch_prober.go:28] interesting pod/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 29 21:58:59.874502 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:58:59.874314    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r" podUID="93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 29 21:59:00.877558 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:00.877526    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:59:00.877987 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:00.877794    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:59:00.878377 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:00.878357    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 21:59:03.727249 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:03.727162    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:59:04.486133 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.486089    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:59:04.805493 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.805148    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"]
Jul 29 21:59:04.813214 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.813182    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.816742 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.816461    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-50d50c-openshift-default-dockercfg-ng6jl\""
Jul 29 21:59:04.820299 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.820272    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"]
Jul 29 21:59:04.868732 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.868691    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-data\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.868933 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.868746    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-envoy\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.868933 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.868789    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-credential-socket\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.868933 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.868835    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-workload-certs\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.868933 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.868853    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-podinfo\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.868933 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.868881    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kqpx\" (UniqueName: \"kubernetes.io/projected/c4176880-283b-4c4c-b2ef-4757c9d0ef78-kube-api-access-9kqpx\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.868933 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.868934    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istiod-ca-cert\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.869255 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.868970    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-workload-socket\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.869255 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.869022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-token\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.954926 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.954893    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:59:04.970205 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.970168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kqpx\" (UniqueName: \"kubernetes.io/projected/c4176880-283b-4c4c-b2ef-4757c9d0ef78-kube-api-access-9kqpx\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.970369 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.970221    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istiod-ca-cert\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.970369 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.970253    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-workload-socket\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.970369 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.970286    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-token\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.970369 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.970325    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-data\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.970642 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.970378    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-envoy\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.970642 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.970409    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-credential-socket\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.970642 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.970436    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-workload-certs\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.970642 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.970489    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-podinfo\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.970852 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.970761    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-workload-socket\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.970908 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.970848    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-data\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.970908 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.970863    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-credential-socket\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.971023 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.970958    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-workload-certs\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.971117 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.971098    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istiod-ca-cert\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.972982 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.972960    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-envoy\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.973312 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.973294    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-podinfo\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.981394 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.981346    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kqpx\" (UniqueName: \"kubernetes.io/projected/c4176880-283b-4c4c-b2ef-4757c9d0ef78-kube-api-access-9kqpx\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:04.988032 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:04.988006    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-token\") pod \"e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") " pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:05.127750 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:05.127651    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:05.189701 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:05.189667    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:59:05.286607 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:05.286568    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"]
Jul 29 21:59:05.290041 ip-10-0-134-66 kubenswrapper[2575]: W0729 21:59:05.290007    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4176880_283b_4c4c_b2ef_4757c9d0ef78.slice/crio-11ea4622a60d569f5d43bc12ad95986bfcaa429ae5cf03e91c4c1bfc494b8e7c WatchSource:0}: Error finding container 11ea4622a60d569f5d43bc12ad95986bfcaa429ae5cf03e91c4c1bfc494b8e7c: Status 404 returned error can't find the container with id 11ea4622a60d569f5d43bc12ad95986bfcaa429ae5cf03e91c4c1bfc494b8e7c
Jul 29 21:59:05.292349 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:05.292316    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:59:05.292511 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:05.292402    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:59:05.292511 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:05.292476    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:59:05.854053 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:05.854010    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c" event={"ID":"c4176880-283b-4c4c-b2ef-4757c9d0ef78","Type":"ContainerStarted","Data":"58847f64d7c9917af41e38d48cdc3a36d7ea1f16b0e56d2ac7ba2c6293b3d0e1"}
Jul 29 21:59:05.854490 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:05.854068    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c" event={"ID":"c4176880-283b-4c4c-b2ef-4757c9d0ef78","Type":"ContainerStarted","Data":"11ea4622a60d569f5d43bc12ad95986bfcaa429ae5cf03e91c4c1bfc494b8e7c"}
Jul 29 21:59:05.877465 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:05.877392    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c" podStartSLOduration=1.877374406 podStartE2EDuration="1.877374406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 21:59:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 21:59:05.87619502 +0000 UTC m=+3337.881718389" watchObservedRunningTime="2026-07-29 21:59:05.877374406 +0000 UTC m=+3337.882897774"
Jul 29 21:59:06.128822 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:06.128719    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:06.134351 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:06.134314    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:06.859849 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:06.859820    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:06.860808 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:06.860787    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:07.841170 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:07.841133    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:59:07.943841 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:07.943804    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:59:08.986741 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:08.986708    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:59:09.541565 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:09.541530    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:59:09.641063 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:09.641030    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:59:17.320775 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:17.320738    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 21:59:25.974344 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:25.974256    2575 generic.go:356] "Generic (PLEG): container finished" podID="c4176880-283b-4c4c-b2ef-4757c9d0ef78" containerID="58847f64d7c9917af41e38d48cdc3a36d7ea1f16b0e56d2ac7ba2c6293b3d0e1" exitCode=0
Jul 29 21:59:25.974344 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:25.974329    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c" event={"ID":"c4176880-283b-4c4c-b2ef-4757c9d0ef78","Type":"ContainerDied","Data":"58847f64d7c9917af41e38d48cdc3a36d7ea1f16b0e56d2ac7ba2c6293b3d0e1"}
Jul 29 21:59:25.974820 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:25.974804    2575 scope.go:117] "RemoveContainer" containerID="58847f64d7c9917af41e38d48cdc3a36d7ea1f16b0e56d2ac7ba2c6293b3d0e1"
Jul 29 21:59:25.976040 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:25.976015    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:59:25.976107 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:25.976079    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:59:25.976144 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:25.976105    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 21:59:26.981897 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:26.981862    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c" event={"ID":"c4176880-283b-4c4c-b2ef-4757c9d0ef78","Type":"ContainerStarted","Data":"d8cfe5c031a548014e86c8feb39bd6d1eeb8f5e366617bcd6d034d7b44014cab"}
Jul 29 21:59:27.128035 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:27.128000    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:27.128319 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:27.128291    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 29 21:59:27.128460 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:27.128371    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c" podUID="c4176880-283b-4c4c-b2ef-4757c9d0ef78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 29 21:59:28.129047 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:28.129010    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 29 21:59:28.129429 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:28.129076    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c" podUID="c4176880-283b-4c4c-b2ef-4757c9d0ef78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 29 21:59:29.128200 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:29.128159    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 29 21:59:29.128392 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:29.128219    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c" podUID="c4176880-283b-4c4c-b2ef-4757c9d0ef78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 29 21:59:30.128746 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:30.128707    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 29 21:59:30.129148 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:30.128765    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c" podUID="c4176880-283b-4c4c-b2ef-4757c9d0ef78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 29 21:59:31.132660 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:31.132630    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:31.133084 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:31.133060    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:31.133962 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:31.133942    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 21:59:32.832257 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:32.832219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:59:35.460158 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:35.460122    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:59:53.029002 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:53.028971    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 21:59:56.423261 ip-10-0-134-66 kubenswrapper[2575]: I0729 21:59:56.423224    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 22:00:00.144734 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:00.144696    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-50d50c-29756040-t68ql"]
Jul 29 22:00:00.148456 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:00.148427    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fe32bc-29756040-v748q"]
Jul 29 22:00:00.148549 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:00.148522    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-50d50c-29756040-t68ql"
Jul 29 22:00:00.151318 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:00.151298    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9wjvq\""
Jul 29 22:00:00.151759 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:00.151745    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756040-rqt6k"]
Jul 29 22:00:00.151897 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:00.151874    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fe32bc-29756040-v748q"
Jul 29 22:00:00.155422 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:00.155400    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756040-rqt6k"
Jul 29 22:00:00.158012 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:00.157991    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-50d50c-29756040-t68ql"]
Jul 29 22:00:00.160901 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:00.160879    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fe32bc-29756040-v748q"]
Jul 29 22:00:00.162698 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:00.162672    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-50d50c-29756040-t68ql"
Jul 29 22:00:00.172513 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:00.172484    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fe32bc-29756040-v748q"
Jul 29 22:00:00.178163 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:00.178064    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756040-rqt6k"]
Jul 29 22:00:00.211061 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:00.211022    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756040-rqt6k"
Jul 29 22:00:00.385675 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:00.385649    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756040-rqt6k"]
Jul 29 22:00:00.387351 ip-10-0-134-66 kubenswrapper[2575]: W0729 22:00:00.387329    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b3c8e8f_80f4_44c0_aa5b_e7a46b2e0aec.slice/crio-c0ebcc18a7c955fb879ed8127ddfff6d5d300198bf7348d93b7dc1e7e8b9812c WatchSource:0}: Error finding container c0ebcc18a7c955fb879ed8127ddfff6d5d300198bf7348d93b7dc1e7e8b9812c: Status 404 returned error can't find the container with id c0ebcc18a7c955fb879ed8127ddfff6d5d300198bf7348d93b7dc1e7e8b9812c
Jul 29 22:00:00.536850 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:00.536825    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-50d50c-29756040-t68ql"]
Jul 29 22:00:00.544624 ip-10-0-134-66 kubenswrapper[2575]: W0729 22:00:00.544593    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40670fa9_24c7_447e_b73f_f2277138e37b.slice/crio-507d08cb6eb90b13b463b8ce9ccba50874a6523c9f1dafe5a60544fd42c8fe96 WatchSource:0}: Error finding container 507d08cb6eb90b13b463b8ce9ccba50874a6523c9f1dafe5a60544fd42c8fe96: Status 404 returned error can't find the container with id 507d08cb6eb90b13b463b8ce9ccba50874a6523c9f1dafe5a60544fd42c8fe96
Jul 29 22:00:00.574421 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:00.574395    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fe32bc-29756040-v748q"]
Jul 29 22:00:00.583717 ip-10-0-134-66 kubenswrapper[2575]: W0729 22:00:00.583689    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod788646d7_795b_4a97_9022_ac7a287eae85.slice/crio-e76fb78a9a2560bd01812ffe69f2e368f914acabfc9ad48dc09438d0daa431d3 WatchSource:0}: Error finding container e76fb78a9a2560bd01812ffe69f2e368f914acabfc9ad48dc09438d0daa431d3: Status 404 returned error can't find the container with id e76fb78a9a2560bd01812ffe69f2e368f914acabfc9ad48dc09438d0daa431d3
Jul 29 22:00:01.170086 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:01.170046    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fe32bc-29756040-v748q" event={"ID":"788646d7-795b-4a97-9022-ac7a287eae85","Type":"ContainerStarted","Data":"b04a7a6e861a511e06362ee741dc5485306994ffb2d9a7f065522c8b153d7c1e"}
Jul 29 22:00:01.170524 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:01.170107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fe32bc-29756040-v748q" event={"ID":"788646d7-795b-4a97-9022-ac7a287eae85","Type":"ContainerStarted","Data":"e76fb78a9a2560bd01812ffe69f2e368f914acabfc9ad48dc09438d0daa431d3"}
Jul 29 22:00:01.171604 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:01.171573    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-50d50c-29756040-t68ql" event={"ID":"40670fa9-24c7-447e-b73f-f2277138e37b","Type":"ContainerStarted","Data":"8c35d3dcf3c95e6b26835c58f2d702f77a502e76a4fd725b2746004aa8b8a2ae"}
Jul 29 22:00:01.171728 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:01.171625    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-50d50c-29756040-t68ql" event={"ID":"40670fa9-24c7-447e-b73f-f2277138e37b","Type":"ContainerStarted","Data":"507d08cb6eb90b13b463b8ce9ccba50874a6523c9f1dafe5a60544fd42c8fe96"}
Jul 29 22:00:01.172977 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:01.172954    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756040-rqt6k" event={"ID":"9b3c8e8f-80f4-44c0-aa5b-e7a46b2e0aec","Type":"ContainerStarted","Data":"473c13c9c611329072d7e429b423627743920d1bfe018aace664fe32f41cb8ec"}
Jul 29 22:00:01.173084 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:01.172992    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756040-rqt6k" event={"ID":"9b3c8e8f-80f4-44c0-aa5b-e7a46b2e0aec","Type":"ContainerStarted","Data":"c0ebcc18a7c955fb879ed8127ddfff6d5d300198bf7348d93b7dc1e7e8b9812c"}
Jul 29 22:00:01.186423 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:01.186379    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fe32bc-29756040-v748q" podStartSLOduration=1.186365946 podStartE2EDuration="1.186365946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:00:01.184766949 +0000 UTC m=+3393.190290318" watchObservedRunningTime="2026-07-29 22:00:01.186365946 +0000 UTC m=+3393.191889313"
Jul 29 22:00:01.203751 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:01.203704    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-50d50c-29756040-t68ql" podStartSLOduration=1.2036898360000001 podStartE2EDuration="1.203689836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:00:01.202768649 +0000 UTC m=+3393.208292017" watchObservedRunningTime="2026-07-29 22:00:01.203689836 +0000 UTC m=+3393.209213181"
Jul 29 22:00:01.217692 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:01.217645    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756040-rqt6k" podStartSLOduration=1.217631262 podStartE2EDuration="1.217631262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:00:01.216138987 +0000 UTC m=+3393.221662382" watchObservedRunningTime="2026-07-29 22:00:01.217631262 +0000 UTC m=+3393.223154631"
Jul 29 22:00:02.180088 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:02.180053    2575 generic.go:356] "Generic (PLEG): container finished" podID="9b3c8e8f-80f4-44c0-aa5b-e7a46b2e0aec" containerID="473c13c9c611329072d7e429b423627743920d1bfe018aace664fe32f41cb8ec" exitCode=0
Jul 29 22:00:02.180625 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:02.180146    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756040-rqt6k" event={"ID":"9b3c8e8f-80f4-44c0-aa5b-e7a46b2e0aec","Type":"ContainerDied","Data":"473c13c9c611329072d7e429b423627743920d1bfe018aace664fe32f41cb8ec"}
Jul 29 22:00:02.181674 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:02.181654    2575 generic.go:356] "Generic (PLEG): container finished" podID="788646d7-795b-4a97-9022-ac7a287eae85" containerID="b04a7a6e861a511e06362ee741dc5485306994ffb2d9a7f065522c8b153d7c1e" exitCode=0
Jul 29 22:00:02.181776 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:02.181680    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fe32bc-29756040-v748q" event={"ID":"788646d7-795b-4a97-9022-ac7a287eae85","Type":"ContainerDied","Data":"b04a7a6e861a511e06362ee741dc5485306994ffb2d9a7f065522c8b153d7c1e"}
Jul 29 22:00:02.183079 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:02.183060    2575 generic.go:356] "Generic (PLEG): container finished" podID="40670fa9-24c7-447e-b73f-f2277138e37b" containerID="8c35d3dcf3c95e6b26835c58f2d702f77a502e76a4fd725b2746004aa8b8a2ae" exitCode=0
Jul 29 22:00:02.183184 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:02.183118    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-50d50c-29756040-t68ql" event={"ID":"40670fa9-24c7-447e-b73f-f2277138e37b","Type":"ContainerDied","Data":"8c35d3dcf3c95e6b26835c58f2d702f77a502e76a4fd725b2746004aa8b8a2ae"}
Jul 29 22:00:03.342058 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:03.342026    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756040-rqt6k"
Jul 29 22:00:03.382169 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:03.382142    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fe32bc-29756040-v748q"
Jul 29 22:00:03.385264 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:03.385244    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-50d50c-29756040-t68ql"
Jul 29 22:00:04.195196 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:04.195163    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fe32bc-29756040-v748q"
Jul 29 22:00:04.195362 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:04.195163    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fe32bc-29756040-v748q" event={"ID":"788646d7-795b-4a97-9022-ac7a287eae85","Type":"ContainerDied","Data":"e76fb78a9a2560bd01812ffe69f2e368f914acabfc9ad48dc09438d0daa431d3"}
Jul 29 22:00:04.195362 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:04.195294    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e76fb78a9a2560bd01812ffe69f2e368f914acabfc9ad48dc09438d0daa431d3"
Jul 29 22:00:04.196532 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:04.196515    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-50d50c-29756040-t68ql"
Jul 29 22:00:04.196629 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:04.196568    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-50d50c-29756040-t68ql" event={"ID":"40670fa9-24c7-447e-b73f-f2277138e37b","Type":"ContainerDied","Data":"507d08cb6eb90b13b463b8ce9ccba50874a6523c9f1dafe5a60544fd42c8fe96"}
Jul 29 22:00:04.196629 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:04.196604    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="507d08cb6eb90b13b463b8ce9ccba50874a6523c9f1dafe5a60544fd42c8fe96"
Jul 29 22:00:04.197993 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:04.197968    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756040-rqt6k" event={"ID":"9b3c8e8f-80f4-44c0-aa5b-e7a46b2e0aec","Type":"ContainerDied","Data":"c0ebcc18a7c955fb879ed8127ddfff6d5d300198bf7348d93b7dc1e7e8b9812c"}
Jul 29 22:00:04.198108 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:04.197999    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756040-rqt6k"
Jul 29 22:00:04.198108 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:04.198004    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0ebcc18a7c955fb879ed8127ddfff6d5d300198bf7348d93b7dc1e7e8b9812c"
Jul 29 22:00:25.909967 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:25.909880    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 22:00:36.481245 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.481204    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:00:36.767267 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.767187    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"]
Jul 29 22:00:36.767635 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.767620    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40670fa9-24c7-447e-b73f-f2277138e37b" containerName="cleanup"
Jul 29 22:00:36.767686 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.767636    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="40670fa9-24c7-447e-b73f-f2277138e37b" containerName="cleanup"
Jul 29 22:00:36.767686 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.767653    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="788646d7-795b-4a97-9022-ac7a287eae85" containerName="cleanup"
Jul 29 22:00:36.767686 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.767660    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="788646d7-795b-4a97-9022-ac7a287eae85" containerName="cleanup"
Jul 29 22:00:36.767686 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.767683    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b3c8e8f-80f4-44c0-aa5b-e7a46b2e0aec" containerName="cleanup"
Jul 29 22:00:36.767829 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.767689    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b3c8e8f-80f4-44c0-aa5b-e7a46b2e0aec" containerName="cleanup"
Jul 29 22:00:36.767829 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.767750    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="40670fa9-24c7-447e-b73f-f2277138e37b" containerName="cleanup"
Jul 29 22:00:36.767829 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.767763    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b3c8e8f-80f4-44c0-aa5b-e7a46b2e0aec" containerName="cleanup"
Jul 29 22:00:36.767829 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.767769    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="788646d7-795b-4a97-9022-ac7a287eae85" containerName="cleanup"
Jul 29 22:00:36.772412 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.772384    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.775510 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.775475    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-215280-openshift-default-dockercfg-9zjs2\""
Jul 29 22:00:36.782786 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.782760    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"]
Jul 29 22:00:36.798576 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.798537    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-workload-socket\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.798755 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.798584    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-data\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.798755 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.798633    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-podinfo\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.798755 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.798669    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-envoy\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.798755 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.798718    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-workload-certs\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.798999 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.798780    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7nbn\" (UniqueName: \"kubernetes.io/projected/caf9a0ee-d152-4161-b0ed-b49f54e36238-kube-api-access-g7nbn\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.798999 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.798806    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-credential-socket\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.798999 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.798827    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caf9a0ee-d152-4161-b0ed-b49f54e36238-istiod-ca-cert\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.798999 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.798844    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-token\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.802890 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.802863    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:00:36.900453 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.900394    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-workload-socket\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.900653 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.900482    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-data\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.900653 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.900512    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-podinfo\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.900653 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.900544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-envoy\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.900916 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.900889    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-workload-socket\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.901212 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.900975    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-data\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.901342 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.901006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-workload-certs\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.901593 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.901566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7nbn\" (UniqueName: \"kubernetes.io/projected/caf9a0ee-d152-4161-b0ed-b49f54e36238-kube-api-access-g7nbn\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.901708 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.901644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-credential-socket\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.901784 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.901710    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caf9a0ee-d152-4161-b0ed-b49f54e36238-istiod-ca-cert\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.901784 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.901761    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-token\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.902318 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.901229    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-workload-certs\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.902526 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.902504    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-credential-socket\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.903050 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.903028    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caf9a0ee-d152-4161-b0ed-b49f54e36238-istiod-ca-cert\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.903135 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.903111    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-envoy\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.903586 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.903567    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-podinfo\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.911024 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.910990    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-token\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:36.911584 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:36.911567    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7nbn\" (UniqueName: \"kubernetes.io/projected/caf9a0ee-d152-4161-b0ed-b49f54e36238-kube-api-access-g7nbn\") pod \"e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") " pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:37.033711 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:37.033625    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:00:37.085355 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:37.085320    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:37.232142 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:37.232110    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"]
Jul 29 22:00:37.233541 ip-10-0-134-66 kubenswrapper[2575]: W0729 22:00:37.233513    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf9a0ee_d152_4161_b0ed_b49f54e36238.slice/crio-036647a55cc5c353e951802ac3f835c23c87fd98391eb1d7a77f6b7d25e27623 WatchSource:0}: Error finding container 036647a55cc5c353e951802ac3f835c23c87fd98391eb1d7a77f6b7d25e27623: Status 404 returned error can't find the container with id 036647a55cc5c353e951802ac3f835c23c87fd98391eb1d7a77f6b7d25e27623
Jul 29 22:00:37.235802 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:37.235770    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 22:00:37.235914 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:37.235856    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 22:00:37.235914 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:37.235904    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 22:00:37.380374 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:37.380331    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9" event={"ID":"caf9a0ee-d152-4161-b0ed-b49f54e36238","Type":"ContainerStarted","Data":"e364e3f99733e40a8cd387147decc573e8fcb4c9bec8962758d917fa4f45cd97"}
Jul 29 22:00:37.380566 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:37.380394    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9" event={"ID":"caf9a0ee-d152-4161-b0ed-b49f54e36238","Type":"ContainerStarted","Data":"036647a55cc5c353e951802ac3f835c23c87fd98391eb1d7a77f6b7d25e27623"}
Jul 29 22:00:37.402692 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:37.402638    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9" podStartSLOduration=1.40261671 podStartE2EDuration="1.40261671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:00:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:00:37.400068819 +0000 UTC m=+3429.405592199" watchObservedRunningTime="2026-07-29 22:00:37.40261671 +0000 UTC m=+3429.408140079"
Jul 29 22:00:38.086599 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:38.086563    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:38.091527 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:38.091499    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:38.385905 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:38.385813    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:38.386848 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:38.386826    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:39.376959 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:39.376929    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:00:39.477553 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:39.477523    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:00:40.510648 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:40.510611    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:00:40.691865 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:40.691836    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:00:40.978324 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:40.978289    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:00:41.110461 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:41.110418    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:00:45.516059 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:45.516019    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 22:00:52.878645 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:52.878610    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:00:53.975276 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:53.974613    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": read tcp 10.132.0.2:35492->10.132.0.79:15021: read: connection reset by peer" start-of-body=
Jul 29 22:00:53.975276 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:53.974695    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9" podUID="caf9a0ee-d152-4161-b0ed-b49f54e36238" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": read tcp 10.132.0.2:35492->10.132.0.79:15021: read: connection reset by peer"
Jul 29 22:00:54.490108 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:54.490079    2575 generic.go:356] "Generic (PLEG): container finished" podID="caf9a0ee-d152-4161-b0ed-b49f54e36238" containerID="e364e3f99733e40a8cd387147decc573e8fcb4c9bec8962758d917fa4f45cd97" exitCode=0
Jul 29 22:00:54.490290 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:54.490159    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9" event={"ID":"caf9a0ee-d152-4161-b0ed-b49f54e36238","Type":"ContainerDied","Data":"e364e3f99733e40a8cd387147decc573e8fcb4c9bec8962758d917fa4f45cd97"}
Jul 29 22:00:54.490594 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:54.490580    2575 scope.go:117] "RemoveContainer" containerID="e364e3f99733e40a8cd387147decc573e8fcb4c9bec8962758d917fa4f45cd97"
Jul 29 22:00:54.491758 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:54.491733    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 22:00:54.498966 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:54.492260    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 22:00:54.498966 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:54.492390    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 22:00:55.497475 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:55.497418    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9" event={"ID":"caf9a0ee-d152-4161-b0ed-b49f54e36238","Type":"ContainerStarted","Data":"a16ffd86e5841b3926246ba1079873071520ab33a22b5e5b1f64f298faa23643"}
Jul 29 22:00:56.086324 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:56.086281    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:00:56.086586 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:56.086559    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 29 22:00:56.086644 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:56.086625    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9" podUID="caf9a0ee-d152-4161-b0ed-b49f54e36238" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 29 22:00:57.085900 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:57.085862    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 29 22:00:57.086375 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:57.085930    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9" podUID="caf9a0ee-d152-4161-b0ed-b49f54e36238" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 29 22:00:58.086591 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:58.086552    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 29 22:00:58.086996 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:58.086612    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9" podUID="caf9a0ee-d152-4161-b0ed-b49f54e36238" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 29 22:00:59.085759 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:59.085720    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 29 22:00:59.085968 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:00:59.085782    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9" podUID="caf9a0ee-d152-4161-b0ed-b49f54e36238" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 29 22:01:00.089899 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:00.089859    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:01:00.090348 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:00.090145    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:01:00.090805 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:00.090787    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:01:04.441954 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:04.441916    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:01:10.298058 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:10.298024    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:01:10.377856 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:10.377821    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:01:10.477916 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:10.477881    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:01:10.551181 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:10.551048    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:01:11.002947 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:11.002847    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:01:15.415702 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:15.415667    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 22:01:16.836850 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:16.836810    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:01:16.936892 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:16.936850    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:01:17.101849 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:17.101751    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"]
Jul 29 22:01:17.102024 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:17.101964    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9" podUID="caf9a0ee-d152-4161-b0ed-b49f54e36238" containerName="istio-proxy" containerID="cri-o://a16ffd86e5841b3926246ba1079873071520ab33a22b5e5b1f64f298faa23643" gracePeriod=30
Jul 29 22:01:17.129262 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:17.129231    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:01:17.367899 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:17.367765    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:01:22.371828 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.371756    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:01:22.477098 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.477062    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-data\") pod \"caf9a0ee-d152-4161-b0ed-b49f54e36238\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") "
Jul 29 22:01:22.477290 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.477117    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-credential-socket\") pod \"caf9a0ee-d152-4161-b0ed-b49f54e36238\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") "
Jul 29 22:01:22.477290 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.477181    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-workload-certs\") pod \"caf9a0ee-d152-4161-b0ed-b49f54e36238\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") "
Jul 29 22:01:22.477290 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.477223    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-workload-socket\") pod \"caf9a0ee-d152-4161-b0ed-b49f54e36238\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") "
Jul 29 22:01:22.477290 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.477255    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-token\") pod \"caf9a0ee-d152-4161-b0ed-b49f54e36238\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") "
Jul 29 22:01:22.477533 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.477290    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7nbn\" (UniqueName: \"kubernetes.io/projected/caf9a0ee-d152-4161-b0ed-b49f54e36238-kube-api-access-g7nbn\") pod \"caf9a0ee-d152-4161-b0ed-b49f54e36238\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") "
Jul 29 22:01:22.477533 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.477318    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-envoy\") pod \"caf9a0ee-d152-4161-b0ed-b49f54e36238\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") "
Jul 29 22:01:22.477533 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.477362    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-podinfo\") pod \"caf9a0ee-d152-4161-b0ed-b49f54e36238\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") "
Jul 29 22:01:22.477533 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.477417    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caf9a0ee-d152-4161-b0ed-b49f54e36238-istiod-ca-cert\") pod \"caf9a0ee-d152-4161-b0ed-b49f54e36238\" (UID: \"caf9a0ee-d152-4161-b0ed-b49f54e36238\") "
Jul 29 22:01:22.477533 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.477431    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "caf9a0ee-d152-4161-b0ed-b49f54e36238" (UID: "caf9a0ee-d152-4161-b0ed-b49f54e36238"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:01:22.477782 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.477552    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "caf9a0ee-d152-4161-b0ed-b49f54e36238" (UID: "caf9a0ee-d152-4161-b0ed-b49f54e36238"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:01:22.477782 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.477641    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "caf9a0ee-d152-4161-b0ed-b49f54e36238" (UID: "caf9a0ee-d152-4161-b0ed-b49f54e36238"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:01:22.477923 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.477902    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-credential-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:01:22.477986 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.477929    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-workload-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:01:22.477986 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.477944    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-workload-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:01:22.477986 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.477972    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caf9a0ee-d152-4161-b0ed-b49f54e36238-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "caf9a0ee-d152-4161-b0ed-b49f54e36238" (UID: "caf9a0ee-d152-4161-b0ed-b49f54e36238"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 22:01:22.478159 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.478132    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-data" (OuterVolumeSpecName: "istio-data") pod "caf9a0ee-d152-4161-b0ed-b49f54e36238" (UID: "caf9a0ee-d152-4161-b0ed-b49f54e36238"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:01:22.479750 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.479725    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "caf9a0ee-d152-4161-b0ed-b49f54e36238" (UID: "caf9a0ee-d152-4161-b0ed-b49f54e36238"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:01:22.479967 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.479939    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-token" (OuterVolumeSpecName: "istio-token") pod "caf9a0ee-d152-4161-b0ed-b49f54e36238" (UID: "caf9a0ee-d152-4161-b0ed-b49f54e36238"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 22:01:22.480044 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.480024    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "caf9a0ee-d152-4161-b0ed-b49f54e36238" (UID: "caf9a0ee-d152-4161-b0ed-b49f54e36238"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 22:01:22.480090 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.480066    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caf9a0ee-d152-4161-b0ed-b49f54e36238-kube-api-access-g7nbn" (OuterVolumeSpecName: "kube-api-access-g7nbn") pod "caf9a0ee-d152-4161-b0ed-b49f54e36238" (UID: "caf9a0ee-d152-4161-b0ed-b49f54e36238"). InnerVolumeSpecName "kube-api-access-g7nbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 22:01:22.578749 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.578716    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-token\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:01:22.578749 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.578744    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7nbn\" (UniqueName: \"kubernetes.io/projected/caf9a0ee-d152-4161-b0ed-b49f54e36238-kube-api-access-g7nbn\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:01:22.578749 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.578755    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-envoy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:01:22.578963 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.578764    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-podinfo\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:01:22.578963 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.578774    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caf9a0ee-d152-4161-b0ed-b49f54e36238-istiod-ca-cert\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:01:22.578963 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.578781    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caf9a0ee-d152-4161-b0ed-b49f54e36238-istio-data\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:01:22.650998 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.650921    2575 generic.go:356] "Generic (PLEG): container finished" podID="caf9a0ee-d152-4161-b0ed-b49f54e36238" containerID="a16ffd86e5841b3926246ba1079873071520ab33a22b5e5b1f64f298faa23643" exitCode=0
Jul 29 22:01:22.650998 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.650977    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"
Jul 29 22:01:22.651173 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.651008    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9" event={"ID":"caf9a0ee-d152-4161-b0ed-b49f54e36238","Type":"ContainerDied","Data":"a16ffd86e5841b3926246ba1079873071520ab33a22b5e5b1f64f298faa23643"}
Jul 29 22:01:22.651173 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.651069    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9" event={"ID":"caf9a0ee-d152-4161-b0ed-b49f54e36238","Type":"ContainerDied","Data":"036647a55cc5c353e951802ac3f835c23c87fd98391eb1d7a77f6b7d25e27623"}
Jul 29 22:01:22.651173 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.651090    2575 scope.go:117] "RemoveContainer" containerID="a16ffd86e5841b3926246ba1079873071520ab33a22b5e5b1f64f298faa23643"
Jul 29 22:01:22.660512 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.660494    2575 scope.go:117] "RemoveContainer" containerID="e364e3f99733e40a8cd387147decc573e8fcb4c9bec8962758d917fa4f45cd97"
Jul 29 22:01:22.668922 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.668903    2575 scope.go:117] "RemoveContainer" containerID="a16ffd86e5841b3926246ba1079873071520ab33a22b5e5b1f64f298faa23643"
Jul 29 22:01:22.669167 ip-10-0-134-66 kubenswrapper[2575]: E0729 22:01:22.669147    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a16ffd86e5841b3926246ba1079873071520ab33a22b5e5b1f64f298faa23643\": container with ID starting with a16ffd86e5841b3926246ba1079873071520ab33a22b5e5b1f64f298faa23643 not found: ID does not exist" containerID="a16ffd86e5841b3926246ba1079873071520ab33a22b5e5b1f64f298faa23643"
Jul 29 22:01:22.669242 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.669174    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a16ffd86e5841b3926246ba1079873071520ab33a22b5e5b1f64f298faa23643"} err="failed to get container status \"a16ffd86e5841b3926246ba1079873071520ab33a22b5e5b1f64f298faa23643\": rpc error: code = NotFound desc = could not find container \"a16ffd86e5841b3926246ba1079873071520ab33a22b5e5b1f64f298faa23643\": container with ID starting with a16ffd86e5841b3926246ba1079873071520ab33a22b5e5b1f64f298faa23643 not found: ID does not exist"
Jul 29 22:01:22.669242 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.669193    2575 scope.go:117] "RemoveContainer" containerID="e364e3f99733e40a8cd387147decc573e8fcb4c9bec8962758d917fa4f45cd97"
Jul 29 22:01:22.669484 ip-10-0-134-66 kubenswrapper[2575]: E0729 22:01:22.669438    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e364e3f99733e40a8cd387147decc573e8fcb4c9bec8962758d917fa4f45cd97\": container with ID starting with e364e3f99733e40a8cd387147decc573e8fcb4c9bec8962758d917fa4f45cd97 not found: ID does not exist" containerID="e364e3f99733e40a8cd387147decc573e8fcb4c9bec8962758d917fa4f45cd97"
Jul 29 22:01:22.669531 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.669494    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e364e3f99733e40a8cd387147decc573e8fcb4c9bec8962758d917fa4f45cd97"} err="failed to get container status \"e364e3f99733e40a8cd387147decc573e8fcb4c9bec8962758d917fa4f45cd97\": rpc error: code = NotFound desc = could not find container \"e364e3f99733e40a8cd387147decc573e8fcb4c9bec8962758d917fa4f45cd97\": container with ID starting with e364e3f99733e40a8cd387147decc573e8fcb4c9bec8962758d917fa4f45cd97 not found: ID does not exist"
Jul 29 22:01:22.670671 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.670653    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"]
Jul 29 22:01:22.674775 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:22.674754    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-215280-openshift-default-6b686948cb-kvfg9"]
Jul 29 22:01:24.482939 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:24.482905    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caf9a0ee-d152-4161-b0ed-b49f54e36238" path="/var/lib/kubelet/pods/caf9a0ee-d152-4161-b0ed-b49f54e36238/volumes"
Jul 29 22:01:36.478706 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:36.478668    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:01:37.022913 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:37.022882    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 22:01:37.050279 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:37.050252    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:01:37.112327 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:37.112292    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:01:42.059539 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:42.059497    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:01:47.819751 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:47.819715    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 22:01:54.521500 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:01:54.521394    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:02:18.757284 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:18.757242    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:02:19.176461 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:19.176425    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:02:33.383771 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:33.383730    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:02:33.454749 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:33.454711    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:02:33.662264 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:33.662174    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"]
Jul 29 22:02:33.662489 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:33.662421    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r" podUID="93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" containerName="istio-proxy" containerID="cri-o://59a7845e60a309b3123f8793798cadf92caa18051909734ec4104df1d5858610" gracePeriod=30
Jul 29 22:02:33.678981 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:33.678953    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:02:33.919880 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:33.919783    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:02:38.919106 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:38.919077    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 22:02:39.061318 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.061285    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-credential-socket\") pod \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") "
Jul 29 22:02:39.061511 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.061327    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-envoy\") pod \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") "
Jul 29 22:02:39.061511 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.061345    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-podinfo\") pod \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") "
Jul 29 22:02:39.061511 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.061371    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istiod-ca-cert\") pod \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") "
Jul 29 22:02:39.061511 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.061394    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-token\") pod \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") "
Jul 29 22:02:39.061511 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.061420    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-workload-certs\") pod \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") "
Jul 29 22:02:39.061783 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.061565    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-workload-socket\") pod \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") "
Jul 29 22:02:39.061783 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.061592    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-data\") pod \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") "
Jul 29 22:02:39.061783 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.061627    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnqt7\" (UniqueName: \"kubernetes.io/projected/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-kube-api-access-rnqt7\") pod \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\" (UID: \"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2\") "
Jul 29 22:02:39.061783 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.061757    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" (UID: "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:02:39.061974 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.061795    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" (UID: "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:02:39.061974 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.061880    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" (UID: "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:02:39.062105 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.062084    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-workload-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:39.062164 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.062108    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-credential-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:39.062164 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.062122    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-workload-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:39.062278 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.062262    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" (UID: "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 22:02:39.062558 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.062540    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-data" (OuterVolumeSpecName: "istio-data") pod "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" (UID: "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:02:39.063758 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.063736    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" (UID: "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 22:02:39.063927 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.063912    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-kube-api-access-rnqt7" (OuterVolumeSpecName: "kube-api-access-rnqt7") pod "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" (UID: "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2"). InnerVolumeSpecName "kube-api-access-rnqt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 22:02:39.064027 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.064010    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" (UID: "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:02:39.064080 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.064027    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-token" (OuterVolumeSpecName: "istio-token") pod "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" (UID: "93ed99f5-3b9d-47ce-917e-fe574fa4e5c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 22:02:39.074258 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.074231    2575 generic.go:356] "Generic (PLEG): container finished" podID="93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" containerID="59a7845e60a309b3123f8793798cadf92caa18051909734ec4104df1d5858610" exitCode=0
Jul 29 22:02:39.074359 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.074282    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"
Jul 29 22:02:39.074359 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.074310    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r" event={"ID":"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2","Type":"ContainerDied","Data":"59a7845e60a309b3123f8793798cadf92caa18051909734ec4104df1d5858610"}
Jul 29 22:02:39.074464 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.074366    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r" event={"ID":"93ed99f5-3b9d-47ce-917e-fe574fa4e5c2","Type":"ContainerDied","Data":"7220cb3759797c98d97d904d36f03455e4ee0faa6b9bb6d2d2032fe173bca84c"}
Jul 29 22:02:39.074464 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.074389    2575 scope.go:117] "RemoveContainer" containerID="59a7845e60a309b3123f8793798cadf92caa18051909734ec4104df1d5858610"
Jul 29 22:02:39.086166 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.086137    2575 scope.go:117] "RemoveContainer" containerID="35a7f36398f89d4a52d9ebef7e302a7b691120013de150276338ceb619749d18"
Jul 29 22:02:39.094567 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.094512    2575 scope.go:117] "RemoveContainer" containerID="59a7845e60a309b3123f8793798cadf92caa18051909734ec4104df1d5858610"
Jul 29 22:02:39.094903 ip-10-0-134-66 kubenswrapper[2575]: E0729 22:02:39.094874    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59a7845e60a309b3123f8793798cadf92caa18051909734ec4104df1d5858610\": container with ID starting with 59a7845e60a309b3123f8793798cadf92caa18051909734ec4104df1d5858610 not found: ID does not exist" containerID="59a7845e60a309b3123f8793798cadf92caa18051909734ec4104df1d5858610"
Jul 29 22:02:39.094990 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.094914    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59a7845e60a309b3123f8793798cadf92caa18051909734ec4104df1d5858610"} err="failed to get container status \"59a7845e60a309b3123f8793798cadf92caa18051909734ec4104df1d5858610\": rpc error: code = NotFound desc = could not find container \"59a7845e60a309b3123f8793798cadf92caa18051909734ec4104df1d5858610\": container with ID starting with 59a7845e60a309b3123f8793798cadf92caa18051909734ec4104df1d5858610 not found: ID does not exist"
Jul 29 22:02:39.094990 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.094941    2575 scope.go:117] "RemoveContainer" containerID="35a7f36398f89d4a52d9ebef7e302a7b691120013de150276338ceb619749d18"
Jul 29 22:02:39.095274 ip-10-0-134-66 kubenswrapper[2575]: E0729 22:02:39.095250    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35a7f36398f89d4a52d9ebef7e302a7b691120013de150276338ceb619749d18\": container with ID starting with 35a7f36398f89d4a52d9ebef7e302a7b691120013de150276338ceb619749d18 not found: ID does not exist" containerID="35a7f36398f89d4a52d9ebef7e302a7b691120013de150276338ceb619749d18"
Jul 29 22:02:39.095358 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.095280    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35a7f36398f89d4a52d9ebef7e302a7b691120013de150276338ceb619749d18"} err="failed to get container status \"35a7f36398f89d4a52d9ebef7e302a7b691120013de150276338ceb619749d18\": rpc error: code = NotFound desc = could not find container \"35a7f36398f89d4a52d9ebef7e302a7b691120013de150276338ceb619749d18\": container with ID starting with 35a7f36398f89d4a52d9ebef7e302a7b691120013de150276338ceb619749d18 not found: ID does not exist"
Jul 29 22:02:39.097590 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.097572    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"]
Jul 29 22:02:39.100942 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.100923    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-a0dedf-openshift-default-68464f7c78-kmn8r"]
Jul 29 22:02:39.163264 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.163237    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-data\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:39.163264 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.163261    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnqt7\" (UniqueName: \"kubernetes.io/projected/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-kube-api-access-rnqt7\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:39.163438 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.163271    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-envoy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:39.163438 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.163281    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-podinfo\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:39.163438 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.163292    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istiod-ca-cert\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:39.163438 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:39.163299    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2-istio-token\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:40.482549 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:40.482509    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" path="/var/lib/kubelet/pods/93ed99f5-3b9d-47ce-917e-fe574fa4e5c2/volumes"
Jul 29 22:02:44.542360 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:44.542324    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-50d50c-29756040-t68ql"]
Jul 29 22:02:44.546891 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:44.546866    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-50d50c-29756040-t68ql"]
Jul 29 22:02:44.815440 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:44.815360    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:02:44.914834 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:44.914780    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:02:45.112086 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:45.111997    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:02:46.483519 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:46.483484    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40670fa9-24c7-447e-b73f-f2277138e37b" path="/var/lib/kubelet/pods/40670fa9-24c7-447e-b73f-f2277138e37b/volumes"
Jul 29 22:02:48.219677 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:48.219636    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 22:02:50.865878 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:50.865844    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:02:50.965818 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:50.965780    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:02:51.131822 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:51.131722    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"]
Jul 29 22:02:51.132011 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:51.131984    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c" podUID="c4176880-283b-4c4c-b2ef-4757c9d0ef78" containerName="istio-proxy" containerID="cri-o://d8cfe5c031a548014e86c8feb39bd6d1eeb8f5e366617bcd6d034d7b44014cab" gracePeriod=30
Jul 29 22:02:51.149190 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:51.149163    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:02:51.388740 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:51.388647    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:02:56.389305 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.389278    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 22:02:56.442135 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.442051    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-workload-socket\") pod \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") "
Jul 29 22:02:56.442135 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.442117    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-workload-certs\") pod \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") "
Jul 29 22:02:56.442353 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.442202    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-credential-socket\") pod \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") "
Jul 29 22:02:56.442353 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.442237    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istiod-ca-cert\") pod \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") "
Jul 29 22:02:56.442353 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.442279    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kqpx\" (UniqueName: \"kubernetes.io/projected/c4176880-283b-4c4c-b2ef-4757c9d0ef78-kube-api-access-9kqpx\") pod \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") "
Jul 29 22:02:56.442353 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.442310    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-data\") pod \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") "
Jul 29 22:02:56.442353 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.442336    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c4176880-283b-4c4c-b2ef-4757c9d0ef78" (UID: "c4176880-283b-4c4c-b2ef-4757c9d0ef78"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:02:56.442635 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.442374    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-podinfo\") pod \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") "
Jul 29 22:02:56.442635 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.442408    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-envoy\") pod \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") "
Jul 29 22:02:56.442635 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.442468    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c4176880-283b-4c4c-b2ef-4757c9d0ef78" (UID: "c4176880-283b-4c4c-b2ef-4757c9d0ef78"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:02:56.442635 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.442485    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-token\") pod \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\" (UID: \"c4176880-283b-4c4c-b2ef-4757c9d0ef78\") "
Jul 29 22:02:56.442907 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.442859    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-workload-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:56.442907 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.442882    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-workload-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:56.443056 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.442930    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c4176880-283b-4c4c-b2ef-4757c9d0ef78" (UID: "c4176880-283b-4c4c-b2ef-4757c9d0ef78"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:02:56.443056 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.442982    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c4176880-283b-4c4c-b2ef-4757c9d0ef78" (UID: "c4176880-283b-4c4c-b2ef-4757c9d0ef78"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 22:02:56.443699 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.443665    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-data" (OuterVolumeSpecName: "istio-data") pod "c4176880-283b-4c4c-b2ef-4757c9d0ef78" (UID: "c4176880-283b-4c4c-b2ef-4757c9d0ef78"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:02:56.444711 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.444688    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c4176880-283b-4c4c-b2ef-4757c9d0ef78" (UID: "c4176880-283b-4c4c-b2ef-4757c9d0ef78"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:02:56.444833 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.444773    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-token" (OuterVolumeSpecName: "istio-token") pod "c4176880-283b-4c4c-b2ef-4757c9d0ef78" (UID: "c4176880-283b-4c4c-b2ef-4757c9d0ef78"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 22:02:56.444833 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.444801    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c4176880-283b-4c4c-b2ef-4757c9d0ef78" (UID: "c4176880-283b-4c4c-b2ef-4757c9d0ef78"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 22:02:56.444833 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.444813    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4176880-283b-4c4c-b2ef-4757c9d0ef78-kube-api-access-9kqpx" (OuterVolumeSpecName: "kube-api-access-9kqpx") pod "c4176880-283b-4c4c-b2ef-4757c9d0ef78" (UID: "c4176880-283b-4c4c-b2ef-4757c9d0ef78"). InnerVolumeSpecName "kube-api-access-9kqpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 22:02:56.544184 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.544152    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-token\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:56.544184 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.544181    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-credential-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:56.544184 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.544191    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istiod-ca-cert\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:56.544386 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.544199    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kqpx\" (UniqueName: \"kubernetes.io/projected/c4176880-283b-4c4c-b2ef-4757c9d0ef78-kube-api-access-9kqpx\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:56.544386 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.544209    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-data\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:56.544386 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.544217    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-podinfo\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:56.544386 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:56.544224    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4176880-283b-4c4c-b2ef-4757c9d0ef78-istio-envoy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:02:57.181876 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:57.181844    2575 generic.go:356] "Generic (PLEG): container finished" podID="c4176880-283b-4c4c-b2ef-4757c9d0ef78" containerID="d8cfe5c031a548014e86c8feb39bd6d1eeb8f5e366617bcd6d034d7b44014cab" exitCode=0
Jul 29 22:02:57.182048 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:57.181895    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"
Jul 29 22:02:57.182048 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:57.181935    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c" event={"ID":"c4176880-283b-4c4c-b2ef-4757c9d0ef78","Type":"ContainerDied","Data":"d8cfe5c031a548014e86c8feb39bd6d1eeb8f5e366617bcd6d034d7b44014cab"}
Jul 29 22:02:57.182048 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:57.181998    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c" event={"ID":"c4176880-283b-4c4c-b2ef-4757c9d0ef78","Type":"ContainerDied","Data":"11ea4622a60d569f5d43bc12ad95986bfcaa429ae5cf03e91c4c1bfc494b8e7c"}
Jul 29 22:02:57.182048 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:57.182026    2575 scope.go:117] "RemoveContainer" containerID="d8cfe5c031a548014e86c8feb39bd6d1eeb8f5e366617bcd6d034d7b44014cab"
Jul 29 22:02:57.191475 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:57.191433    2575 scope.go:117] "RemoveContainer" containerID="58847f64d7c9917af41e38d48cdc3a36d7ea1f16b0e56d2ac7ba2c6293b3d0e1"
Jul 29 22:02:57.199871 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:57.199851    2575 scope.go:117] "RemoveContainer" containerID="d8cfe5c031a548014e86c8feb39bd6d1eeb8f5e366617bcd6d034d7b44014cab"
Jul 29 22:02:57.200135 ip-10-0-134-66 kubenswrapper[2575]: E0729 22:02:57.200114    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8cfe5c031a548014e86c8feb39bd6d1eeb8f5e366617bcd6d034d7b44014cab\": container with ID starting with d8cfe5c031a548014e86c8feb39bd6d1eeb8f5e366617bcd6d034d7b44014cab not found: ID does not exist" containerID="d8cfe5c031a548014e86c8feb39bd6d1eeb8f5e366617bcd6d034d7b44014cab"
Jul 29 22:02:57.200184 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:57.200143    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8cfe5c031a548014e86c8feb39bd6d1eeb8f5e366617bcd6d034d7b44014cab"} err="failed to get container status \"d8cfe5c031a548014e86c8feb39bd6d1eeb8f5e366617bcd6d034d7b44014cab\": rpc error: code = NotFound desc = could not find container \"d8cfe5c031a548014e86c8feb39bd6d1eeb8f5e366617bcd6d034d7b44014cab\": container with ID starting with d8cfe5c031a548014e86c8feb39bd6d1eeb8f5e366617bcd6d034d7b44014cab not found: ID does not exist"
Jul 29 22:02:57.200184 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:57.200168    2575 scope.go:117] "RemoveContainer" containerID="58847f64d7c9917af41e38d48cdc3a36d7ea1f16b0e56d2ac7ba2c6293b3d0e1"
Jul 29 22:02:57.200469 ip-10-0-134-66 kubenswrapper[2575]: E0729 22:02:57.200433    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58847f64d7c9917af41e38d48cdc3a36d7ea1f16b0e56d2ac7ba2c6293b3d0e1\": container with ID starting with 58847f64d7c9917af41e38d48cdc3a36d7ea1f16b0e56d2ac7ba2c6293b3d0e1 not found: ID does not exist" containerID="58847f64d7c9917af41e38d48cdc3a36d7ea1f16b0e56d2ac7ba2c6293b3d0e1"
Jul 29 22:02:57.200535 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:57.200467    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58847f64d7c9917af41e38d48cdc3a36d7ea1f16b0e56d2ac7ba2c6293b3d0e1"} err="failed to get container status \"58847f64d7c9917af41e38d48cdc3a36d7ea1f16b0e56d2ac7ba2c6293b3d0e1\": rpc error: code = NotFound desc = could not find container \"58847f64d7c9917af41e38d48cdc3a36d7ea1f16b0e56d2ac7ba2c6293b3d0e1\": container with ID starting with 58847f64d7c9917af41e38d48cdc3a36d7ea1f16b0e56d2ac7ba2c6293b3d0e1 not found: ID does not exist"
Jul 29 22:02:57.201085 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:57.201067    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"]
Jul 29 22:02:57.207952 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:57.207929    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-50d50c-openshift-default-7dd4ccd878-sjm7c"]
Jul 29 22:02:58.482757 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:02:58.482727    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4176880-283b-4c4c-b2ef-4757c9d0ef78" path="/var/lib/kubelet/pods/c4176880-283b-4c4c-b2ef-4757c9d0ef78/volumes"
Jul 29 22:03:01.978539 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:01.978499    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:02.055741 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:02.055711    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:02.062036 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:02.062013    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fe32bc-29756040-v748q"]
Jul 29 22:03:02.064736 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:02.064716    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-fe32bc-29756040-v748q"]
Jul 29 22:03:02.120079 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:02.120035    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:02.219543 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:02.219490    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:02.319795 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:02.319758    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:02.482602 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:02.482569    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="788646d7-795b-4a97-9022-ac7a287eae85" path="/var/lib/kubelet/pods/788646d7-795b-4a97-9022-ac7a287eae85/volumes"
Jul 29 22:03:02.632231 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:02.632143    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:05.111420 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:05.111385    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 22:03:08.664835 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:08.664802    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:08.910808 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:08.910770    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"]
Jul 29 22:03:08.911087 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:08.911035    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5" podUID="f00e8810-cf51-428c-90a9-e875d7b4feec" containerName="istio-proxy" containerID="cri-o://b4ce63a28154c7fbee569263262d61a5b39975bdbc4520f49ded46999df3e9ee" gracePeriod=30
Jul 29 22:03:09.647703 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:09.647669    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:09.744194 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:09.744158    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:11.481270 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:11.481232    2575 patch_prober.go:28] interesting pod/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 22:03:11.481731 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:11.481308    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5" podUID="f00e8810-cf51-428c-90a9-e875d7b4feec" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 22:03:14.165732 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.165703    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 22:03:14.218705 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.218626    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-workload-socket\") pod \"f00e8810-cf51-428c-90a9-e875d7b4feec\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") "
Jul 29 22:03:14.218705 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.218675    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-token\") pod \"f00e8810-cf51-428c-90a9-e875d7b4feec\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") "
Jul 29 22:03:14.218705 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.218696    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f00e8810-cf51-428c-90a9-e875d7b4feec-istiod-ca-cert\") pod \"f00e8810-cf51-428c-90a9-e875d7b4feec\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") "
Jul 29 22:03:14.218966 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.218770    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-podinfo\") pod \"f00e8810-cf51-428c-90a9-e875d7b4feec\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") "
Jul 29 22:03:14.218966 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.218816    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4js5\" (UniqueName: \"kubernetes.io/projected/f00e8810-cf51-428c-90a9-e875d7b4feec-kube-api-access-c4js5\") pod \"f00e8810-cf51-428c-90a9-e875d7b4feec\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") "
Jul 29 22:03:14.218966 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.218857    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-workload-certs\") pod \"f00e8810-cf51-428c-90a9-e875d7b4feec\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") "
Jul 29 22:03:14.218966 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.218883    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-envoy\") pod \"f00e8810-cf51-428c-90a9-e875d7b4feec\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") "
Jul 29 22:03:14.218966 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.218902    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f00e8810-cf51-428c-90a9-e875d7b4feec" (UID: "f00e8810-cf51-428c-90a9-e875d7b4feec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:03:14.218966 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.218912    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-data\") pod \"f00e8810-cf51-428c-90a9-e875d7b4feec\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") "
Jul 29 22:03:14.219334 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.218992    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-credential-socket\") pod \"f00e8810-cf51-428c-90a9-e875d7b4feec\" (UID: \"f00e8810-cf51-428c-90a9-e875d7b4feec\") "
Jul 29 22:03:14.219334 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.219081    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f00e8810-cf51-428c-90a9-e875d7b4feec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f00e8810-cf51-428c-90a9-e875d7b4feec" (UID: "f00e8810-cf51-428c-90a9-e875d7b4feec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 22:03:14.219334 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.219240    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f00e8810-cf51-428c-90a9-e875d7b4feec" (UID: "f00e8810-cf51-428c-90a9-e875d7b4feec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:03:14.219334 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.219254    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f00e8810-cf51-428c-90a9-e875d7b4feec" (UID: "f00e8810-cf51-428c-90a9-e875d7b4feec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:03:14.219575 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.219470    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-workload-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:14.219575 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.219493    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-credential-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:14.219575 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.219513    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-workload-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:14.219575 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.219530    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f00e8810-cf51-428c-90a9-e875d7b4feec-istiod-ca-cert\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:14.219847 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.219818    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-data" (OuterVolumeSpecName: "istio-data") pod "f00e8810-cf51-428c-90a9-e875d7b4feec" (UID: "f00e8810-cf51-428c-90a9-e875d7b4feec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:03:14.220938 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.220909    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-token" (OuterVolumeSpecName: "istio-token") pod "f00e8810-cf51-428c-90a9-e875d7b4feec" (UID: "f00e8810-cf51-428c-90a9-e875d7b4feec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 22:03:14.221062 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.221022    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f00e8810-cf51-428c-90a9-e875d7b4feec" (UID: "f00e8810-cf51-428c-90a9-e875d7b4feec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 22:03:14.221292 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.221255    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f00e8810-cf51-428c-90a9-e875d7b4feec-kube-api-access-c4js5" (OuterVolumeSpecName: "kube-api-access-c4js5") pod "f00e8810-cf51-428c-90a9-e875d7b4feec" (UID: "f00e8810-cf51-428c-90a9-e875d7b4feec"). InnerVolumeSpecName "kube-api-access-c4js5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 22:03:14.221384 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.221367    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f00e8810-cf51-428c-90a9-e875d7b4feec" (UID: "f00e8810-cf51-428c-90a9-e875d7b4feec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:03:14.276398 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.276371    2575 generic.go:356] "Generic (PLEG): container finished" podID="f00e8810-cf51-428c-90a9-e875d7b4feec" containerID="b4ce63a28154c7fbee569263262d61a5b39975bdbc4520f49ded46999df3e9ee" exitCode=0
Jul 29 22:03:14.276566 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.276419    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"
Jul 29 22:03:14.276566 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.276475    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5" event={"ID":"f00e8810-cf51-428c-90a9-e875d7b4feec","Type":"ContainerDied","Data":"b4ce63a28154c7fbee569263262d61a5b39975bdbc4520f49ded46999df3e9ee"}
Jul 29 22:03:14.276643 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.276563    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5" event={"ID":"f00e8810-cf51-428c-90a9-e875d7b4feec","Type":"ContainerDied","Data":"0373dc869085a035f455c32d4ce94b6ea2157957047accc47e41d6470dd72333"}
Jul 29 22:03:14.276643 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.276593    2575 scope.go:117] "RemoveContainer" containerID="b4ce63a28154c7fbee569263262d61a5b39975bdbc4520f49ded46999df3e9ee"
Jul 29 22:03:14.286016 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.285996    2575 scope.go:117] "RemoveContainer" containerID="dce5fa53b3e59627f07ed568c0dfedc28520a4c11d190377bf2558dd3ec488bc"
Jul 29 22:03:14.294268 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.294250    2575 scope.go:117] "RemoveContainer" containerID="b4ce63a28154c7fbee569263262d61a5b39975bdbc4520f49ded46999df3e9ee"
Jul 29 22:03:14.294540 ip-10-0-134-66 kubenswrapper[2575]: E0729 22:03:14.294520    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4ce63a28154c7fbee569263262d61a5b39975bdbc4520f49ded46999df3e9ee\": container with ID starting with b4ce63a28154c7fbee569263262d61a5b39975bdbc4520f49ded46999df3e9ee not found: ID does not exist" containerID="b4ce63a28154c7fbee569263262d61a5b39975bdbc4520f49ded46999df3e9ee"
Jul 29 22:03:14.294608 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.294549    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4ce63a28154c7fbee569263262d61a5b39975bdbc4520f49ded46999df3e9ee"} err="failed to get container status \"b4ce63a28154c7fbee569263262d61a5b39975bdbc4520f49ded46999df3e9ee\": rpc error: code = NotFound desc = could not find container \"b4ce63a28154c7fbee569263262d61a5b39975bdbc4520f49ded46999df3e9ee\": container with ID starting with b4ce63a28154c7fbee569263262d61a5b39975bdbc4520f49ded46999df3e9ee not found: ID does not exist"
Jul 29 22:03:14.294608 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.294568    2575 scope.go:117] "RemoveContainer" containerID="dce5fa53b3e59627f07ed568c0dfedc28520a4c11d190377bf2558dd3ec488bc"
Jul 29 22:03:14.294813 ip-10-0-134-66 kubenswrapper[2575]: E0729 22:03:14.294791    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dce5fa53b3e59627f07ed568c0dfedc28520a4c11d190377bf2558dd3ec488bc\": container with ID starting with dce5fa53b3e59627f07ed568c0dfedc28520a4c11d190377bf2558dd3ec488bc not found: ID does not exist" containerID="dce5fa53b3e59627f07ed568c0dfedc28520a4c11d190377bf2558dd3ec488bc"
Jul 29 22:03:14.294869 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.294821    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dce5fa53b3e59627f07ed568c0dfedc28520a4c11d190377bf2558dd3ec488bc"} err="failed to get container status \"dce5fa53b3e59627f07ed568c0dfedc28520a4c11d190377bf2558dd3ec488bc\": rpc error: code = NotFound desc = could not find container \"dce5fa53b3e59627f07ed568c0dfedc28520a4c11d190377bf2558dd3ec488bc\": container with ID starting with dce5fa53b3e59627f07ed568c0dfedc28520a4c11d190377bf2558dd3ec488bc not found: ID does not exist"
Jul 29 22:03:14.297877 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.297855    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"]
Jul 29 22:03:14.302595 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.302574    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-fe32bc-openshift-default-796f9cdcd4-4b8m5"]
Jul 29 22:03:14.320055 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.320034    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-podinfo\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:14.320128 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.320054    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4js5\" (UniqueName: \"kubernetes.io/projected/f00e8810-cf51-428c-90a9-e875d7b4feec-kube-api-access-c4js5\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:14.320128 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.320064    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-envoy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:14.320128 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.320074    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-data\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:14.320128 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.320081    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f00e8810-cf51-428c-90a9-e875d7b4feec-istio-token\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:14.482648 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:14.482569    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f00e8810-cf51-428c-90a9-e875d7b4feec" path="/var/lib/kubelet/pods/f00e8810-cf51-428c-90a9-e875d7b4feec/volumes"
Jul 29 22:03:19.347261 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:19.347220    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:21.395586 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:21.395509    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:22.815508 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:22.815440    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8q668"]
Jul 29 22:03:26.474243 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:26.474139    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:26.589906 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:26.589869    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:26.731790 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:26.731692    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"]
Jul 29 22:03:26.732035 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:26.731984    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49" podUID="b96f21ad-56e8-4b03-a293-82bcc55bc24b" containerName="istio-proxy" containerID="cri-o://3e953185cdb1c37c072f84127ba579d2e34990a0f5740dfc55bb68bc8a7502fd" gracePeriod=30
Jul 29 22:03:27.532348 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:27.532315    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:27.631945 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:27.631914    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:29.287840 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:29.287750    2575 patch_prober.go:28] interesting pod/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 22:03:29.287840 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:29.287824    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49" podUID="b96f21ad-56e8-4b03-a293-82bcc55bc24b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 22:03:31.994654 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:31.994594    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 22:03:32.087922 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.087883    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-token\") pod \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") "
Jul 29 22:03:32.088115 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.087941    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-data\") pod \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") "
Jul 29 22:03:32.088115 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.087991    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istiod-ca-cert\") pod \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") "
Jul 29 22:03:32.088115 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.088019    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-workload-certs\") pod \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") "
Jul 29 22:03:32.088115 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.088037    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-envoy\") pod \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") "
Jul 29 22:03:32.088115 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.088059    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-podinfo\") pod \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") "
Jul 29 22:03:32.088115 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.088087    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-credential-socket\") pod \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") "
Jul 29 22:03:32.088431 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.088120    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsr5v\" (UniqueName: \"kubernetes.io/projected/b96f21ad-56e8-4b03-a293-82bcc55bc24b-kube-api-access-wsr5v\") pod \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") "
Jul 29 22:03:32.088431 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.088161    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-workload-socket\") pod \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\" (UID: \"b96f21ad-56e8-4b03-a293-82bcc55bc24b\") "
Jul 29 22:03:32.088580 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.088552    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b96f21ad-56e8-4b03-a293-82bcc55bc24b" (UID: "b96f21ad-56e8-4b03-a293-82bcc55bc24b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:03:32.088651 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.088560    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b96f21ad-56e8-4b03-a293-82bcc55bc24b" (UID: "b96f21ad-56e8-4b03-a293-82bcc55bc24b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 22:03:32.088711 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.088691    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b96f21ad-56e8-4b03-a293-82bcc55bc24b" (UID: "b96f21ad-56e8-4b03-a293-82bcc55bc24b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:03:32.088765 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.088686    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b96f21ad-56e8-4b03-a293-82bcc55bc24b" (UID: "b96f21ad-56e8-4b03-a293-82bcc55bc24b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:03:32.089051 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.089018    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-data" (OuterVolumeSpecName: "istio-data") pod "b96f21ad-56e8-4b03-a293-82bcc55bc24b" (UID: "b96f21ad-56e8-4b03-a293-82bcc55bc24b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:03:32.090350 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.090322    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-token" (OuterVolumeSpecName: "istio-token") pod "b96f21ad-56e8-4b03-a293-82bcc55bc24b" (UID: "b96f21ad-56e8-4b03-a293-82bcc55bc24b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 22:03:32.090510 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.090380    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b96f21ad-56e8-4b03-a293-82bcc55bc24b" (UID: "b96f21ad-56e8-4b03-a293-82bcc55bc24b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 22:03:32.090824 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.090801    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b96f21ad-56e8-4b03-a293-82bcc55bc24b" (UID: "b96f21ad-56e8-4b03-a293-82bcc55bc24b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 22:03:32.090914 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.090824    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b96f21ad-56e8-4b03-a293-82bcc55bc24b-kube-api-access-wsr5v" (OuterVolumeSpecName: "kube-api-access-wsr5v") pod "b96f21ad-56e8-4b03-a293-82bcc55bc24b" (UID: "b96f21ad-56e8-4b03-a293-82bcc55bc24b"). InnerVolumeSpecName "kube-api-access-wsr5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 22:03:32.189631 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.189605    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-podinfo\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:32.189631 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.189628    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-credential-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:32.189814 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.189639    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsr5v\" (UniqueName: \"kubernetes.io/projected/b96f21ad-56e8-4b03-a293-82bcc55bc24b-kube-api-access-wsr5v\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:32.189814 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.189649    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-workload-socket\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:32.189814 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.189658    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-token\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:32.189814 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.189667    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-data\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:32.189814 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.189674    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istiod-ca-cert\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:32.189814 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.189681    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-workload-certs\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:32.189814 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.189688    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b96f21ad-56e8-4b03-a293-82bcc55bc24b-istio-envoy\") on node \"ip-10-0-134-66.ec2.internal\" DevicePath \"\""
Jul 29 22:03:32.373266 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.373232    2575 generic.go:356] "Generic (PLEG): container finished" podID="b96f21ad-56e8-4b03-a293-82bcc55bc24b" containerID="3e953185cdb1c37c072f84127ba579d2e34990a0f5740dfc55bb68bc8a7502fd" exitCode=0
Jul 29 22:03:32.373423 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.373286    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"
Jul 29 22:03:32.373423 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.373317    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49" event={"ID":"b96f21ad-56e8-4b03-a293-82bcc55bc24b","Type":"ContainerDied","Data":"3e953185cdb1c37c072f84127ba579d2e34990a0f5740dfc55bb68bc8a7502fd"}
Jul 29 22:03:32.373423 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.373373    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49" event={"ID":"b96f21ad-56e8-4b03-a293-82bcc55bc24b","Type":"ContainerDied","Data":"2c913cd1674bc616e4fb1c1dfced0f3e72d4859437d9af0a5cbe115be0f9294e"}
Jul 29 22:03:32.373423 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.373396    2575 scope.go:117] "RemoveContainer" containerID="3e953185cdb1c37c072f84127ba579d2e34990a0f5740dfc55bb68bc8a7502fd"
Jul 29 22:03:32.383299 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.383280    2575 scope.go:117] "RemoveContainer" containerID="e21ab05ef9b795900124fe4d09d8b8ebd975f30f5d4e28fc4fae7346a812e85f"
Jul 29 22:03:32.391859 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.391836    2575 scope.go:117] "RemoveContainer" containerID="3e953185cdb1c37c072f84127ba579d2e34990a0f5740dfc55bb68bc8a7502fd"
Jul 29 22:03:32.392112 ip-10-0-134-66 kubenswrapper[2575]: E0729 22:03:32.392092    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e953185cdb1c37c072f84127ba579d2e34990a0f5740dfc55bb68bc8a7502fd\": container with ID starting with 3e953185cdb1c37c072f84127ba579d2e34990a0f5740dfc55bb68bc8a7502fd not found: ID does not exist" containerID="3e953185cdb1c37c072f84127ba579d2e34990a0f5740dfc55bb68bc8a7502fd"
Jul 29 22:03:32.392166 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.392120    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e953185cdb1c37c072f84127ba579d2e34990a0f5740dfc55bb68bc8a7502fd"} err="failed to get container status \"3e953185cdb1c37c072f84127ba579d2e34990a0f5740dfc55bb68bc8a7502fd\": rpc error: code = NotFound desc = could not find container \"3e953185cdb1c37c072f84127ba579d2e34990a0f5740dfc55bb68bc8a7502fd\": container with ID starting with 3e953185cdb1c37c072f84127ba579d2e34990a0f5740dfc55bb68bc8a7502fd not found: ID does not exist"
Jul 29 22:03:32.392166 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.392138    2575 scope.go:117] "RemoveContainer" containerID="e21ab05ef9b795900124fe4d09d8b8ebd975f30f5d4e28fc4fae7346a812e85f"
Jul 29 22:03:32.392384 ip-10-0-134-66 kubenswrapper[2575]: E0729 22:03:32.392365    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e21ab05ef9b795900124fe4d09d8b8ebd975f30f5d4e28fc4fae7346a812e85f\": container with ID starting with e21ab05ef9b795900124fe4d09d8b8ebd975f30f5d4e28fc4fae7346a812e85f not found: ID does not exist" containerID="e21ab05ef9b795900124fe4d09d8b8ebd975f30f5d4e28fc4fae7346a812e85f"
Jul 29 22:03:32.392427 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.392391    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e21ab05ef9b795900124fe4d09d8b8ebd975f30f5d4e28fc4fae7346a812e85f"} err="failed to get container status \"e21ab05ef9b795900124fe4d09d8b8ebd975f30f5d4e28fc4fae7346a812e85f\": rpc error: code = NotFound desc = could not find container \"e21ab05ef9b795900124fe4d09d8b8ebd975f30f5d4e28fc4fae7346a812e85f\": container with ID starting with e21ab05ef9b795900124fe4d09d8b8ebd975f30f5d4e28fc4fae7346a812e85f not found: ID does not exist"
Jul 29 22:03:32.396985 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.396964    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"]
Jul 29 22:03:32.402642 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.402618    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-670ddc-openshift-default-dd9b9b544-r9r49"]
Jul 29 22:03:32.482784 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:32.482756    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b96f21ad-56e8-4b03-a293-82bcc55bc24b" path="/var/lib/kubelet/pods/b96f21ad-56e8-4b03-a293-82bcc55bc24b/volumes"
Jul 29 22:03:33.146496 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:33.146462    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9gf5h_011617b9-408e-47e4-89a5-523c2265f543/manager/0.log"
Jul 29 22:03:33.286894 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:33.286861    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jhb4l_cd5f18e9-c065-4e96-aa61-68dbc0509095/manager/0.log"
Jul 29 22:03:33.806724 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:33.806696    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8446ffcd9c-72qt6_48364292-ba6d-4420-b602-3fa234d29422/copy-manifests/0.log"
Jul 29 22:03:33.816729 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:33.816708    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8446ffcd9c-72qt6_48364292-ba6d-4420-b602-3fa234d29422/manager/0.log"
Jul 29 22:03:34.574510 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:34.574476    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29756010-zkskw_5a37fb97-f1df-46e4-b48b-91289d365e47/cleanup/0.log"
Jul 29 22:03:34.694413 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:34.694379    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29756025-q7hfk_4dddc6c8-e115-4fdb-842a-a4eb9fdef159/cleanup/0.log"
Jul 29 22:03:34.811322 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:34.811292    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29756040-rqt6k_9b3c8e8f-80f4-44c0-aa5b-e7a46b2e0aec/cleanup/0.log"
Jul 29 22:03:37.087987 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:37.087957    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8q668_3db0947e-3709-4542-8226-00b6016546bf/limitador/0.log"
Jul 29 22:03:37.604771 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:37.604737    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m_af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab/istio-proxy/0.log"
Jul 29 22:03:38.131954 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:38.131917    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-99jf9_72aff634-da5f-432e-92aa-cbc8193dca2d/istio-proxy/1.log"
Jul 29 22:03:38.980147 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:38.980119    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-fj2dr_5cfecc06-269a-4e2b-a449-82b1ca976a8b/main/0.log"
Jul 29 22:03:39.101699 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:39.101670    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rbf6q_b85c89d8-7f2b-48c6-a9d5-30f42561243b/main/0.log"
Jul 29 22:03:45.803963 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.803921    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xq8zq/must-gather-kxkqp"]
Jul 29 22:03:45.804581 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804560    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b96f21ad-56e8-4b03-a293-82bcc55bc24b" containerName="istio-proxy"
Jul 29 22:03:45.804676 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804583    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b96f21ad-56e8-4b03-a293-82bcc55bc24b" containerName="istio-proxy"
Jul 29 22:03:45.804676 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804598    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f00e8810-cf51-428c-90a9-e875d7b4feec" containerName="istio-proxy"
Jul 29 22:03:45.804676 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804606    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f00e8810-cf51-428c-90a9-e875d7b4feec" containerName="istio-proxy"
Jul 29 22:03:45.804676 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804622    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4176880-283b-4c4c-b2ef-4757c9d0ef78" containerName="istio-proxy"
Jul 29 22:03:45.804676 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804631    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4176880-283b-4c4c-b2ef-4757c9d0ef78" containerName="istio-proxy"
Jul 29 22:03:45.804676 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804650    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4176880-283b-4c4c-b2ef-4757c9d0ef78" containerName="istio-proxy"
Jul 29 22:03:45.804676 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804659    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4176880-283b-4c4c-b2ef-4757c9d0ef78" containerName="istio-proxy"
Jul 29 22:03:45.804676 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804670    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caf9a0ee-d152-4161-b0ed-b49f54e36238" containerName="istio-proxy"
Jul 29 22:03:45.804676 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804679    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="caf9a0ee-d152-4161-b0ed-b49f54e36238" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804694    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caf9a0ee-d152-4161-b0ed-b49f54e36238" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804703    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="caf9a0ee-d152-4161-b0ed-b49f54e36238" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804712    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804722    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804829    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804842    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804851    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="caf9a0ee-d152-4161-b0ed-b49f54e36238" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804860    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4176880-283b-4c4c-b2ef-4757c9d0ef78" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804871    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="caf9a0ee-d152-4161-b0ed-b49f54e36238" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804881    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f00e8810-cf51-428c-90a9-e875d7b4feec" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804891    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4176880-283b-4c4c-b2ef-4757c9d0ef78" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804900    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b96f21ad-56e8-4b03-a293-82bcc55bc24b" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804911    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f00e8810-cf51-428c-90a9-e875d7b4feec" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.804919    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b96f21ad-56e8-4b03-a293-82bcc55bc24b" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.805003    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b96f21ad-56e8-4b03-a293-82bcc55bc24b" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.805014    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b96f21ad-56e8-4b03-a293-82bcc55bc24b" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.805027    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f00e8810-cf51-428c-90a9-e875d7b4feec" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.805036    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f00e8810-cf51-428c-90a9-e875d7b4feec" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.805066    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" containerName="istio-proxy"
Jul 29 22:03:45.805189 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.805074    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="93ed99f5-3b9d-47ce-917e-fe574fa4e5c2" containerName="istio-proxy"
Jul 29 22:03:45.808529 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.808509    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xq8zq/must-gather-kxkqp"
Jul 29 22:03:45.811289 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.811264    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xq8zq\"/\"kube-root-ca.crt\""
Jul 29 22:03:45.812350 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.812329    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xq8zq\"/\"openshift-service-ca.crt\""
Jul 29 22:03:45.812476 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.812350    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xq8zq\"/\"default-dockercfg-9jqsr\""
Jul 29 22:03:45.816302 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.816282    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xq8zq/must-gather-kxkqp"]
Jul 29 22:03:45.816842 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.816812    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:45.913278 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.913243    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:03:45.924558 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.924526    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1c49397e-e3b3-4a6f-8161-1772dd102b72-must-gather-output\") pod \"must-gather-kxkqp\" (UID: \"1c49397e-e3b3-4a6f-8161-1772dd102b72\") " pod="openshift-must-gather-xq8zq/must-gather-kxkqp"
Jul 29 22:03:45.924659 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:45.924581    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csb9f\" (UniqueName: \"kubernetes.io/projected/1c49397e-e3b3-4a6f-8161-1772dd102b72-kube-api-access-csb9f\") pod \"must-gather-kxkqp\" (UID: \"1c49397e-e3b3-4a6f-8161-1772dd102b72\") " pod="openshift-must-gather-xq8zq/must-gather-kxkqp"
Jul 29 22:03:46.025601 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:46.025562    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1c49397e-e3b3-4a6f-8161-1772dd102b72-must-gather-output\") pod \"must-gather-kxkqp\" (UID: \"1c49397e-e3b3-4a6f-8161-1772dd102b72\") " pod="openshift-must-gather-xq8zq/must-gather-kxkqp"
Jul 29 22:03:46.025779 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:46.025618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csb9f\" (UniqueName: \"kubernetes.io/projected/1c49397e-e3b3-4a6f-8161-1772dd102b72-kube-api-access-csb9f\") pod \"must-gather-kxkqp\" (UID: \"1c49397e-e3b3-4a6f-8161-1772dd102b72\") " pod="openshift-must-gather-xq8zq/must-gather-kxkqp"
Jul 29 22:03:46.025991 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:46.025968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1c49397e-e3b3-4a6f-8161-1772dd102b72-must-gather-output\") pod \"must-gather-kxkqp\" (UID: \"1c49397e-e3b3-4a6f-8161-1772dd102b72\") " pod="openshift-must-gather-xq8zq/must-gather-kxkqp"
Jul 29 22:03:46.034781 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:46.034755    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csb9f\" (UniqueName: \"kubernetes.io/projected/1c49397e-e3b3-4a6f-8161-1772dd102b72-kube-api-access-csb9f\") pod \"must-gather-kxkqp\" (UID: \"1c49397e-e3b3-4a6f-8161-1772dd102b72\") " pod="openshift-must-gather-xq8zq/must-gather-kxkqp"
Jul 29 22:03:46.118543 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:46.118430    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xq8zq/must-gather-kxkqp"
Jul 29 22:03:46.254785 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:46.254751    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xq8zq/must-gather-kxkqp"]
Jul 29 22:03:46.257097 ip-10-0-134-66 kubenswrapper[2575]: W0729 22:03:46.257069    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c49397e_e3b3_4a6f_8161_1772dd102b72.slice/crio-18c64dc7f7733d5d0231ddd72a0e76aec52d2532013167ef21f75e8f0db25524 WatchSource:0}: Error finding container 18c64dc7f7733d5d0231ddd72a0e76aec52d2532013167ef21f75e8f0db25524: Status 404 returned error can't find the container with id 18c64dc7f7733d5d0231ddd72a0e76aec52d2532013167ef21f75e8f0db25524
Jul 29 22:03:46.259062 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:46.259047    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 22:03:46.448484 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:46.448381    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xq8zq/must-gather-kxkqp" event={"ID":"1c49397e-e3b3-4a6f-8161-1772dd102b72","Type":"ContainerStarted","Data":"18c64dc7f7733d5d0231ddd72a0e76aec52d2532013167ef21f75e8f0db25524"}
Jul 29 22:03:47.459175 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:47.459133    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xq8zq/must-gather-kxkqp" event={"ID":"1c49397e-e3b3-4a6f-8161-1772dd102b72","Type":"ContainerStarted","Data":"bb2465bfe02d31fe41265d3c8f9e4efe9f7eaae9c0b7a644621ce2545247d759"}
Jul 29 22:03:47.459697 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:47.459188    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xq8zq/must-gather-kxkqp" event={"ID":"1c49397e-e3b3-4a6f-8161-1772dd102b72","Type":"ContainerStarted","Data":"d050e7ac349b720521f814d0f5448b9cdd8f2c548e5c521130c2708e730ef823"}
Jul 29 22:03:47.476199 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:47.476139    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xq8zq/must-gather-kxkqp" podStartSLOduration=1.811941521 podStartE2EDuration="2.476120672s" totalImagesPullingTime="664.179151ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:03:47.47504557 +0000 UTC m=+3619.480568938" watchObservedRunningTime="2026-07-29 22:03:47.476120672 +0000 UTC m=+3619.481644040"
Jul 29 22:03:48.525853 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:48.525815    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lhv4n_091fbbf5-b287-4969-bdbf-b84d4981c4f3/global-pull-secret-syncer/0.log"
Jul 29 22:03:48.677196 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:48.677160    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log"
Jul 29 22:03:48.775423 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:48.775393    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-66.ec2.internal_396253a3efd1499c22363fbe927d2664/haproxy/0.log"
Jul 29 22:03:53.654060 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:53.653982    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8q668_3db0947e-3709-4542-8226-00b6016546bf/limitador/0.log"
Jul 29 22:03:55.388751 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:55.388723    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2f8eb66e-8113-45c3-805d-7188465bc594/alertmanager/0.log"
Jul 29 22:03:55.414951 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:55.414897    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2f8eb66e-8113-45c3-805d-7188465bc594/config-reloader/0.log"
Jul 29 22:03:55.442864 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:55.442838    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2f8eb66e-8113-45c3-805d-7188465bc594/kube-rbac-proxy-web/0.log"
Jul 29 22:03:55.465667 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:55.465638    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2f8eb66e-8113-45c3-805d-7188465bc594/kube-rbac-proxy/0.log"
Jul 29 22:03:55.494153 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:55.494048    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2f8eb66e-8113-45c3-805d-7188465bc594/kube-rbac-proxy-metric/0.log"
Jul 29 22:03:55.519657 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:55.519538    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2f8eb66e-8113-45c3-805d-7188465bc594/prom-label-proxy/0.log"
Jul 29 22:03:55.547392 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:55.547345    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2f8eb66e-8113-45c3-805d-7188465bc594/init-config-reloader/0.log"
Jul 29 22:03:55.600479 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:55.600224    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-kdw9d_c69f337b-af28-45b8-aed8-7c3be7ac0755/cluster-monitoring-operator/0.log"
Jul 29 22:03:55.750188 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:55.750155    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-llbz2_d2339936-1790-4e2a-97e8-85e7bce84f84/monitoring-plugin/0.log"
Jul 29 22:03:55.796465 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:55.792523    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6wd6j_1a356676-2383-4d47-a211-bed0a7bbfa56/node-exporter/0.log"
Jul 29 22:03:55.823397 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:55.823355    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6wd6j_1a356676-2383-4d47-a211-bed0a7bbfa56/kube-rbac-proxy/0.log"
Jul 29 22:03:55.849390 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:55.849367    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6wd6j_1a356676-2383-4d47-a211-bed0a7bbfa56/init-textfile/0.log"
Jul 29 22:03:56.060683 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:56.058532    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-9fkpn_0293bdb3-2a31-480b-8726-faed9e243c1c/kube-rbac-proxy-main/0.log"
Jul 29 22:03:56.086782 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:56.086751    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-9fkpn_0293bdb3-2a31-480b-8726-faed9e243c1c/kube-rbac-proxy-self/0.log"
Jul 29 22:03:56.113801 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:56.113333    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-9fkpn_0293bdb3-2a31-480b-8726-faed9e243c1c/openshift-state-metrics/0.log"
Jul 29 22:03:56.173857 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:56.173634    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da187a43-e8fe-4228-ae44-2d89de6a5506/prometheus/0.log"
Jul 29 22:03:56.201328 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:56.201282    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da187a43-e8fe-4228-ae44-2d89de6a5506/config-reloader/0.log"
Jul 29 22:03:56.245060 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:56.244350    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da187a43-e8fe-4228-ae44-2d89de6a5506/thanos-sidecar/0.log"
Jul 29 22:03:56.269460 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:56.269412    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da187a43-e8fe-4228-ae44-2d89de6a5506/kube-rbac-proxy-web/0.log"
Jul 29 22:03:56.295645 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:56.295611    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da187a43-e8fe-4228-ae44-2d89de6a5506/kube-rbac-proxy/0.log"
Jul 29 22:03:56.320166 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:56.320069    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da187a43-e8fe-4228-ae44-2d89de6a5506/kube-rbac-proxy-thanos/0.log"
Jul 29 22:03:56.340889 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:56.340858    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da187a43-e8fe-4228-ae44-2d89de6a5506/init-config-reloader/0.log"
Jul 29 22:03:56.421956 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:56.421925    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-55ndz_354becda-fc82-4cf6-8169-bf5ec03d4ee1/prometheus-operator-admission-webhook/0.log"
Jul 29 22:03:56.454660 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:56.454628    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54dc7fbb4-24tv4_bdc6bd12-69b5-4e8d-8e43-b39ece5200c4/telemeter-client/0.log"
Jul 29 22:03:56.482097 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:56.482063    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54dc7fbb4-24tv4_bdc6bd12-69b5-4e8d-8e43-b39ece5200c4/reload/0.log"
Jul 29 22:03:56.513256 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:56.513231    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54dc7fbb4-24tv4_bdc6bd12-69b5-4e8d-8e43-b39ece5200c4/kube-rbac-proxy/0.log"
Jul 29 22:03:58.077955 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.077909    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-s9sxm_fb657a40-9774-42ab-974f-2ff4345acc3c/networking-console-plugin/0.log"
Jul 29 22:03:58.792725 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.792684    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"]
Jul 29 22:03:58.802534 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.802499    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:58.805273 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.805243    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"]
Jul 29 22:03:58.879226 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.878719    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lq8b\" (UniqueName: \"kubernetes.io/projected/2d0e29c8-6de7-4e3e-af3b-85fd1c73af73-kube-api-access-4lq8b\") pod \"perf-node-gather-daemonset-h6pb2\" (UID: \"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73\") " pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:58.879226 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.878826    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d0e29c8-6de7-4e3e-af3b-85fd1c73af73-podres\") pod \"perf-node-gather-daemonset-h6pb2\" (UID: \"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73\") " pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:58.879226 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.878870    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d0e29c8-6de7-4e3e-af3b-85fd1c73af73-proc\") pod \"perf-node-gather-daemonset-h6pb2\" (UID: \"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73\") " pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:58.879226 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.878901    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d0e29c8-6de7-4e3e-af3b-85fd1c73af73-sys\") pod \"perf-node-gather-daemonset-h6pb2\" (UID: \"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73\") " pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:58.879226 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.878981    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d0e29c8-6de7-4e3e-af3b-85fd1c73af73-lib-modules\") pod \"perf-node-gather-daemonset-h6pb2\" (UID: \"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73\") " pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:58.979876 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.979828    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d0e29c8-6de7-4e3e-af3b-85fd1c73af73-lib-modules\") pod \"perf-node-gather-daemonset-h6pb2\" (UID: \"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73\") " pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:58.980070 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.979888    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lq8b\" (UniqueName: \"kubernetes.io/projected/2d0e29c8-6de7-4e3e-af3b-85fd1c73af73-kube-api-access-4lq8b\") pod \"perf-node-gather-daemonset-h6pb2\" (UID: \"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73\") " pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:58.980070 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.979959    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d0e29c8-6de7-4e3e-af3b-85fd1c73af73-podres\") pod \"perf-node-gather-daemonset-h6pb2\" (UID: \"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73\") " pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:58.980070 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.979978    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d0e29c8-6de7-4e3e-af3b-85fd1c73af73-lib-modules\") pod \"perf-node-gather-daemonset-h6pb2\" (UID: \"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73\") " pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:58.980070 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.979990    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d0e29c8-6de7-4e3e-af3b-85fd1c73af73-proc\") pod \"perf-node-gather-daemonset-h6pb2\" (UID: \"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73\") " pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:58.980070 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.980041    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d0e29c8-6de7-4e3e-af3b-85fd1c73af73-sys\") pod \"perf-node-gather-daemonset-h6pb2\" (UID: \"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73\") " pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:58.980350 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.980076    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d0e29c8-6de7-4e3e-af3b-85fd1c73af73-sys\") pod \"perf-node-gather-daemonset-h6pb2\" (UID: \"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73\") " pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:58.980350 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.980103    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d0e29c8-6de7-4e3e-af3b-85fd1c73af73-podres\") pod \"perf-node-gather-daemonset-h6pb2\" (UID: \"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73\") " pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:58.980350 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:58.980045    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d0e29c8-6de7-4e3e-af3b-85fd1c73af73-proc\") pod \"perf-node-gather-daemonset-h6pb2\" (UID: \"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73\") " pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:59.003004 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:59.002968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lq8b\" (UniqueName: \"kubernetes.io/projected/2d0e29c8-6de7-4e3e-af3b-85fd1c73af73-kube-api-access-4lq8b\") pod \"perf-node-gather-daemonset-h6pb2\" (UID: \"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73\") " pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:59.124640 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:59.124543    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:59.308497 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:59.308262    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"]
Jul 29 22:03:59.311456 ip-10-0-134-66 kubenswrapper[2575]: W0729 22:03:59.311402    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2d0e29c8_6de7_4e3e_af3b_85fd1c73af73.slice/crio-f9ccca8f669f191ba38803af86bdefd088f2204299a830d3ce06a066dc2a04b9 WatchSource:0}: Error finding container f9ccca8f669f191ba38803af86bdefd088f2204299a830d3ce06a066dc2a04b9: Status 404 returned error can't find the container with id f9ccca8f669f191ba38803af86bdefd088f2204299a830d3ce06a066dc2a04b9
Jul 29 22:03:59.565630 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:59.565592    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2" event={"ID":"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73","Type":"ContainerStarted","Data":"d5ab20479e800d9cd7470219ae436425d0a0a20d402c6d5a045622ef6ffd9918"}
Jul 29 22:03:59.565885 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:59.565656    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2" event={"ID":"2d0e29c8-6de7-4e3e-af3b-85fd1c73af73","Type":"ContainerStarted","Data":"f9ccca8f669f191ba38803af86bdefd088f2204299a830d3ce06a066dc2a04b9"}
Jul 29 22:03:59.565885 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:59.565819    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:03:59.585106 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:59.585043    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2" podStartSLOduration=1.5850267200000001 podStartE2EDuration="1.58502672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:03:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:03:59.582911218 +0000 UTC m=+3631.588434585" watchObservedRunningTime="2026-07-29 22:03:59.58502672 +0000 UTC m=+3631.590550241"
Jul 29 22:03:59.961967 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:03:59.961933    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-d8mb5_3bb7b007-164f-4a96-bdf8-bb56016fdccf/volume-data-source-validator/0.log"
Jul 29 22:04:01.084928 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:01.084895    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l42z5_163ef3df-3eb2-44e3-ad92-0665dbe66343/dns/0.log"
Jul 29 22:04:01.105939 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:01.105912    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l42z5_163ef3df-3eb2-44e3-ad92-0665dbe66343/kube-rbac-proxy/0.log"
Jul 29 22:04:01.128664 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:01.128637    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5kmcr_78fa3b29-d371-437e-ab96-47269879af94/dns-node-resolver/0.log"
Jul 29 22:04:01.763282 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:01.763251    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-696n2_df3cf440-cfee-44f5-b194-82f00a6a4c44/node-ca/0.log"
Jul 29 22:04:02.729821 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:02.729770    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m_af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab/istio-proxy/0.log"
Jul 29 22:04:02.944836 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:02.944799    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-99jf9_72aff634-da5f-432e-92aa-cbc8193dca2d/istio-proxy/0.log"
Jul 29 22:04:02.981261 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:02.981181    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-99jf9_72aff634-da5f-432e-92aa-cbc8193dca2d/istio-proxy/1.log"
Jul 29 22:04:03.942396 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:03.942361    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8xb9c_ce278890-ad21-445b-adb0-27a807a79f86/serve-healthcheck-canary/0.log"
Jul 29 22:04:04.443360 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:04.443312    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-smtxx_28d35bea-1e86-45a5-99f2-1cd1e51dbfed/insights-operator/0.log"
Jul 29 22:04:04.444076 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:04.444048    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-smtxx_28d35bea-1e86-45a5-99f2-1cd1e51dbfed/insights-operator/1.log"
Jul 29 22:04:04.450971 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:04.450935    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4r87h_8dae69cf-821a-44a8-88c0-71231fa90777/konnectivity-agent/0.log" limit=1024
Jul 29 22:04:04.537822 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:04.537792    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hpz5z_a0298cd0-9c41-44cb-80ce-a8a2665ad445/kube-rbac-proxy/0.log"
Jul 29 22:04:04.562992 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:04.562962    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hpz5z_a0298cd0-9c41-44cb-80ce-a8a2665ad445/exporter/0.log"
Jul 29 22:04:04.585223 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:04.585193    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hpz5z_a0298cd0-9c41-44cb-80ce-a8a2665ad445/extractor/0.log"
Jul 29 22:04:05.588027 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:05.587993    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xq8zq/perf-node-gather-daemonset-h6pb2"
Jul 29 22:04:06.744305 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:06.744269    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9gf5h_011617b9-408e-47e4-89a5-523c2265f543/manager/0.log"
Jul 29 22:04:07.066971 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:07.066936    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jhb4l_cd5f18e9-c065-4e96-aa61-68dbc0509095/manager/0.log"
Jul 29 22:04:07.357223 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:07.357137    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8446ffcd9c-72qt6_48364292-ba6d-4420-b602-3fa234d29422/manager/0.log"
Jul 29 22:04:07.382061 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:07.382030    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8446ffcd9c-72qt6_48364292-ba6d-4420-b602-3fa234d29422/copy-manifests/0.log"
Jul 29 22:04:08.999812 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:08.999778    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d97fdbb4b-n4lzl_70d76b4a-5884-4287-85f6-30780039a937/manager/0.log"
Jul 29 22:04:09.026268 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:09.026238    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-mscrd_97892046-0a99-4ee7-8aaf-80be9a987d81/openshift-lws-operator/0.log"
Jul 29 22:04:09.488086 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:09.488056    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m_af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab/istio-proxy/0.log"
Jul 29 22:04:09.677821 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:09.677786    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-99jf9_72aff634-da5f-432e-92aa-cbc8193dca2d/istio-proxy/0.log"
Jul 29 22:04:09.715644 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:09.715615    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-99jf9_72aff634-da5f-432e-92aa-cbc8193dca2d/istio-proxy/1.log"
Jul 29 22:04:11.144363 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:11.144274    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6sz8m_af83174d-86cf-4c1c-8e1a-a0ab19d7d8ab/istio-proxy/0.log"
Jul 29 22:04:11.337867 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:11.337833    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-99jf9_72aff634-da5f-432e-92aa-cbc8193dca2d/istio-proxy/0.log"
Jul 29 22:04:11.372207 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:11.372172    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-99jf9_72aff634-da5f-432e-92aa-cbc8193dca2d/istio-proxy/1.log"
Jul 29 22:04:13.979665 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:13.979638    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-xknth_579b63d3-9205-49b5-8f5c-8eb6f4c22bbb/migrator/0.log"
Jul 29 22:04:14.001159 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:14.001126    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-xknth_579b63d3-9205-49b5-8f5c-8eb6f4c22bbb/graceful-termination/0.log"
Jul 29 22:04:15.632511 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:15.632483    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttp4q_0b2b7b29-9225-48c9-966d-1e90a3b431a8/kube-multus-additional-cni-plugins/0.log"
Jul 29 22:04:15.657398 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:15.657374    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttp4q_0b2b7b29-9225-48c9-966d-1e90a3b431a8/egress-router-binary-copy/0.log"
Jul 29 22:04:15.680601 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:15.680572    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttp4q_0b2b7b29-9225-48c9-966d-1e90a3b431a8/cni-plugins/0.log"
Jul 29 22:04:15.701539 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:15.701517    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttp4q_0b2b7b29-9225-48c9-966d-1e90a3b431a8/bond-cni-plugin/0.log"
Jul 29 22:04:15.722888 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:15.722863    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttp4q_0b2b7b29-9225-48c9-966d-1e90a3b431a8/routeoverride-cni/0.log"
Jul 29 22:04:15.744602 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:15.744576    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttp4q_0b2b7b29-9225-48c9-966d-1e90a3b431a8/whereabouts-cni-bincopy/0.log"
Jul 29 22:04:15.765686 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:15.765653    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttp4q_0b2b7b29-9225-48c9-966d-1e90a3b431a8/whereabouts-cni/0.log"
Jul 29 22:04:15.877631 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:15.877600    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-p9nbl_97bfc384-e246-4ee4-b5f7-39cbe1917d44/kube-multus/0.log"
Jul 29 22:04:15.944476 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:15.944377    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4wwgl_ff9a3f79-f4da-491d-abb3-8acc9ff17877/network-metrics-daemon/0.log"
Jul 29 22:04:15.962730 ip-10-0-134-66 kubenswrapper[2575]: I0729 22:04:15.962693    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4wwgl_ff9a3f79-f4da-491d-abb3-8acc9ff17877/kube-rbac-proxy/0.log"