Jul 08 18:37:32.714064 ip-10-0-129-111 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 18:37:32.714073 ip-10-0-129-111 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 18:37:32.714080 ip-10-0-129-111 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 18:37:32.714287 ip-10-0-129-111 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 18:37:42.528139 ip-10-0-129-111 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 18:37:42.528156 ip-10-0-129-111 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 72aef3ac8f3641bdaf8a88aae860181d --
Jul 08 18:39:31.657182 ip-10-0-129-111 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 18:39:32.003334 ip-10-0-129-111 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 18:39:32.003334 ip-10-0-129-111 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 18:39:32.003334 ip-10-0-129-111 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 18:39:32.003334 ip-10-0-129-111 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 18:39:32.003334 ip-10-0-129-111 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 18:39:32.004326 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.004262    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 18:39:32.011661 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011641    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 18:39:32.011661 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011657    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 18:39:32.011661 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011661    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 18:39:32.011661 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011665    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 18:39:32.011661 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011668    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011672    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011674    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011677    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011680    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011683    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011686    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011688    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011691    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011693    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011696    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011699    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011701    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011704    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011707    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011710    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011712    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011715    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011718    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011722    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 18:39:32.011847 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011727    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011729    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011732    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011735    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011738    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011740    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011743    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011746    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011748    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011751    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011754    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011756    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011759    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011762    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011765    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011768    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011771    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011774    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011777    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011779    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 18:39:32.012312 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011782    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011784    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011787    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011790    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011792    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011795    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011798    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011801    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011804    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011806    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011808    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011811    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011813    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011816    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011818    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011821    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011824    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011826    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011829    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011831    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 18:39:32.012805 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011834    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011836    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011839    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011844    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011849    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011852    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011856    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011859    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011862    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011864    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011867    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011870    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011873    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011875    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011878    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011881    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011884    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011886    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011889    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 18:39:32.013308 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011892    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011894    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011899    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011901    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011904    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011906    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011909    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011911    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011914    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011916    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011919    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011922    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011926    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011929    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011932    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.011935    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012620    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012643    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012646    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012649    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 18:39:32.013775 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012651    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012654    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012657    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012660    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012663    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012665    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012668    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012672    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012676    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012679    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012682    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012685    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012687    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012691    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012694    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012697    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012699    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012702    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012705    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 18:39:32.014270 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012707    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012710    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012712    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012715    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012717    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012720    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012722    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012725    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012727    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012730    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012732    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012734    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012737    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012740    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012743    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012745    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012748    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012750    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012753    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012755    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 18:39:32.014752 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012759    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012761    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012764    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012766    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012770    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012773    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012776    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012780    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012783    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012786    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012789    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012792    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012795    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012797    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012800    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012802    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012805    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012807    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012810    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 18:39:32.015282 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012813    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012816    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012820    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012822    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012825    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012828    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012831    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012834    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012836    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012839    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012841    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012844    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012847    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012850    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012853    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012855    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012858    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012860    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012862    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 18:39:32.015770 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012865    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012868    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012871    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012873    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012876    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012879    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012881    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012884    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012886    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012888    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012891    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012893    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012895    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012898    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012901    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012903    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012906    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.012908    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013292    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013296    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013299    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 18:39:32.016219 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013302    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013305    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013307    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013310    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013313    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013316    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013318    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013321    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013324    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013326    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013329    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013332    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013335    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013339    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013343    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013346    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013349    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013351    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013354    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013357    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 18:39:32.016732 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013359    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013362    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013364    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013367    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013369    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013372    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013375    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013377    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013379    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013382    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013385    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013387    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013390    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013392    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013395    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013397    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013400    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013402    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013407    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 18:39:32.017212 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013410    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013413    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013416    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013419    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013421    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013424    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013427    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013430    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013433    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013435    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013438    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013440    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013442    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013445    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013448    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013451    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013453    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013456    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013458    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013460    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 18:39:32.017688 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013463    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013465    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013469    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013473    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013475    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013479    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013482    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013484    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013487    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013490    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013493    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013495    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013498    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013501    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013503    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013505    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013511    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013513    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013516    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 18:39:32.018162 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013518    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013521    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013524    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013526    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013529    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013531    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013534    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013536    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013539    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013541    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013544    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013546    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013549    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013551    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013554    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013556    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013558    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.013561    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013643    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013652    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013661    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 18:39:32.018610 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013667    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013672    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013676    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013679    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013686    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013689    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013692    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013695    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013700    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013703    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013706    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013709    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013712    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013715    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013718    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013723    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013725    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013728    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013731    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013735    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013738    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013741    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013744    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 18:39:32.019116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013747    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013751    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013753    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013756    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013759    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013762    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013766    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013769    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013772    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013775    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013778    2563 flags.go:64] FLAG: --enable-server="true"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013781    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013785    2563 flags.go:64] FLAG: --event-burst="100"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013790    2563 flags.go:64] FLAG: --event-qps="50"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013793    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013796    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013799    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013803    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013806    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013809    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013812    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013815    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013817    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013820    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013823    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 18:39:32.019765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013826    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013829    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013832    2563 flags.go:64] FLAG: --feature-gates=""
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013836    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013839    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013842    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013845    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013847    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013850    2563 flags.go:64] FLAG: --help="false"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013853    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013856    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013859    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013862    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013865    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013869    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013871    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013874    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013877    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013880    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013882    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013889    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013892    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013895    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013897    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 18:39:32.020835 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013901    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013904    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013906    2563 flags.go:64] FLAG: --lock-file=""
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013909    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013912    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013915    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013920    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013923    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013926    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013929    2563 flags.go:64] FLAG: --logging-format="text"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013932    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013935    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013938    2563 flags.go:64] FLAG: --manifest-url=""
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013941    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013945    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013948    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013952    2563 flags.go:64] FLAG: --max-pods="110"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013954    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013957    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013960    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013963    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013966    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013969    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013972    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013979    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 18:39:32.021855 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013982    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013985    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013987    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013992    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.013998    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014001    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014004    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014007    2563 flags.go:64] FLAG: --port="10250"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014010    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014013    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07d3bffdb19814de0"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014016    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014019    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014021    2563 flags.go:64] FLAG: --register-node="true"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014024    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014028    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014031    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014034    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014036    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014040    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014043    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014046    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014048    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014051    2563 flags.go:64] FLAG: --runonce="false"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014054    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014057    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 18:39:32.022964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014060    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014063    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014065    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014068    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014071    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014074    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014076    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014079    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014082    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014084    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014089    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014091    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014094    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014099    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014102    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014105    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014110    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014112    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014115    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014118    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014120    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014123    2563 flags.go:64] FLAG: --v="2"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014127    2563 flags.go:64] FLAG: --version="false"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014134    2563 flags.go:64] FLAG: --vmodule=""
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014138    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 18:39:32.023818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.014141    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014247    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014250    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014253    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014255    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014258    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014261    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014263    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014266    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014268    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014271    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014274    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014276    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014279    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014281    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014285    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014289    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014293    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014295    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 18:39:32.024859 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014298    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014300    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014303    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014307    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014310    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014312    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014315    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014317    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014320    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014323    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014325    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014328    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014331    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014334    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014336    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014338    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014341    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014343    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014346    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 18:39:32.025456 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014348    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014351    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014353    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014356    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014358    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014360    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014363    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014365    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014368    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014370    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014373    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014377    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014379    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014381    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014384    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014386    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014390    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014392    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014395    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014398    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 18:39:32.026091 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014400    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014403    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014405    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014408    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014410    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014413    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014416    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014418    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014420    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014423    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014426    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014428    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014431    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014435    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014438    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014441    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014444    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014447    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014449    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014452    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 18:39:32.026667 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014455    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014457    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014460    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014463    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014466    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014468    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014470    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014473    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014476    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014479    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014482    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014485    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014487    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014490    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014493    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014497    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014500    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014502    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014505    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 18:39:32.027141 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014509    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 18:39:32.027669 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014512    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 18:39:32.027669 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.014514    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 18:39:32.027669 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.015149    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 18:39:32.027669 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.021843    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 18:39:32.027669 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.021862    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 18:39:32.027669 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.021887    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 18:39:32.027669 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.021895    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 18:39:32.027669 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.021979    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 18:39:32.027669 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.021986    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 18:39:32.027669 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.021990    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 18:39:32.027669 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.021995    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 18:39:32.027669 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.021999    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 18:39:32.027669 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022003    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 18:39:32.027669 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022008    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 18:39:32.027669 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022012    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022016    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022020    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022025    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022029    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022033    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022037    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022041    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022046    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022049    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022054    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022058    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022062    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022066    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022071    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022075    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022079    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022083    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022087    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022091    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 18:39:32.028090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022095    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022099    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022105    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022109    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022114    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022118    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022122    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022126    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022130    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022134    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022138    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022142    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022146    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022151    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022158    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022163    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022168    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022173    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022177    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022181    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 18:39:32.028598 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022185    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022189    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022193    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022197    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022201    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022206    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022210    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022215    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022219    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022223    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022227    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022231    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022236    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022241    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022245    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022250    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022254    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022258    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022262    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022266    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 18:39:32.029074 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022270    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022274    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022280    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022285    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022291    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022297    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022302    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022306    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022310    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022314    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022318    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022322    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022326    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022330    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022334    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022338    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022342    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022346    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022350    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 18:39:32.029659 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022354    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 18:39:32.030201 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022358    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 18:39:32.030201 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022362    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 18:39:32.030201 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022366    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 18:39:32.030201 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022371    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 18:39:32.030201 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022375    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 18:39:32.030201 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022379    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 18:39:32.030201 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022384    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 18:39:32.030201 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022388    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 18:39:32.030201 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022393    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 18:39:32.030201 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022396    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 18:39:32.030201 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022400    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 18:39:32.030201 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022404    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 18:39:32.030201 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.022412    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 18:39:32.030201 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022584    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022593    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022600    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022605    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022610    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022615    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022619    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022640    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022645    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022649    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022653    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022658    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022662    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022666    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022670    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022674    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022678    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022682    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022686    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 18:39:32.030561 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022690    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022695    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022699    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022703    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022709    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022714    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022719    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022724    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022729    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022734    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022739    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022743    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022748    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022752    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022757    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022761    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022765    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022769    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022773    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022778    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 18:39:32.031062 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022782    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022786    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022790    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022794    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022798    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022802    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022806    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022810    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022814    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022818    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022823    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022827    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022833    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022837    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022842    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022846    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022851    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022855    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022860    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 18:39:32.031901 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022865    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022869    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022873    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022878    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022882    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022886    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022890    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022894    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022899    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022903    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022907    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022911    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022916    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022920    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022924    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022928    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022932    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022936    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022940    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022944    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 18:39:32.032725 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022949    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022953    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022957    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022961    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022965    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022969    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022973    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022976    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022980    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022985    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022988    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022993    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.022997    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.023001    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.023005    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.023009    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.023014    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.023019    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.023023    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.023027    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 18:39:32.033536 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:32.023031    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 18:39:32.034195 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.023039    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 18:39:32.034195 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.023209    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 18:39:32.034195 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.025767    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 18:39:32.034195 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.029149    2563 server.go:1019] "Starting client certificate rotation"
Jul 08 18:39:32.034195 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.029252    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 18:39:32.034195 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.029320    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 18:39:32.034195 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.031684    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 18:39:32.034195 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.033426    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 18:39:32.044411 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.044391    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 08 18:39:32.046760 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.046742    2563 log.go:25] "Validated CRI v1 image API"
Jul 08 18:39:32.048085 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.048067    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 18:39:32.050160 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.050143    2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 f1bcdde1-c1f0-4058-ac42-0fdbe96a8389:/dev/nvme0n1p3 f5749ab0-6938-4995-a3bb-c91fbd5aae1b:/dev/nvme0n1p4]
Jul 08 18:39:32.050225 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.050159    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 18:39:32.054235 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.054132    2563 manager.go:216] Machine: {Timestamp:2026-07-08 18:39:32.053665278 +0000 UTC m=+0.296156389 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102207 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dee842d8ad0d913eda44f421a9983 SystemUUID:ec2dee84-2d8a-d0d9-13ed-a44f421a9983 BootID:72aef3ac-8f36-41bd-af8a-88aae860181d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:57:e5:ab:20:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:57:e5:ab:20:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:17:93:e0:a0:61 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 18:39:32.054235 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.054225    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 18:39:32.054372 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.054287    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 18:39:32.056969 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.056941    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 18:39:32.057127 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.056971    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-111.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 18:39:32.057633 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.057614    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 18:39:32.057665 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.057639    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 18:39:32.057665 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.057651    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 18:39:32.058569 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.058559    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 18:39:32.058831 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.058814    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 18:39:32.059856 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.059845    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 18:39:32.064205 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.064193    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 18:39:32.064341 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.064331    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 18:39:32.064371 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.064361    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 18:39:32.064401 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.064376    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 18:39:32.064401 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.064392    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 18:39:32.064401 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.064402    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 08 18:39:32.064519 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.064410    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 18:39:32.064709 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.064699    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 18:39:32.064741 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.064715    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 18:39:32.066468 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.066448    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 18:39:32.068124 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.068111    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 18:39:32.068181 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.068141    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 18:39:32.069234 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.069221    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 18:39:32.069311 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.069239    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 18:39:32.069311 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.069245    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 18:39:32.069311 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.069251    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 18:39:32.069311 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.069259    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 18:39:32.069311 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.069264    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 18:39:32.069311 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.069272    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 18:39:32.069311 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.069277    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 18:39:32.069311 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.069283    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 18:39:32.069311 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.069288    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 18:39:32.069311 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.069306    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 18:39:32.069311 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.069311    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 18:39:32.069994 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.069984    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 18:39:32.069994 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.069994    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 18:39:32.073028 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.073015    2563 server.go:1268] "Started kubelet"
Jul 08 18:39:32.073111 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.073078    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 18:39:32.073177 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.073100    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 18:39:32.073225 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.073203    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 18:39:32.073651 ip-10-0-129-111 systemd[1]: Started Kubernetes Kubelet.
Jul 08 18:39:32.076745 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.076522    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 18:39:32.078048 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.078033    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 18:39:32.078761 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.078736    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 18:39:32.081688 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.081673    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-111.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 18:39:32.081688 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.081674    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-111.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 18:39:32.081965 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.081948    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 18:39:32.082711 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.081904    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-111.ec2.internal.18c064845b8a9227  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-111.ec2.internal,UID:ip-10-0-129-111.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-111.ec2.internal,},FirstTimestamp:2026-07-08 18:39:32.072985127 +0000 UTC m=+0.315476239,LastTimestamp:2026-07-08 18:39:32.072985127 +0000 UTC m=+0.315476239,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-111.ec2.internal,}"
Jul 08 18:39:32.085456 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.085437    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 18:39:32.085532 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.085456    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 18:39:32.085615 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.085596    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-111.ec2.internal\" not found"
Jul 08 18:39:32.086295 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.086279    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 18:39:32.086295 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.086289    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 18:39:32.086439 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.086303    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 18:39:32.086439 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.086400    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 18:39:32.086439 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.086409    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 18:39:32.086439 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.086423    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 18:39:32.086439 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.086438    2563 factory.go:55] Registering systemd factory
Jul 08 18:39:32.086670 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.086447    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 08 18:39:32.086670 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.086641    2563 factory.go:153] Registering CRI-O factory
Jul 08 18:39:32.086670 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.086649    2563 factory.go:223] Registration of the crio container factory successfully
Jul 08 18:39:32.086670 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.086664    2563 factory.go:103] Registering Raw factory
Jul 08 18:39:32.086852 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.086677    2563 manager.go:1196] Started watching for new ooms in manager
Jul 08 18:39:32.087184 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.087172    2563 manager.go:349] Starting recovery of all containers
Jul 08 18:39:32.097130 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.097041    2563 manager.go:354] Recovery completed
Jul 08 18:39:32.098183 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.098158    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-111.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 18:39:32.098280 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.098264    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 18:39:32.099950 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.099934    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2mmf6"
Jul 08 18:39:32.101037 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.101026    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 18:39:32.102607 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.102593    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 18:39:32.102674 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.102618    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 18:39:32.102674 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.102649    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasSufficientPID"
Jul 08 18:39:32.103128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.103115    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 18:39:32.103128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.103125    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 18:39:32.103225 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.103131    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 18:39:32.103225 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.103139    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 18:39:32.103841 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.103828    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 18:39:32.103893 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.103853    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 18:39:32.103893 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.103863    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasSufficientPID"
Jul 08 18:39:32.105267 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.105255    2563 policy_none.go:49] "None policy: Start"
Jul 08 18:39:32.105305 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.105270    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 18:39:32.105305 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.105281    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 18:39:32.106645 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.106620    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2mmf6"
Jul 08 18:39:32.107261 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.107249    2563 policy_none.go:47] "Start"
Jul 08 18:39:32.140823 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.140811    2563 manager.go:337] "Starting Device Plugin manager"
Jul 08 18:39:32.140878 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.140838    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 18:39:32.140878 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.140847    2563 server.go:87] "Starting device plugin registration server"
Jul 08 18:39:32.141021 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.141010    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 18:39:32.141071 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.141024    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 18:39:32.141193 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.141179    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 18:39:32.141312 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.141256    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 18:39:32.141312 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.141268    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 18:39:32.141665 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.141647    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 18:39:32.141724 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.141701    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-111.ec2.internal\" not found"
Jul 08 18:39:32.216865 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.216839    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 18:39:32.218941 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.217991    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 18:39:32.218941 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.218021    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 18:39:32.218941 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.218039    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 18:39:32.218941 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.218069    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 18:39:32.220854 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.220833    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 18:39:32.242124 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.242110    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 18:39:32.242841 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.242827    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 18:39:32.242893 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.242854    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 18:39:32.242893 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.242870    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasSufficientPID"
Jul 08 18:39:32.242893 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.242892    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.250862 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.250849    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.250909 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.250868    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-111.ec2.internal\": node \"ip-10-0-129-111.ec2.internal\" not found"
Jul 08 18:39:32.264814 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.264774    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-111.ec2.internal\" not found"
Jul 08 18:39:32.318839 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.318820    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-111.ec2.internal"]
Jul 08 18:39:32.318908 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.318867    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 18:39:32.320700 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.320686    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 18:39:32.320769 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.320710    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 18:39:32.320769 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.320720    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasSufficientPID"
Jul 08 18:39:32.322993 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.322982    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 18:39:32.323105 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.323081    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.323145 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.323109    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 18:39:32.323704 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.323690    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 18:39:32.323785 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.323710    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 18:39:32.323785 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.323719    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasSufficientPID"
Jul 08 18:39:32.323785 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.323770    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 18:39:32.323904 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.323790    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 18:39:32.323904 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.323799    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasSufficientPID"
Jul 08 18:39:32.326090 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.326069    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.326168 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.326097    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 18:39:32.326800 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.326786    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 18:39:32.326904 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.326811    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 18:39:32.326904 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.326822    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeHasSufficientPID"
Jul 08 18:39:32.348386 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.348370    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-111.ec2.internal\" not found" node="ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.353116 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.353097    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-111.ec2.internal\" not found" node="ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.365434 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.365419    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-111.ec2.internal\" not found"
Jul 08 18:39:32.387694 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.387676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d14f66be19f895e054d42120ba98af2d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal\" (UID: \"d14f66be19f895e054d42120ba98af2d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.387758 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.387699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d14f66be19f895e054d42120ba98af2d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal\" (UID: \"d14f66be19f895e054d42120ba98af2d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.387758 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.387719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3cf8f78dfede9ae7cc414ed8fcb3e4e9-config\") pod \"kube-apiserver-proxy-ip-10-0-129-111.ec2.internal\" (UID: \"3cf8f78dfede9ae7cc414ed8fcb3e4e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.466490 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.466457    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-111.ec2.internal\" not found"
Jul 08 18:39:32.488372 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.488351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d14f66be19f895e054d42120ba98af2d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal\" (UID: \"d14f66be19f895e054d42120ba98af2d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.488445 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.488378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d14f66be19f895e054d42120ba98af2d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal\" (UID: \"d14f66be19f895e054d42120ba98af2d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.488445 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.488395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3cf8f78dfede9ae7cc414ed8fcb3e4e9-config\") pod \"kube-apiserver-proxy-ip-10-0-129-111.ec2.internal\" (UID: \"3cf8f78dfede9ae7cc414ed8fcb3e4e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.488445 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.488432    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3cf8f78dfede9ae7cc414ed8fcb3e4e9-config\") pod \"kube-apiserver-proxy-ip-10-0-129-111.ec2.internal\" (UID: \"3cf8f78dfede9ae7cc414ed8fcb3e4e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.488569 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.488454    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d14f66be19f895e054d42120ba98af2d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal\" (UID: \"d14f66be19f895e054d42120ba98af2d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.488569 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.488471    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d14f66be19f895e054d42120ba98af2d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal\" (UID: \"d14f66be19f895e054d42120ba98af2d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.566929 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.566868    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-111.ec2.internal\" not found"
Jul 08 18:39:32.656109 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.656076    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.657263 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:32.657249    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-111.ec2.internal"
Jul 08 18:39:32.667673 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.667652    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-111.ec2.internal\" not found"
Jul 08 18:39:32.772422 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.772391    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-111.ec2.internal\" not found"
Jul 08 18:39:32.873354 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.873331    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-111.ec2.internal\" not found"
Jul 08 18:39:32.979889 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:32.979865    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-111.ec2.internal\" not found"
Jul 08 18:39:33.029174 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:33.029153    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 18:39:33.029688 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:33.029273    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 18:39:33.051968 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:33.051949    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 18:39:33.080909 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:33.080890    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-111.ec2.internal\" not found"
Jul 08 18:39:33.109781 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:33.109752    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 18:34:32 +0000 UTC" deadline="2028-03-20 17:16:51.486855996 +0000 UTC"
Jul 08 18:39:33.109781 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:33.109776    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14902h37m18.377083103s"
Jul 08 18:39:33.181876 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:33.181852    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-111.ec2.internal\" not found"
Jul 08 18:39:33.245317 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:33.245290    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 18:39:33.262506 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:33.262480    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf8f78dfede9ae7cc414ed8fcb3e4e9.slice/crio-9f953daf5f69caac0ef3298184b38320ad0192a4e5e5fd1cdc036690cc976a28 WatchSource:0}: Error finding container 9f953daf5f69caac0ef3298184b38320ad0192a4e5e5fd1cdc036690cc976a28: Status 404 returned error can't find the container with id 9f953daf5f69caac0ef3298184b38320ad0192a4e5e5fd1cdc036690cc976a28
Jul 08 18:39:33.263101 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:33.263082    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd14f66be19f895e054d42120ba98af2d.slice/crio-2a9b6e1b1e2d1ecd2cc6468f536ac9eaca6b574c1324663b207174f66d205395 WatchSource:0}: Error finding container 2a9b6e1b1e2d1ecd2cc6468f536ac9eaca6b574c1324663b207174f66d205395: Status 404 returned error can't find the container with id 2a9b6e1b1e2d1ecd2cc6468f536ac9eaca6b574c1324663b207174f66d205395
Jul 08 18:39:33.268653 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:33.268619    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 18:39:33.286216 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:33.286201    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal"
Jul 08 18:39:33.299149 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:33.299129    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 18:39:33.299994 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:33.299981    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-111.ec2.internal"
Jul 08 18:39:33.310045 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:33.310028    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 18:39:33.571945 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:33.571895    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 18:39:34.065425 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.065397    2563 apiserver.go:52] "Watching apiserver"
Jul 08 18:39:34.076047 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.075945    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 18:39:34.076655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.076615    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-r4p8h","openshift-network-diagnostics/network-check-target-fk596","openshift-network-operator/iptables-alerter-btcqh","openshift-ovn-kubernetes/ovnkube-node-fsjbh","kube-system/global-pull-secret-syncer-rqbw5","kube-system/konnectivity-agent-ktl4c","kube-system/kube-apiserver-proxy-ip-10-0-129-111.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8","openshift-cluster-node-tuning-operator/tuned-sfvwg","openshift-image-registry/node-ca-62l88","openshift-multus/multus-4qch9","openshift-multus/multus-additional-cni-plugins-nhg22","openshift-dns/node-resolver-pxmt9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal"]
Jul 08 18:39:34.079387 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.079363    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-62l88"
Jul 08 18:39:34.082868 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.082707    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pxmt9"
Jul 08 18:39:34.083054 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.083034    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b7m75\""
Jul 08 18:39:34.083291 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.083272    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 18:39:34.083369 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.083347    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 18:39:34.083488 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.083473    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 18:39:34.086085 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.086064    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 18:39:34.086462 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.086443    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 18:39:34.086662 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.086645    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rvg4v\""
Jul 08 18:39:34.087316 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.087299    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-btcqh"
Jul 08 18:39:34.088821 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.088533    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.088821 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.088602    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 18:39:34.090619 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.089568    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:34.090619 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.089674    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:39:34.090619 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.089951    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kd6mz\""
Jul 08 18:39:34.090619 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.089999    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 18:39:34.090619 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.090312    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 18:39:34.090619 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.090486    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 18:39:34.091447 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.091427    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vgr5m\""
Jul 08 18:39:34.091797 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.091779    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 18:39:34.091986 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.091970    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 18:39:34.092177 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.092154    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ktl4c"
Jul 08 18:39:34.092785 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.092766    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 18:39:34.092883 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.092789    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 18:39:34.092883 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.092851    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 18:39:34.093063 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.093044    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 18:39:34.095317 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.094955    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.096754    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.097122    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.097523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/69e11bcd-c40d-467f-8c92-464f63a8d067-dbus\") pod \"global-pull-secret-syncer-rqbw5\" (UID: \"69e11bcd-c40d-467f-8c92-464f63a8d067\") " pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.097568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3c721aa6-174c-479f-a347-2b96c9378ab5-env-overrides\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.097601    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/69e11bcd-c40d-467f-8c92-464f63a8d067-kubelet-config\") pod \"global-pull-secret-syncer-rqbw5\" (UID: \"69e11bcd-c40d-467f-8c92-464f63a8d067\") " pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.097635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh8f6\" (UniqueName: \"kubernetes.io/projected/d149a818-b8bc-4e1c-bba0-9de3c65ff3b4-kube-api-access-jh8f6\") pod \"node-ca-62l88\" (UID: \"d149a818-b8bc-4e1c-bba0-9de3c65ff3b4\") " pod="openshift-image-registry/node-ca-62l88"
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.097670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp2qq\" (UniqueName: \"kubernetes.io/projected/83d999e8-1854-476e-859e-2a438b8191be-kube-api-access-tp2qq\") pod \"iptables-alerter-btcqh\" (UID: \"83d999e8-1854-476e-859e-2a438b8191be\") " pod="openshift-network-operator/iptables-alerter-btcqh"
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.097848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-var-lib-openvswitch\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.097884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpzfb\" (UniqueName: \"kubernetes.io/projected/3c721aa6-174c-479f-a347-2b96c9378ab5-kube-api-access-wpzfb\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.097932    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c721aa6-174c-479f-a347-2b96c9378ab5-ovn-node-metrics-cert\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.097994    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmlqx\" (UniqueName: \"kubernetes.io/projected/ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682-kube-api-access-pmlqx\") pod \"node-resolver-pxmt9\" (UID: \"ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682\") " pod="openshift-dns/node-resolver-pxmt9"
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-slash\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098060    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-run-ovn\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098096    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7f9jt\""
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-run-ovn-kubernetes\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d149a818-b8bc-4e1c-bba0-9de3c65ff3b4-host\") pod \"node-ca-62l88\" (UID: \"d149a818-b8bc-4e1c-bba0-9de3c65ff3b4\") " pod="openshift-image-registry/node-ca-62l88"
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-run-netns\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098306    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-run-systemd\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.099119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098330    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-cni-bin\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-cni-netd\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098425    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret\") pod \"global-pull-secret-syncer-rqbw5\" (UID: \"69e11bcd-c40d-467f-8c92-464f63a8d067\") " pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098461    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682-hosts-file\") pod \"node-resolver-pxmt9\" (UID: \"ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682\") " pod="openshift-dns/node-resolver-pxmt9"
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098496    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83d999e8-1854-476e-859e-2a438b8191be-iptables-alerter-script\") pod \"iptables-alerter-btcqh\" (UID: \"83d999e8-1854-476e-859e-2a438b8191be\") " pod="openshift-network-operator/iptables-alerter-btcqh"
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83d999e8-1854-476e-859e-2a438b8191be-host-slash\") pod \"iptables-alerter-btcqh\" (UID: \"83d999e8-1854-476e-859e-2a438b8191be\") " pod="openshift-network-operator/iptables-alerter-btcqh"
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-node-log\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098598    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3c721aa6-174c-479f-a347-2b96c9378ab5-ovnkube-script-lib\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-kubelet\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-systemd-units\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098823    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d149a818-b8bc-4e1c-bba0-9de3c65ff3b4-serviceca\") pod \"node-ca-62l88\" (UID: \"d149a818-b8bc-4e1c-bba0-9de3c65ff3b4\") " pod="openshift-image-registry/node-ca-62l88"
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098852    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682-tmp-dir\") pod \"node-resolver-pxmt9\" (UID: \"ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682\") " pod="openshift-dns/node-resolver-pxmt9"
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-etc-openvswitch\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-run-openvswitch\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-log-socket\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.100148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.098988    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 18:39:34.101030 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.099006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3c721aa6-174c-479f-a347-2b96c9378ab5-ovnkube-config\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.101030 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.099975    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.102450 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.101439    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hxv7t\""
Jul 08 18:39:34.102591 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.102561    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:34.102926 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.102815    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:39:34.104979 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.104659    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mp6qk\""
Jul 08 18:39:34.104979 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.104821    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 18:39:34.105155 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.105024    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 18:39:34.105155 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.105089    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:34.105155 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.105147    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:39:34.105320 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.105222    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 18:39:34.107129 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.107106    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 18:39:34.107380 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.107366    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.109965 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.109944    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.112892 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.111984    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qp58f\""
Jul 08 18:39:34.112892 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.112320    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 18:39:34.112892 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.112564    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 18:39:34.112892 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.112670    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 18:39:34.113143 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.112960    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 18:39:34.114802 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.114278    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dhdwn\""
Jul 08 18:39:34.114802 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.114489    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 18:39:34.115115 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.114933    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 18:39:34.122765 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.121621    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 18:39:34.133647 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.133618    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pv4vp"
Jul 08 18:39:34.142364 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.142345    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pv4vp"
Jul 08 18:39:34.188469 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.188447    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 18:39:34.199256 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-node-log\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.199358 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199277    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3c721aa6-174c-479f-a347-2b96c9378ab5-ovnkube-script-lib\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.199358 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199308    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-kubernetes\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.199358 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199333    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-device-dir\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.199526 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199385    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-node-log\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.199526 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199401    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-kubelet\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.199526 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.199526 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fc40634d-9589-4123-b582-ac94ba9b3cb6-agent-certs\") pod \"konnectivity-agent-ktl4c\" (UID: \"fc40634d-9589-4123-b582-ac94ba9b3cb6\") " pod="kube-system/konnectivity-agent-ktl4c"
Jul 08 18:39:34.199526 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199484    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-kubelet\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.199526 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-systemd\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.199894 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199531    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.199894 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eddf9339-cff1-490c-94bd-45eca0498564-cni-binary-copy\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.199894 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d149a818-b8bc-4e1c-bba0-9de3c65ff3b4-serviceca\") pod \"node-ca-62l88\" (UID: \"d149a818-b8bc-4e1c-bba0-9de3c65ff3b4\") " pod="openshift-image-registry/node-ca-62l88"
Jul 08 18:39:34.199894 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682-tmp-dir\") pod \"node-resolver-pxmt9\" (UID: \"ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682\") " pod="openshift-dns/node-resolver-pxmt9"
Jul 08 18:39:34.199894 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-run-openvswitch\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.199894 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199689    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-run-openvswitch\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.199894 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-tuned\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.199894 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.199894 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199778    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eddf9339-cff1-490c-94bd-45eca0498564-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.199894 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199805    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/69e11bcd-c40d-467f-8c92-464f63a8d067-kubelet-config\") pod \"global-pull-secret-syncer-rqbw5\" (UID: \"69e11bcd-c40d-467f-8c92-464f63a8d067\") " pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:34.199894 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-multus-daemon-config\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.199894 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm8qp\" (UniqueName: \"kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp\") pod \"network-check-target-fk596\" (UID: \"00e24eff-47d6-4995-9631-af4c943ace31\") " pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:34.199894 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh8f6\" (UniqueName: \"kubernetes.io/projected/d149a818-b8bc-4e1c-bba0-9de3c65ff3b4-kube-api-access-jh8f6\") pod \"node-ca-62l88\" (UID: \"d149a818-b8bc-4e1c-bba0-9de3c65ff3b4\") " pod="openshift-image-registry/node-ca-62l88"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-var-lib-openvswitch\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-var-lib-kubelet\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-hostroot\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199958    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682-tmp-dir\") pod \"node-resolver-pxmt9\" (UID: \"ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682\") " pod="openshift-dns/node-resolver-pxmt9"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.199983    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eddf9339-cff1-490c-94bd-45eca0498564-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f8zq\" (UniqueName: \"kubernetes.io/projected/0c0385fb-7ccc-4145-8e6f-7d355d25c018-kube-api-access-8f8zq\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200038    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-cni-binary-copy\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200065    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m28cx\" (UniqueName: \"kubernetes.io/projected/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-kube-api-access-m28cx\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200066    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/69e11bcd-c40d-467f-8c92-464f63a8d067-kubelet-config\") pod \"global-pull-secret-syncer-rqbw5\" (UID: \"69e11bcd-c40d-467f-8c92-464f63a8d067\") " pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200072    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3c721aa6-174c-479f-a347-2b96c9378ab5-ovnkube-script-lib\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eddf9339-cff1-490c-94bd-45eca0498564-system-cni-dir\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmlqx\" (UniqueName: \"kubernetes.io/projected/ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682-kube-api-access-pmlqx\") pod \"node-resolver-pxmt9\" (UID: \"ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682\") " pod="openshift-dns/node-resolver-pxmt9"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-slash\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200200    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-run-ovn-kubernetes\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c0385fb-7ccc-4145-8e6f-7d355d25c018-tmp\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200271    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-run-k8s-cni-cncf-io\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.200534 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eddf9339-cff1-490c-94bd-45eca0498564-os-release\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-run-netns\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200369    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-slash\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-run-systemd\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200408    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-run-ovn-kubernetes\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-cni-bin\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-cni-netd\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200502    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret\") pod \"global-pull-secret-syncer-rqbw5\" (UID: \"69e11bcd-c40d-467f-8c92-464f63a8d067\") " pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200556    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-sysctl-d\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682-hosts-file\") pod \"node-resolver-pxmt9\" (UID: \"ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682\") " pod="openshift-dns/node-resolver-pxmt9"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83d999e8-1854-476e-859e-2a438b8191be-host-slash\") pod \"iptables-alerter-btcqh\" (UID: \"83d999e8-1854-476e-859e-2a438b8191be\") " pod="openshift-network-operator/iptables-alerter-btcqh"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-sysctl-conf\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-lib-modules\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-run-netns\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200883    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-cni-bin\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200895    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-var-lib-openvswitch\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200929    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-cni-netd\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.201431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200951    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-run-systemd\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200959    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-host-run-netns\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200978    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682-hosts-file\") pod \"node-resolver-pxmt9\" (UID: \"ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682\") " pod="openshift-dns/node-resolver-pxmt9"
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkb2j\" (UniqueName: \"kubernetes.io/projected/9c7d8581-d84c-499f-9f15-b82db785c117-kube-api-access-bkb2j\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.200899    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83d999e8-1854-476e-859e-2a438b8191be-host-slash\") pod \"iptables-alerter-btcqh\" (UID: \"83d999e8-1854-476e-859e-2a438b8191be\") " pod="openshift-network-operator/iptables-alerter-btcqh"
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.201009    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201015    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d149a818-b8bc-4e1c-bba0-9de3c65ff3b4-serviceca\") pod \"node-ca-62l88\" (UID: \"d149a818-b8bc-4e1c-bba0-9de3c65ff3b4\") " pod="openshift-image-registry/node-ca-62l88"
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eddf9339-cff1-490c-94bd-45eca0498564-cnibin\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.201117    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret podName:69e11bcd-c40d-467f-8c92-464f63a8d067 nodeName:}" failed. No retries permitted until 2026-07-08 18:39:34.70107762 +0000 UTC m=+2.943568765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret") pod "global-pull-secret-syncer-rqbw5" (UID: "69e11bcd-c40d-467f-8c92-464f63a8d067") : object "kube-system"/"original-pull-secret" not registered
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-systemd-units\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201180    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-multus-socket-dir-parent\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-var-lib-cni-multus\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201225    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-systemd-units\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201264    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-etc-kubernetes\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f96qx\" (UniqueName: \"kubernetes.io/projected/eddf9339-cff1-490c-94bd-45eca0498564-kube-api-access-f96qx\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-etc-openvswitch\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-log-socket\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.202300 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3c721aa6-174c-479f-a347-2b96c9378ab5-ovnkube-config\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201423    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/69e11bcd-c40d-467f-8c92-464f63a8d067-dbus\") pod \"global-pull-secret-syncer-rqbw5\" (UID: \"69e11bcd-c40d-467f-8c92-464f63a8d067\") " pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201441    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-etc-openvswitch\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201450    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-modprobe-d\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201496    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-sys\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201540    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-log-socket\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201571    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvhss\" (UniqueName: \"kubernetes.io/projected/d580cb38-0201-47b0-9d32-6a24141ad0ce-kube-api-access-pvhss\") pod \"network-metrics-daemon-r4p8h\" (UID: \"d580cb38-0201-47b0-9d32-6a24141ad0ce\") " pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-socket-dir\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201631    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3c721aa6-174c-479f-a347-2b96c9378ab5-env-overrides\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fc40634d-9589-4123-b582-ac94ba9b3cb6-konnectivity-ca\") pod \"konnectivity-agent-ktl4c\" (UID: \"fc40634d-9589-4123-b582-ac94ba9b3cb6\") " pod="kube-system/konnectivity-agent-ktl4c"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-sysconfig\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201697    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/69e11bcd-c40d-467f-8c92-464f63a8d067-dbus\") pod \"global-pull-secret-syncer-rqbw5\" (UID: \"69e11bcd-c40d-467f-8c92-464f63a8d067\") " pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs\") pod \"network-metrics-daemon-r4p8h\" (UID: \"d580cb38-0201-47b0-9d32-6a24141ad0ce\") " pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-os-release\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eddf9339-cff1-490c-94bd-45eca0498564-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201917    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp2qq\" (UniqueName: \"kubernetes.io/projected/83d999e8-1854-476e-859e-2a438b8191be-kube-api-access-tp2qq\") pod \"iptables-alerter-btcqh\" (UID: \"83d999e8-1854-476e-859e-2a438b8191be\") " pod="openshift-network-operator/iptables-alerter-btcqh"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201946    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpzfb\" (UniqueName: \"kubernetes.io/projected/3c721aa6-174c-479f-a347-2b96c9378ab5-kube-api-access-wpzfb\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.203385 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201970    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-system-cni-dir\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.201995    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-multus-conf-dir\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-sys-fs\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c721aa6-174c-479f-a347-2b96c9378ab5-ovn-node-metrics-cert\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-host\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-multus-cni-dir\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-cnibin\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202149    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-registration-dir\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-etc-selinux\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202199    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-run-ovn\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202217    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3c721aa6-174c-479f-a347-2b96c9378ab5-env-overrides\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202212    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3c721aa6-174c-479f-a347-2b96c9378ab5-ovnkube-config\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202284    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3c721aa6-174c-479f-a347-2b96c9378ab5-run-ovn\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202554    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-run\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-var-lib-kubelet\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202875    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d149a818-b8bc-4e1c-bba0-9de3c65ff3b4-host\") pod \"node-ca-62l88\" (UID: \"d149a818-b8bc-4e1c-bba0-9de3c65ff3b4\") " pod="openshift-image-registry/node-ca-62l88"
Jul 08 18:39:34.204273 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202900    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-var-lib-cni-bin\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.205202 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-run-multus-certs\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.205202 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.202951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83d999e8-1854-476e-859e-2a438b8191be-iptables-alerter-script\") pod \"iptables-alerter-btcqh\" (UID: \"83d999e8-1854-476e-859e-2a438b8191be\") " pod="openshift-network-operator/iptables-alerter-btcqh"
Jul 08 18:39:34.205202 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.203121    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d149a818-b8bc-4e1c-bba0-9de3c65ff3b4-host\") pod \"node-ca-62l88\" (UID: \"d149a818-b8bc-4e1c-bba0-9de3c65ff3b4\") " pod="openshift-image-registry/node-ca-62l88"
Jul 08 18:39:34.205202 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.203540    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83d999e8-1854-476e-859e-2a438b8191be-iptables-alerter-script\") pod \"iptables-alerter-btcqh\" (UID: \"83d999e8-1854-476e-859e-2a438b8191be\") " pod="openshift-network-operator/iptables-alerter-btcqh"
Jul 08 18:39:34.206332 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.206269    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c721aa6-174c-479f-a347-2b96c9378ab5-ovn-node-metrics-cert\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.227449 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.227398    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal" event={"ID":"d14f66be19f895e054d42120ba98af2d","Type":"ContainerStarted","Data":"2a9b6e1b1e2d1ecd2cc6468f536ac9eaca6b574c1324663b207174f66d205395"}
Jul 08 18:39:34.228794 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.228756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-111.ec2.internal" event={"ID":"3cf8f78dfede9ae7cc414ed8fcb3e4e9","Type":"ContainerStarted","Data":"9f953daf5f69caac0ef3298184b38320ad0192a4e5e5fd1cdc036690cc976a28"}
Jul 08 18:39:34.232182 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.232158    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmlqx\" (UniqueName: \"kubernetes.io/projected/ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682-kube-api-access-pmlqx\") pod \"node-resolver-pxmt9\" (UID: \"ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682\") " pod="openshift-dns/node-resolver-pxmt9"
Jul 08 18:39:34.234677 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.234652    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp2qq\" (UniqueName: \"kubernetes.io/projected/83d999e8-1854-476e-859e-2a438b8191be-kube-api-access-tp2qq\") pod \"iptables-alerter-btcqh\" (UID: \"83d999e8-1854-476e-859e-2a438b8191be\") " pod="openshift-network-operator/iptables-alerter-btcqh"
Jul 08 18:39:34.235116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.235092    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh8f6\" (UniqueName: \"kubernetes.io/projected/d149a818-b8bc-4e1c-bba0-9de3c65ff3b4-kube-api-access-jh8f6\") pod \"node-ca-62l88\" (UID: \"d149a818-b8bc-4e1c-bba0-9de3c65ff3b4\") " pod="openshift-image-registry/node-ca-62l88"
Jul 08 18:39:34.237240 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.237216    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpzfb\" (UniqueName: \"kubernetes.io/projected/3c721aa6-174c-479f-a347-2b96c9378ab5-kube-api-access-wpzfb\") pod \"ovnkube-node-fsjbh\" (UID: \"3c721aa6-174c-479f-a347-2b96c9378ab5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.304002 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.303973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-etc-selinux\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.304002 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-run\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.304198 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304024    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-var-lib-kubelet\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.304198 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304046    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-var-lib-cni-bin\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.304198 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-run-multus-certs\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.304198 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304097    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-kubernetes\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.304198 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304129    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-run\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.304198 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304142    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-var-lib-kubelet\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.304198 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-device-dir\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.304198 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304152    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-run-multus-certs\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.304198 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304198    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fc40634d-9589-4123-b582-ac94ba9b3cb6-agent-certs\") pod \"konnectivity-agent-ktl4c\" (UID: \"fc40634d-9589-4123-b582-ac94ba9b3cb6\") " pod="kube-system/konnectivity-agent-ktl4c"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304204    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-var-lib-cni-bin\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304208    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-kubernetes\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304212    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-device-dir\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-systemd\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304226    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-etc-selinux\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eddf9339-cff1-490c-94bd-45eca0498564-cni-binary-copy\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-tuned\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304291    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304301    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-systemd\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304310    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eddf9339-cff1-490c-94bd-45eca0498564-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-multus-daemon-config\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm8qp\" (UniqueName: \"kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp\") pod \"network-check-target-fk596\" (UID: \"00e24eff-47d6-4995-9631-af4c943ace31\") " pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-var-lib-kubelet\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304436    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-hostroot\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eddf9339-cff1-490c-94bd-45eca0498564-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304490    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f8zq\" (UniqueName: \"kubernetes.io/projected/0c0385fb-7ccc-4145-8e6f-7d355d25c018-kube-api-access-8f8zq\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.304655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304515    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-cni-binary-copy\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304563    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m28cx\" (UniqueName: \"kubernetes.io/projected/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-kube-api-access-m28cx\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304588    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eddf9339-cff1-490c-94bd-45eca0498564-system-cni-dir\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c0385fb-7ccc-4145-8e6f-7d355d25c018-tmp\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304641    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-run-k8s-cni-cncf-io\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eddf9339-cff1-490c-94bd-45eca0498564-os-release\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304703    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-sysctl-d\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-sysctl-conf\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304778    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-lib-modules\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304801    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-run-netns\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkb2j\" (UniqueName: \"kubernetes.io/projected/9c7d8581-d84c-499f-9f15-b82db785c117-kube-api-access-bkb2j\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eddf9339-cff1-490c-94bd-45eca0498564-cnibin\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304880    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-multus-socket-dir-parent\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304891    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eddf9339-cff1-490c-94bd-45eca0498564-cni-binary-copy\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304905    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-var-lib-cni-multus\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304929    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eddf9339-cff1-490c-94bd-45eca0498564-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.305481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304944    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-etc-kubernetes\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304954    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-var-lib-cni-multus\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.304972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f96qx\" (UniqueName: \"kubernetes.io/projected/eddf9339-cff1-490c-94bd-45eca0498564-kube-api-access-f96qx\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305012    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-multus-socket-dir-parent\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305053    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-sysctl-conf\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305099    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eddf9339-cff1-490c-94bd-45eca0498564-system-cni-dir\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305154    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-etc-kubernetes\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305218    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-var-lib-kubelet\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305278    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-run-netns\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305272    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-lib-modules\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305307    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eddf9339-cff1-490c-94bd-45eca0498564-cnibin\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305339    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-host-run-k8s-cni-cncf-io\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-modprobe-d\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-sys\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305398    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-hostroot\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvhss\" (UniqueName: \"kubernetes.io/projected/d580cb38-0201-47b0-9d32-6a24141ad0ce-kube-api-access-pvhss\") pod \"network-metrics-daemon-r4p8h\" (UID: \"d580cb38-0201-47b0-9d32-6a24141ad0ce\") " pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305447    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-sysctl-d\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305445    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-socket-dir\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.306346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fc40634d-9589-4123-b582-ac94ba9b3cb6-konnectivity-ca\") pod \"konnectivity-agent-ktl4c\" (UID: \"fc40634d-9589-4123-b582-ac94ba9b3cb6\") " pod="kube-system/konnectivity-agent-ktl4c"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-sysconfig\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305546    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs\") pod \"network-metrics-daemon-r4p8h\" (UID: \"d580cb38-0201-47b0-9d32-6a24141ad0ce\") " pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305553    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-socket-dir\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-os-release\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305599    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eddf9339-cff1-490c-94bd-45eca0498564-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-system-cni-dir\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-multus-conf-dir\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305657    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eddf9339-cff1-490c-94bd-45eca0498564-os-release\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305678    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-sys-fs\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-host\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305748    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-multus-cni-dir\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305769    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-modprobe-d\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305772    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-cnibin\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-registration-dir\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305816    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-cnibin\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305833    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-multus-daemon-config\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305860    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-sys\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.307128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305889    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-registration-dir\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.307869 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.305907    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:39:34.307869 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305928    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-multus-conf-dir\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.307869 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.305972    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs podName:d580cb38-0201-47b0-9d32-6a24141ad0ce nodeName:}" failed. No retries permitted until 2026-07-08 18:39:34.805953883 +0000 UTC m=+3.048444989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs") pod "network-metrics-daemon-r4p8h" (UID: "d580cb38-0201-47b0-9d32-6a24141ad0ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:39:34.307869 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.305982    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-sysconfig\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.307869 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.306015    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eddf9339-cff1-490c-94bd-45eca0498564-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.307869 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.306058    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c0385fb-7ccc-4145-8e6f-7d355d25c018-host\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.307869 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.306071    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-system-cni-dir\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.307869 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.306077    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eddf9339-cff1-490c-94bd-45eca0498564-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.307869 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.306110    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c7d8581-d84c-499f-9f15-b82db785c117-sys-fs\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.307869 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.306169    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-multus-cni-dir\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.307869 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.306196    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-os-release\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.307869 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.306339    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-cni-binary-copy\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.307869 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.306480    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fc40634d-9589-4123-b582-ac94ba9b3cb6-konnectivity-ca\") pod \"konnectivity-agent-ktl4c\" (UID: \"fc40634d-9589-4123-b582-ac94ba9b3cb6\") " pod="kube-system/konnectivity-agent-ktl4c"
Jul 08 18:39:34.307869 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.307799    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c0385fb-7ccc-4145-8e6f-7d355d25c018-tmp\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.307869 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.307851    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fc40634d-9589-4123-b582-ac94ba9b3cb6-agent-certs\") pod \"konnectivity-agent-ktl4c\" (UID: \"fc40634d-9589-4123-b582-ac94ba9b3cb6\") " pod="kube-system/konnectivity-agent-ktl4c"
Jul 08 18:39:34.308498 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.308346    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c0385fb-7ccc-4145-8e6f-7d355d25c018-etc-tuned\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.317818 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.317743    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 18:39:34.317818 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.317764    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 18:39:34.317818 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.317780    2563 projected.go:196] Error preparing data for projected volume kube-api-access-sm8qp for pod openshift-network-diagnostics/network-check-target-fk596: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:39:34.318029 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.317836    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp podName:00e24eff-47d6-4995-9631-af4c943ace31 nodeName:}" failed. No retries permitted until 2026-07-08 18:39:34.81781769 +0000 UTC m=+3.060308797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sm8qp" (UniqueName: "kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp") pod "network-check-target-fk596" (UID: "00e24eff-47d6-4995-9631-af4c943ace31") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:39:34.318580 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.318528    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkb2j\" (UniqueName: \"kubernetes.io/projected/9c7d8581-d84c-499f-9f15-b82db785c117-kube-api-access-bkb2j\") pod \"aws-ebs-csi-driver-node-jh7d8\" (UID: \"9c7d8581-d84c-499f-9f15-b82db785c117\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.319678 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.319653    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvhss\" (UniqueName: \"kubernetes.io/projected/d580cb38-0201-47b0-9d32-6a24141ad0ce-kube-api-access-pvhss\") pod \"network-metrics-daemon-r4p8h\" (UID: \"d580cb38-0201-47b0-9d32-6a24141ad0ce\") " pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:34.320040 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.320020    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m28cx\" (UniqueName: \"kubernetes.io/projected/7319177e-ad79-4ffc-a4ab-3c04ba7106d4-kube-api-access-m28cx\") pod \"multus-4qch9\" (UID: \"7319177e-ad79-4ffc-a4ab-3c04ba7106d4\") " pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.320165 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.320134    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f8zq\" (UniqueName: \"kubernetes.io/projected/0c0385fb-7ccc-4145-8e6f-7d355d25c018-kube-api-access-8f8zq\") pod \"tuned-sfvwg\" (UID: \"0c0385fb-7ccc-4145-8e6f-7d355d25c018\") " pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.320508 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.320489    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f96qx\" (UniqueName: \"kubernetes.io/projected/eddf9339-cff1-490c-94bd-45eca0498564-kube-api-access-f96qx\") pod \"multus-additional-cni-plugins-nhg22\" (UID: \"eddf9339-cff1-490c-94bd-45eca0498564\") " pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.406486 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.406456    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-62l88"
Jul 08 18:39:34.417516 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.417493    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pxmt9"
Jul 08 18:39:34.421149 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:34.421119    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd149a818_b8bc_4e1c_bba0_9de3c65ff3b4.slice/crio-825222b6d8698b9cea5129fb394bc370bf6a4096080eca63244a78eb3fd4550b WatchSource:0}: Error finding container 825222b6d8698b9cea5129fb394bc370bf6a4096080eca63244a78eb3fd4550b: Status 404 returned error can't find the container with id 825222b6d8698b9cea5129fb394bc370bf6a4096080eca63244a78eb3fd4550b
Jul 08 18:39:34.427919 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:34.427893    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9db15f_8b7d_4a0f_b5bf_5a50be4bf682.slice/crio-78a750c531d2b508ffe97e68c21f61cadd74039bcdfe4be706b8e7a24652232c WatchSource:0}: Error finding container 78a750c531d2b508ffe97e68c21f61cadd74039bcdfe4be706b8e7a24652232c: Status 404 returned error can't find the container with id 78a750c531d2b508ffe97e68c21f61cadd74039bcdfe4be706b8e7a24652232c
Jul 08 18:39:34.428843 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.428823    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-btcqh"
Jul 08 18:39:34.434998 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.434975    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:39:34.440116 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:34.440070    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d999e8_1854_476e_859e_2a438b8191be.slice/crio-28c8b88afb24c267b2aeb5f19e0533d7e79b645a5925a4a892f870a7192105cf WatchSource:0}: Error finding container 28c8b88afb24c267b2aeb5f19e0533d7e79b645a5925a4a892f870a7192105cf: Status 404 returned error can't find the container with id 28c8b88afb24c267b2aeb5f19e0533d7e79b645a5925a4a892f870a7192105cf
Jul 08 18:39:34.445948 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.445923    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ktl4c"
Jul 08 18:39:34.446794 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:34.446768    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c721aa6_174c_479f_a347_2b96c9378ab5.slice/crio-1f85fc14c620fed079acced0730f973e83e4e9f49a372e3ea8e7b25da6610596 WatchSource:0}: Error finding container 1f85fc14c620fed079acced0730f973e83e4e9f49a372e3ea8e7b25da6610596: Status 404 returned error can't find the container with id 1f85fc14c620fed079acced0730f973e83e4e9f49a372e3ea8e7b25da6610596
Jul 08 18:39:34.453354 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.453330    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sfvwg"
Jul 08 18:39:34.459233 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:34.459211    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc40634d_9589_4123_b582_ac94ba9b3cb6.slice/crio-a4558037c5bcb55bc1d81de568512ba530a9f6b2f43d5e5e0bf7360c8fbefbae WatchSource:0}: Error finding container a4558037c5bcb55bc1d81de568512ba530a9f6b2f43d5e5e0bf7360c8fbefbae: Status 404 returned error can't find the container with id a4558037c5bcb55bc1d81de568512ba530a9f6b2f43d5e5e0bf7360c8fbefbae
Jul 08 18:39:34.462279 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.462254    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8"
Jul 08 18:39:34.470323 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.470305    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4qch9"
Jul 08 18:39:34.477049 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.477024    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nhg22"
Jul 08 18:39:34.708994 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.708955    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret\") pod \"global-pull-secret-syncer-rqbw5\" (UID: \"69e11bcd-c40d-467f-8c92-464f63a8d067\") " pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:34.709197 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.709132    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 18:39:34.709265 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.709205    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret podName:69e11bcd-c40d-467f-8c92-464f63a8d067 nodeName:}" failed. No retries permitted until 2026-07-08 18:39:35.709184053 +0000 UTC m=+3.951675157 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret") pod "global-pull-secret-syncer-rqbw5" (UID: "69e11bcd-c40d-467f-8c92-464f63a8d067") : object "kube-system"/"original-pull-secret" not registered
Jul 08 18:39:34.809587 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.809558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs\") pod \"network-metrics-daemon-r4p8h\" (UID: \"d580cb38-0201-47b0-9d32-6a24141ad0ce\") " pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:34.809776 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.809754    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:39:34.809871 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.809857    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs podName:d580cb38-0201-47b0-9d32-6a24141ad0ce nodeName:}" failed. No retries permitted until 2026-07-08 18:39:35.809833805 +0000 UTC m=+4.052324920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs") pod "network-metrics-daemon-r4p8h" (UID: "d580cb38-0201-47b0-9d32-6a24141ad0ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:39:34.910798 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:34.910758    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm8qp\" (UniqueName: \"kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp\") pod \"network-check-target-fk596\" (UID: \"00e24eff-47d6-4995-9631-af4c943ace31\") " pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:34.910986 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.910951    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 18:39:34.910986 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.910982    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 18:39:34.911204 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.910997    2563 projected.go:196] Error preparing data for projected volume kube-api-access-sm8qp for pod openshift-network-diagnostics/network-check-target-fk596: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:39:34.911204 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:34.911067    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp podName:00e24eff-47d6-4995-9631-af4c943ace31 nodeName:}" failed. No retries permitted until 2026-07-08 18:39:35.911046379 +0000 UTC m=+4.153537481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sm8qp" (UniqueName: "kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp") pod "network-check-target-fk596" (UID: "00e24eff-47d6-4995-9631-af4c943ace31") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:39:35.146107 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:35.146016    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:34:34 +0000 UTC" deadline="2028-04-14 12:28:39.752604484 +0000 UTC"
Jul 08 18:39:35.146107 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:35.146075    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15497h49m4.606534448s"
Jul 08 18:39:35.218850 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:35.218823    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:35.219022 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:35.218944    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:39:35.231485 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:35.231446    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ktl4c" event={"ID":"fc40634d-9589-4123-b582-ac94ba9b3cb6","Type":"ContainerStarted","Data":"a4558037c5bcb55bc1d81de568512ba530a9f6b2f43d5e5e0bf7360c8fbefbae"}
Jul 08 18:39:35.232928 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:35.232901    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh" event={"ID":"3c721aa6-174c-479f-a347-2b96c9378ab5","Type":"ContainerStarted","Data":"1f85fc14c620fed079acced0730f973e83e4e9f49a372e3ea8e7b25da6610596"}
Jul 08 18:39:35.234257 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:35.234231    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-btcqh" event={"ID":"83d999e8-1854-476e-859e-2a438b8191be","Type":"ContainerStarted","Data":"28c8b88afb24c267b2aeb5f19e0533d7e79b645a5925a4a892f870a7192105cf"}
Jul 08 18:39:35.235845 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:35.235826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pxmt9" event={"ID":"ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682","Type":"ContainerStarted","Data":"78a750c531d2b508ffe97e68c21f61cadd74039bcdfe4be706b8e7a24652232c"}
Jul 08 18:39:35.237587 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:35.237561    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-62l88" event={"ID":"d149a818-b8bc-4e1c-bba0-9de3c65ff3b4","Type":"ContainerStarted","Data":"825222b6d8698b9cea5129fb394bc370bf6a4096080eca63244a78eb3fd4550b"}
Jul 08 18:39:35.651289 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:35.651140    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0385fb_7ccc_4145_8e6f_7d355d25c018.slice/crio-d22014c68ccd91e1bee9dfa16e04fcae67fb578e493148074358dceb7bb4aa17 WatchSource:0}: Error finding container d22014c68ccd91e1bee9dfa16e04fcae67fb578e493148074358dceb7bb4aa17: Status 404 returned error can't find the container with id d22014c68ccd91e1bee9dfa16e04fcae67fb578e493148074358dceb7bb4aa17
Jul 08 18:39:35.659758 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:35.659694    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeddf9339_cff1_490c_94bd_45eca0498564.slice/crio-9033e73761f3e40c960e1866c7b7d28b051698a1b6a6bfabecaa140e332d748d WatchSource:0}: Error finding container 9033e73761f3e40c960e1866c7b7d28b051698a1b6a6bfabecaa140e332d748d: Status 404 returned error can't find the container with id 9033e73761f3e40c960e1866c7b7d28b051698a1b6a6bfabecaa140e332d748d
Jul 08 18:39:35.661612 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:35.661579    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c7d8581_d84c_499f_9f15_b82db785c117.slice/crio-b7a52a87e5acee178dd735699b2a991c6ba8deb50d9f33983e27d6f4410c2685 WatchSource:0}: Error finding container b7a52a87e5acee178dd735699b2a991c6ba8deb50d9f33983e27d6f4410c2685: Status 404 returned error can't find the container with id b7a52a87e5acee178dd735699b2a991c6ba8deb50d9f33983e27d6f4410c2685
Jul 08 18:39:35.662798 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:39:35.662776    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7319177e_ad79_4ffc_a4ab_3c04ba7106d4.slice/crio-8e0669793e9e9452362af8a8aa67e27916ea11c0364c3b1df587478387c70290 WatchSource:0}: Error finding container 8e0669793e9e9452362af8a8aa67e27916ea11c0364c3b1df587478387c70290: Status 404 returned error can't find the container with id 8e0669793e9e9452362af8a8aa67e27916ea11c0364c3b1df587478387c70290
Jul 08 18:39:35.717309 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:35.717174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret\") pod \"global-pull-secret-syncer-rqbw5\" (UID: \"69e11bcd-c40d-467f-8c92-464f63a8d067\") " pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:35.717410 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:35.717386    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 18:39:35.717484 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:35.717461    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret podName:69e11bcd-c40d-467f-8c92-464f63a8d067 nodeName:}" failed. No retries permitted until 2026-07-08 18:39:37.717439965 +0000 UTC m=+5.959931069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret") pod "global-pull-secret-syncer-rqbw5" (UID: "69e11bcd-c40d-467f-8c92-464f63a8d067") : object "kube-system"/"original-pull-secret" not registered
Jul 08 18:39:35.819305 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:35.818639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs\") pod \"network-metrics-daemon-r4p8h\" (UID: \"d580cb38-0201-47b0-9d32-6a24141ad0ce\") " pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:35.819305 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:35.818850    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:39:35.819305 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:35.818919    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs podName:d580cb38-0201-47b0-9d32-6a24141ad0ce nodeName:}" failed. No retries permitted until 2026-07-08 18:39:37.818898549 +0000 UTC m=+6.061389654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs") pod "network-metrics-daemon-r4p8h" (UID: "d580cb38-0201-47b0-9d32-6a24141ad0ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:39:35.919216 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:35.919106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm8qp\" (UniqueName: \"kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp\") pod \"network-check-target-fk596\" (UID: \"00e24eff-47d6-4995-9631-af4c943ace31\") " pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:35.919372 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:35.919310    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 18:39:35.919372 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:35.919333    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 18:39:35.919372 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:35.919348    2563 projected.go:196] Error preparing data for projected volume kube-api-access-sm8qp for pod openshift-network-diagnostics/network-check-target-fk596: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:39:35.919531 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:35.919408    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp podName:00e24eff-47d6-4995-9631-af4c943ace31 nodeName:}" failed. No retries permitted until 2026-07-08 18:39:37.919389679 +0000 UTC m=+6.161880798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sm8qp" (UniqueName: "kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp") pod "network-check-target-fk596" (UID: "00e24eff-47d6-4995-9631-af4c943ace31") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:39:36.146266 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:36.146194    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:34:34 +0000 UTC" deadline="2028-01-07 03:31:29.972469175 +0000 UTC"
Jul 08 18:39:36.146266 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:36.146230    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13136h51m53.826242464s"
Jul 08 18:39:36.218659 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:36.218536    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:36.218786 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:36.218691    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:39:36.219194 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:36.218999    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:36.219194 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:36.219142    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:39:36.241325 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:36.241247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4qch9" event={"ID":"7319177e-ad79-4ffc-a4ab-3c04ba7106d4","Type":"ContainerStarted","Data":"8e0669793e9e9452362af8a8aa67e27916ea11c0364c3b1df587478387c70290"}
Jul 08 18:39:36.244387 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:36.244356    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8" event={"ID":"9c7d8581-d84c-499f-9f15-b82db785c117","Type":"ContainerStarted","Data":"b7a52a87e5acee178dd735699b2a991c6ba8deb50d9f33983e27d6f4410c2685"}
Jul 08 18:39:36.247222 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:36.247193    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nhg22" event={"ID":"eddf9339-cff1-490c-94bd-45eca0498564","Type":"ContainerStarted","Data":"9033e73761f3e40c960e1866c7b7d28b051698a1b6a6bfabecaa140e332d748d"}
Jul 08 18:39:36.251724 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:36.251636    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sfvwg" event={"ID":"0c0385fb-7ccc-4145-8e6f-7d355d25c018","Type":"ContainerStarted","Data":"d22014c68ccd91e1bee9dfa16e04fcae67fb578e493148074358dceb7bb4aa17"}
Jul 08 18:39:36.256504 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:36.256477    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal" event={"ID":"d14f66be19f895e054d42120ba98af2d","Type":"ContainerStarted","Data":"02dd0e49ef6dba6832dc7a594aa693c7c02e2c5ba1c565cfcc6400f026e1f0cc"}
Jul 08 18:39:36.261678 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:36.261649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-111.ec2.internal" event={"ID":"3cf8f78dfede9ae7cc414ed8fcb3e4e9","Type":"ContainerStarted","Data":"326621d75c281f4e9cc0488911a26c2965e92cf7ec81a53bb42ec888be6e7a64"}
Jul 08 18:39:36.297298 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:36.297228    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-111.ec2.internal" podStartSLOduration=3.297204706 podStartE2EDuration="3.297204706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:39:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:39:36.296026251 +0000 UTC m=+4.538517375" watchObservedRunningTime="2026-07-08 18:39:36.297204706 +0000 UTC m=+4.539695832"
Jul 08 18:39:37.218825 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:37.218547    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:37.218825 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:37.218698    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:39:37.268731 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:37.267609    2563 generic.go:356] "Generic (PLEG): container finished" podID="d14f66be19f895e054d42120ba98af2d" containerID="02dd0e49ef6dba6832dc7a594aa693c7c02e2c5ba1c565cfcc6400f026e1f0cc" exitCode=0
Jul 08 18:39:37.269212 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:37.268696    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal" event={"ID":"d14f66be19f895e054d42120ba98af2d","Type":"ContainerDied","Data":"02dd0e49ef6dba6832dc7a594aa693c7c02e2c5ba1c565cfcc6400f026e1f0cc"}
Jul 08 18:39:37.736276 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:37.736240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret\") pod \"global-pull-secret-syncer-rqbw5\" (UID: \"69e11bcd-c40d-467f-8c92-464f63a8d067\") " pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:37.736565 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:37.736422    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 18:39:37.736565 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:37.736484    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret podName:69e11bcd-c40d-467f-8c92-464f63a8d067 nodeName:}" failed. No retries permitted until 2026-07-08 18:39:41.73646488 +0000 UTC m=+9.978955988 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret") pod "global-pull-secret-syncer-rqbw5" (UID: "69e11bcd-c40d-467f-8c92-464f63a8d067") : object "kube-system"/"original-pull-secret" not registered
Jul 08 18:39:37.836892 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:37.836832    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs\") pod \"network-metrics-daemon-r4p8h\" (UID: \"d580cb38-0201-47b0-9d32-6a24141ad0ce\") " pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:37.837068 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:37.837054    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:39:37.837130 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:37.837120    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs podName:d580cb38-0201-47b0-9d32-6a24141ad0ce nodeName:}" failed. No retries permitted until 2026-07-08 18:39:41.837099892 +0000 UTC m=+10.079590995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs") pod "network-metrics-daemon-r4p8h" (UID: "d580cb38-0201-47b0-9d32-6a24141ad0ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:39:37.937657 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:37.937600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm8qp\" (UniqueName: \"kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp\") pod \"network-check-target-fk596\" (UID: \"00e24eff-47d6-4995-9631-af4c943ace31\") " pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:37.937855 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:37.937836    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 18:39:37.937994 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:37.937865    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 18:39:37.937994 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:37.937880    2563 projected.go:196] Error preparing data for projected volume kube-api-access-sm8qp for pod openshift-network-diagnostics/network-check-target-fk596: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:39:37.937994 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:37.937939    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp podName:00e24eff-47d6-4995-9631-af4c943ace31 nodeName:}" failed. No retries permitted until 2026-07-08 18:39:41.937919302 +0000 UTC m=+10.180410417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sm8qp" (UniqueName: "kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp") pod "network-check-target-fk596" (UID: "00e24eff-47d6-4995-9631-af4c943ace31") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:39:38.221866 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:38.221628    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:38.221866 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:38.221628    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:38.221866 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:38.221796    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:39:38.222575 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:38.221950    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:39:39.218178 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:39.218139    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:39.218374 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:39.218274    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:39:40.218857 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:40.218501    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:40.218857 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:40.218651    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:39:40.218857 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:40.218689    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:40.218857 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:40.218805    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:39:41.219339 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:41.219297    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:41.219846 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:41.219433    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:39:41.770106 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:41.770068    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret\") pod \"global-pull-secret-syncer-rqbw5\" (UID: \"69e11bcd-c40d-467f-8c92-464f63a8d067\") " pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:41.770293 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:41.770223    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 18:39:41.770357 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:41.770295    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret podName:69e11bcd-c40d-467f-8c92-464f63a8d067 nodeName:}" failed. No retries permitted until 2026-07-08 18:39:49.770276511 +0000 UTC m=+18.012767625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret") pod "global-pull-secret-syncer-rqbw5" (UID: "69e11bcd-c40d-467f-8c92-464f63a8d067") : object "kube-system"/"original-pull-secret" not registered
Jul 08 18:39:41.871002 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:41.870969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs\") pod \"network-metrics-daemon-r4p8h\" (UID: \"d580cb38-0201-47b0-9d32-6a24141ad0ce\") " pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:41.871171 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:41.871104    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:39:41.871171 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:41.871165    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs podName:d580cb38-0201-47b0-9d32-6a24141ad0ce nodeName:}" failed. No retries permitted until 2026-07-08 18:39:49.871147945 +0000 UTC m=+18.113639046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs") pod "network-metrics-daemon-r4p8h" (UID: "d580cb38-0201-47b0-9d32-6a24141ad0ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:39:41.972150 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:41.972052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm8qp\" (UniqueName: \"kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp\") pod \"network-check-target-fk596\" (UID: \"00e24eff-47d6-4995-9631-af4c943ace31\") " pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:41.972315 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:41.972210    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 18:39:41.972315 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:41.972229    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 18:39:41.972315 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:41.972239    2563 projected.go:196] Error preparing data for projected volume kube-api-access-sm8qp for pod openshift-network-diagnostics/network-check-target-fk596: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:39:41.972315 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:41.972287    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp podName:00e24eff-47d6-4995-9631-af4c943ace31 nodeName:}" failed. No retries permitted until 2026-07-08 18:39:49.972271227 +0000 UTC m=+18.214762339 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sm8qp" (UniqueName: "kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp") pod "network-check-target-fk596" (UID: "00e24eff-47d6-4995-9631-af4c943ace31") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:39:42.219904 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:42.219454    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:42.219904 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:42.219542    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:42.219904 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:42.219555    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:39:42.219904 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:42.219674    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:39:43.218803 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:43.218771    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:43.218989 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:43.218903    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:39:44.218676 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:44.218637    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:44.219136 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:44.218650    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:44.219136 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:44.218761    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:39:44.219136 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:44.218848    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:39:45.219009 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:45.218943    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:45.219374 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:45.219074    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:39:45.286298 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:45.284218    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal" event={"ID":"d14f66be19f895e054d42120ba98af2d","Type":"ContainerStarted","Data":"7ecc5a4dfb8637ae4e0b403de3223b0f5c602412f19051f7426f682bd8142e6b"}
Jul 08 18:39:45.310815 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:45.310424    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-111.ec2.internal" podStartSLOduration=12.310403646 podStartE2EDuration="12.310403646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:39:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:39:45.309431396 +0000 UTC m=+13.551922519" watchObservedRunningTime="2026-07-08 18:39:45.310403646 +0000 UTC m=+13.552894768"
Jul 08 18:39:46.219491 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:46.219300    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:46.219961 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:46.219307    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:46.219961 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:46.219583    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:39:46.219961 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:46.219661    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:39:46.287767 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:46.287738    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pxmt9" event={"ID":"ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682","Type":"ContainerStarted","Data":"38b75d2e63b71359c5060968574fdfaff4438a3f7f7909328a23bb738c8765b1"}
Jul 08 18:39:46.292290 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:46.292131    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ktl4c" event={"ID":"fc40634d-9589-4123-b582-ac94ba9b3cb6","Type":"ContainerStarted","Data":"4ae3b0b4e79c5e20cc65b5e47f0526c93e91d927b7e90285a0be9bbaf69c9458"}
Jul 08 18:39:46.293647 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:46.293610    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-62l88" event={"ID":"d149a818-b8bc-4e1c-bba0-9de3c65ff3b4","Type":"ContainerStarted","Data":"bd3a8edb774d0d23564ea583dfc175fa784b1df4296731661cb422058cbeef33"}
Jul 08 18:39:46.295161 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:46.295140    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8" event={"ID":"9c7d8581-d84c-499f-9f15-b82db785c117","Type":"ContainerStarted","Data":"603ae60dea23b1af3ae0b73ff335818773bc58b4fbbf2eda299a55740e6b6535"}
Jul 08 18:39:46.296709 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:46.296686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nhg22" event={"ID":"eddf9339-cff1-490c-94bd-45eca0498564","Type":"ContainerStarted","Data":"2cec0e8c2777d04eea12fb4b83f9ab2f456eb19732e35e59811b22b4c696c076"}
Jul 08 18:39:46.298178 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:46.298154    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sfvwg" event={"ID":"0c0385fb-7ccc-4145-8e6f-7d355d25c018","Type":"ContainerStarted","Data":"3a1c34504c6bdebb0a21c6107ae932c99e4308994450519a610b222da4447163"}
Jul 08 18:39:46.305374 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:46.305339    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pxmt9" podStartSLOduration=8.08858109 podStartE2EDuration="14.305328204s" totalImagesPullingTime="6.216747114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:39:46.304882905 +0000 UTC m=+14.547374026" watchObservedRunningTime="2026-07-08 18:39:46.305328204 +0000 UTC m=+14.547819325"
Jul 08 18:39:46.322487 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:46.322446    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-62l88" podStartSLOduration=3.6411720990000003 podStartE2EDuration="14.322434813s" totalImagesPullingTime="10.681262714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:39:46.322427089 +0000 UTC m=+14.564918209" watchObservedRunningTime="2026-07-08 18:39:46.322434813 +0000 UTC m=+14.564925933"
Jul 08 18:39:46.342090 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:46.342050    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ktl4c" podStartSLOduration=8.156551025 podStartE2EDuration="14.342038936s" totalImagesPullingTime="6.185487911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:39:46.340942745 +0000 UTC m=+14.583433866" watchObservedRunningTime="2026-07-08 18:39:46.342038936 +0000 UTC m=+14.584530057"
Jul 08 18:39:46.369602 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:46.369567    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sfvwg" podStartSLOduration=4.814354209 podStartE2EDuration="14.369558188s" totalImagesPullingTime="9.555203979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:39:46.368620635 +0000 UTC m=+14.611111756" watchObservedRunningTime="2026-07-08 18:39:46.369558188 +0000 UTC m=+14.612049362"
Jul 08 18:39:47.218457 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:47.218418    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:47.218657 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:47.218559    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:39:47.302698 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:47.302498    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-btcqh" event={"ID":"83d999e8-1854-476e-859e-2a438b8191be","Type":"ContainerStarted","Data":"5372149d0268b2194c5d78b5706c6a27e4406335bf7546f902490278c83d440d"}
Jul 08 18:39:47.322915 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:47.322862    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-btcqh" podStartSLOduration=4.659872706 podStartE2EDuration="15.322843667s" totalImagesPullingTime="10.662970961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:39:47.322313145 +0000 UTC m=+15.564804265" watchObservedRunningTime="2026-07-08 18:39:47.322843667 +0000 UTC m=+15.565334789"
Jul 08 18:39:48.218570 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:48.218539    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:48.218734 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:48.218539    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:48.218734 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:48.218690    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:39:48.218734 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:48.218719    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:39:49.019035 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:49.018997    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ktl4c"
Jul 08 18:39:49.019795 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:49.019774    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ktl4c"
Jul 08 18:39:49.218227 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:49.218196    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:49.218434 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:49.218321    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:39:49.306689 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:49.306588    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ktl4c"
Jul 08 18:39:49.307272 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:49.307254    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ktl4c"
Jul 08 18:39:49.831504 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:49.831476    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret\") pod \"global-pull-secret-syncer-rqbw5\" (UID: \"69e11bcd-c40d-467f-8c92-464f63a8d067\") " pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:49.831697 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:49.831592    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 18:39:49.831697 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:49.831655    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret podName:69e11bcd-c40d-467f-8c92-464f63a8d067 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:05.831642545 +0000 UTC m=+34.074133644 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret") pod "global-pull-secret-syncer-rqbw5" (UID: "69e11bcd-c40d-467f-8c92-464f63a8d067") : object "kube-system"/"original-pull-secret" not registered
Jul 08 18:39:49.932366 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:49.932336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs\") pod \"network-metrics-daemon-r4p8h\" (UID: \"d580cb38-0201-47b0-9d32-6a24141ad0ce\") " pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:49.932539 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:49.932483    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:39:49.932589 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:49.932543    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs podName:d580cb38-0201-47b0-9d32-6a24141ad0ce nodeName:}" failed. No retries permitted until 2026-07-08 18:40:05.932527709 +0000 UTC m=+34.175018810 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs") pod "network-metrics-daemon-r4p8h" (UID: "d580cb38-0201-47b0-9d32-6a24141ad0ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:39:50.032926 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:50.032888    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm8qp\" (UniqueName: \"kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp\") pod \"network-check-target-fk596\" (UID: \"00e24eff-47d6-4995-9631-af4c943ace31\") " pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:50.033505 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:50.033097    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 18:39:50.033505 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:50.033125    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 18:39:50.033505 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:50.033138    2563 projected.go:196] Error preparing data for projected volume kube-api-access-sm8qp for pod openshift-network-diagnostics/network-check-target-fk596: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:39:50.033505 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:50.033201    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp podName:00e24eff-47d6-4995-9631-af4c943ace31 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:06.033181265 +0000 UTC m=+34.275672380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sm8qp" (UniqueName: "kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp") pod "network-check-target-fk596" (UID: "00e24eff-47d6-4995-9631-af4c943ace31") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:39:50.219051 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:50.219026    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:50.219244 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:50.219026    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:50.219244 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:50.219131    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:39:50.219244 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:50.219235    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:39:50.310239 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:50.310204    2563 generic.go:356] "Generic (PLEG): container finished" podID="eddf9339-cff1-490c-94bd-45eca0498564" containerID="2cec0e8c2777d04eea12fb4b83f9ab2f456eb19732e35e59811b22b4c696c076" exitCode=0
Jul 08 18:39:50.310401 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:50.310281    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nhg22" event={"ID":"eddf9339-cff1-490c-94bd-45eca0498564","Type":"ContainerDied","Data":"2cec0e8c2777d04eea12fb4b83f9ab2f456eb19732e35e59811b22b4c696c076"}
Jul 08 18:39:51.218764 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:51.218719    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:51.219228 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:51.218830    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:39:52.220066 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:52.219834    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:52.220525 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:52.219914    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:52.220525 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:52.220155    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:39:52.220525 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:52.220255    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:39:52.719660 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:52.719607    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:39:52.876342 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:52.876310    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:39:53.077430 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:53.077362    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:39:53.175721 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:53.175686    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:39:53.218382 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:53.218355    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:53.218511 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:53.218456    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:39:54.218719 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:54.218695    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:54.219061 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:54.218806    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:39:54.219061 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:54.218851    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:54.219061 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:54.218940    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:39:54.319143 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:54.319113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4qch9" event={"ID":"7319177e-ad79-4ffc-a4ab-3c04ba7106d4","Type":"ContainerStarted","Data":"3bfd2539f1effaf9db75344b70b9d1bf9eb555b1056522ad6558eb783e048d4c"}
Jul 08 18:39:54.341484 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:54.341428    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4qch9" podStartSLOduration=3.944946597 podStartE2EDuration="22.341409601s" totalImagesPullingTime="18.396463004s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:39:54.341322762 +0000 UTC m=+22.583813882" watchObservedRunningTime="2026-07-08 18:39:54.341409601 +0000 UTC m=+22.583900723"
Jul 08 18:39:54.457830 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:54.457808    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 18:39:54.471206 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:54.471179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:39:54.575169 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:54.575141    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:39:55.154687 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:55.154450    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T18:39:54.457828522Z","UUID":"f21b79f5-3240-4c0e-b678-2467b958d475","Handler":null,"Name":"","Endpoint":""}
Jul 08 18:39:55.155863 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:55.155842    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 18:39:55.155949 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:55.155876    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 18:39:55.218585 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:55.218559    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:55.218765 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:55.218706    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:39:55.323143 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:55.323097    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8" event={"ID":"9c7d8581-d84c-499f-9f15-b82db785c117","Type":"ContainerStarted","Data":"ae2311091d6bcbba8db259b7bf41e81db8c40ed85ee535453b2da4a4a2665ad9"}
Jul 08 18:39:55.326038 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:55.326016    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 18:39:55.326368 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:55.326348    2563 generic.go:356] "Generic (PLEG): container finished" podID="3c721aa6-174c-479f-a347-2b96c9378ab5" containerID="81189679de17d16abcf9a7d33291d5e653568ea54a571281b576f032383870c7" exitCode=1
Jul 08 18:39:55.326464 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:55.326397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh" event={"ID":"3c721aa6-174c-479f-a347-2b96c9378ab5","Type":"ContainerStarted","Data":"d21c1d0467ce3839ca8c3833d97bb11fad1a1443574c5c32b24794718aa81aad"}
Jul 08 18:39:55.326526 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:55.326463    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh" event={"ID":"3c721aa6-174c-479f-a347-2b96c9378ab5","Type":"ContainerStarted","Data":"32c5b2bc1d7935d744665c436d00b97ea98a3b80daadc9634e870b8cd7a83079"}
Jul 08 18:39:55.326526 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:55.326514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh" event={"ID":"3c721aa6-174c-479f-a347-2b96c9378ab5","Type":"ContainerStarted","Data":"b7141772875169c4ad42e674414990034bcf45160776b7d236a5a577bede3c95"}
Jul 08 18:39:55.326638 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:55.326550    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh" event={"ID":"3c721aa6-174c-479f-a347-2b96c9378ab5","Type":"ContainerStarted","Data":"ef5411dd6b9499756f515cb5037a439485a4dac821bb685879ef939a1d2df2c5"}
Jul 08 18:39:55.326638 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:55.326598    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh" event={"ID":"3c721aa6-174c-479f-a347-2b96c9378ab5","Type":"ContainerDied","Data":"81189679de17d16abcf9a7d33291d5e653568ea54a571281b576f032383870c7"}
Jul 08 18:39:55.326718 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:55.326644    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh" event={"ID":"3c721aa6-174c-479f-a347-2b96c9378ab5","Type":"ContainerStarted","Data":"8326c4f6a70223b4c99150cfe9b33869e8b711388936366b8ff9c1ecb18e0c0b"}
Jul 08 18:39:56.222022 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:56.221949    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:56.222550 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:56.221950    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:56.222550 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:56.222078    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:39:56.222550 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:56.222129    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:39:56.330495 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:56.330460    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8" event={"ID":"9c7d8581-d84c-499f-9f15-b82db785c117","Type":"ContainerStarted","Data":"cc6a6b5ad5a215fccb285cbb458247d2a622e9d6dcadb644318839ae374a1958"}
Jul 08 18:39:56.352672 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:56.352609    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh7d8" podStartSLOduration=4.498016654 podStartE2EDuration="24.352591738s" totalImagesPullingTime="19.854575084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:39:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:39:56.351219053 +0000 UTC m=+24.593710175" watchObservedRunningTime="2026-07-08 18:39:56.352591738 +0000 UTC m=+24.595082860"
Jul 08 18:39:57.219166 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:57.219102    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:57.219289 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:57.219191    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:39:57.335291 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:57.335269    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 18:39:57.335684 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:57.335661    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh" event={"ID":"3c721aa6-174c-479f-a347-2b96c9378ab5","Type":"ContainerStarted","Data":"50b1dacbca6a574bf3c2abef824f4ba06df72b6f5facc3aea8b0e102c4b938f3"}
Jul 08 18:39:57.365949 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:57.365925    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:39:57.427297 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:57.427259    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:39:58.218816 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:58.218757    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:39:58.218995 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:58.218866    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:39:58.218995 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:58.218925    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:39:58.219105 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:58.219048    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:39:59.218616 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:39:59.218586    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:39:59.219130 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:39:59.218720    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:40:00.218352 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:00.218194    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:40:00.218499 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:00.218237    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:40:00.218499 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:00.218459    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:40:00.218590 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:00.218505    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:40:00.343591 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:00.343569    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 18:40:00.344036 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:00.343980    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh" event={"ID":"3c721aa6-174c-479f-a347-2b96c9378ab5","Type":"ContainerStarted","Data":"56b8a136804c37ba0e13de443db3ea799c1dc1b170ea35dc5cd5551b43cfa493"}
Jul 08 18:40:00.344232 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:00.344216    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:40:00.344316 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:00.344284    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:40:00.344364 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:00.344331    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:40:00.344409 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:00.344342    2563 scope.go:117] "RemoveContainer" containerID="81189679de17d16abcf9a7d33291d5e653568ea54a571281b576f032383870c7"
Jul 08 18:40:00.346072 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:00.346052    2563 generic.go:356] "Generic (PLEG): container finished" podID="eddf9339-cff1-490c-94bd-45eca0498564" containerID="3c221746618a5881bfabcffc260ed9ee4c08a14edb53b840291afdec2c6cf5ec" exitCode=0
Jul 08 18:40:00.346168 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:00.346078    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nhg22" event={"ID":"eddf9339-cff1-490c-94bd-45eca0498564","Type":"ContainerDied","Data":"3c221746618a5881bfabcffc260ed9ee4c08a14edb53b840291afdec2c6cf5ec"}
Jul 08 18:40:00.360221 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:00.360203    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:40:00.361242 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:00.361227    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:40:00.361451 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:00.361436    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:01.218753 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:01.218726    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:40:01.218925 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:01.218823    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:40:01.352965 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:01.352943    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 18:40:01.353403 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:01.353374    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh" event={"ID":"3c721aa6-174c-479f-a347-2b96c9378ab5","Type":"ContainerStarted","Data":"1345c5d1778dbbbac3154843937cfd125d316c6242dcc3ad09a18bea4d74c64e"}
Jul 08 18:40:01.356370 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:01.356346    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nhg22" event={"ID":"eddf9339-cff1-490c-94bd-45eca0498564","Type":"ContainerStarted","Data":"4c8f8f73e0d8fa50c1d9baff402a1ed207c30bbfa4c9a22acc0d66a70b2169ca"}
Jul 08 18:40:01.395179 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:01.395113    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh" podStartSLOduration=9.545798439 podStartE2EDuration="29.395099022s" totalImagesPullingTime="19.849300583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:40:01.393975914 +0000 UTC m=+29.636467034" watchObservedRunningTime="2026-07-08 18:40:01.395099022 +0000 UTC m=+29.637590142"
Jul 08 18:40:01.617485 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:01.617460    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rqbw5"]
Jul 08 18:40:01.617637 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:01.617562    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:40:01.617685 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:01.617666    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:40:01.621178 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:01.621156    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fk596"]
Jul 08 18:40:01.621284 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:01.621227    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:40:01.621333 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:01.621303    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:40:01.642729 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:01.642708    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r4p8h"]
Jul 08 18:40:01.642809 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:01.642789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:40:01.642875 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:01.642858    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:40:01.948736 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:01.948668    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:02.359830 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:02.359684    2563 generic.go:356] "Generic (PLEG): container finished" podID="eddf9339-cff1-490c-94bd-45eca0498564" containerID="4c8f8f73e0d8fa50c1d9baff402a1ed207c30bbfa4c9a22acc0d66a70b2169ca" exitCode=0
Jul 08 18:40:02.360166 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:02.359751    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nhg22" event={"ID":"eddf9339-cff1-490c-94bd-45eca0498564","Type":"ContainerDied","Data":"4c8f8f73e0d8fa50c1d9baff402a1ed207c30bbfa4c9a22acc0d66a70b2169ca"}
Jul 08 18:40:02.932326 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:02.932300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:03.032865 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:03.032834    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:03.218408 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:03.218388    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:40:03.218408 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:03.218403    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:40:03.218558 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:03.218515    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:40:03.218615 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:03.218560    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:40:03.218615 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:03.218593    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:40:03.218731 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:03.218673    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:40:04.121936 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:04.121909    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:04.223782 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:04.223755    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:04.366541 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:04.366517    2563 generic.go:356] "Generic (PLEG): container finished" podID="eddf9339-cff1-490c-94bd-45eca0498564" containerID="610cad5da4303c291a7855af6301c652471a0d8c208214913ab383bc6cf5dc1e" exitCode=0
Jul 08 18:40:04.366663 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:04.366561    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nhg22" event={"ID":"eddf9339-cff1-490c-94bd-45eca0498564","Type":"ContainerDied","Data":"610cad5da4303c291a7855af6301c652471a0d8c208214913ab383bc6cf5dc1e"}
Jul 08 18:40:05.218741 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:05.218716    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:40:05.218741 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:05.218719    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:40:05.219229 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:05.218719    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:40:05.219229 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:05.218811    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4p8h" podUID="d580cb38-0201-47b0-9d32-6a24141ad0ce"
Jul 08 18:40:05.219229 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:05.218908    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk596" podUID="00e24eff-47d6-4995-9631-af4c943ace31"
Jul 08 18:40:05.219229 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:05.219000    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rqbw5" podUID="69e11bcd-c40d-467f-8c92-464f63a8d067"
Jul 08 18:40:05.850966 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:05.850928    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret\") pod \"global-pull-secret-syncer-rqbw5\" (UID: \"69e11bcd-c40d-467f-8c92-464f63a8d067\") " pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:40:05.851141 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:05.851076    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 18:40:05.851141 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:05.851138    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret podName:69e11bcd-c40d-467f-8c92-464f63a8d067 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:37.851119499 +0000 UTC m=+66.093610598 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret") pod "global-pull-secret-syncer-rqbw5" (UID: "69e11bcd-c40d-467f-8c92-464f63a8d067") : object "kube-system"/"original-pull-secret" not registered
Jul 08 18:40:05.951510 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:05.951479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs\") pod \"network-metrics-daemon-r4p8h\" (UID: \"d580cb38-0201-47b0-9d32-6a24141ad0ce\") " pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:40:05.951682 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:05.951662    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:40:05.951741 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:05.951731    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs podName:d580cb38-0201-47b0-9d32-6a24141ad0ce nodeName:}" failed. No retries permitted until 2026-07-08 18:40:37.951715439 +0000 UTC m=+66.194206539 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs") pod "network-metrics-daemon-r4p8h" (UID: "d580cb38-0201-47b0-9d32-6a24141ad0ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:40:06.052462 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.052433    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm8qp\" (UniqueName: \"kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp\") pod \"network-check-target-fk596\" (UID: \"00e24eff-47d6-4995-9631-af4c943ace31\") " pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:40:06.052612 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:06.052585    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 18:40:06.052612 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:06.052602    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 18:40:06.052612 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:06.052612    2563 projected.go:196] Error preparing data for projected volume kube-api-access-sm8qp for pod openshift-network-diagnostics/network-check-target-fk596: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:40:06.052763 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:06.052676    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp podName:00e24eff-47d6-4995-9631-af4c943ace31 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:38.052663709 +0000 UTC m=+66.295154808 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sm8qp" (UniqueName: "kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp") pod "network-check-target-fk596" (UID: "00e24eff-47d6-4995-9631-af4c943ace31") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:40:06.622837 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.622814    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-111.ec2.internal" event="NodeReady"
Jul 08 18:40:06.623295 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.622947    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 18:40:06.674614 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.674583    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4l5d5"]
Jul 08 18:40:06.678749 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.678709    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7hh8k"]
Jul 08 18:40:06.678860 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.678841    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:06.681238 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.681213    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 18:40:06.681397 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.681380    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rmskx\""
Jul 08 18:40:06.681707 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.681689    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 18:40:06.682501 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.682475    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7hh8k"
Jul 08 18:40:06.687090 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.687070    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 18:40:06.687255 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.687124    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 18:40:06.687358 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.687159    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 18:40:06.687420 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.687167    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nbwh9\""
Jul 08 18:40:06.689753 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.689101    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4l5d5"]
Jul 08 18:40:06.694487 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.693666    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7hh8k"]
Jul 08 18:40:06.858523 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.858491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:06.858523 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.858526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t76fc\" (UniqueName: \"kubernetes.io/projected/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-kube-api-access-t76fc\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:06.858793 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.858552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-config-volume\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:06.858793 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.858642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6d6e5de-b05e-4e3d-8c97-7619bf059136-cert\") pod \"ingress-canary-7hh8k\" (UID: \"e6d6e5de-b05e-4e3d-8c97-7619bf059136\") " pod="openshift-ingress-canary/ingress-canary-7hh8k"
Jul 08 18:40:06.858793 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.858683    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-tmp-dir\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:06.858793 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.858734    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6n6p\" (UniqueName: \"kubernetes.io/projected/e6d6e5de-b05e-4e3d-8c97-7619bf059136-kube-api-access-b6n6p\") pod \"ingress-canary-7hh8k\" (UID: \"e6d6e5de-b05e-4e3d-8c97-7619bf059136\") " pod="openshift-ingress-canary/ingress-canary-7hh8k"
Jul 08 18:40:06.959787 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.959752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-config-volume\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:06.959945 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.959807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6d6e5de-b05e-4e3d-8c97-7619bf059136-cert\") pod \"ingress-canary-7hh8k\" (UID: \"e6d6e5de-b05e-4e3d-8c97-7619bf059136\") " pod="openshift-ingress-canary/ingress-canary-7hh8k"
Jul 08 18:40:06.959945 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.959836    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-tmp-dir\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:06.960068 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.960040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6n6p\" (UniqueName: \"kubernetes.io/projected/e6d6e5de-b05e-4e3d-8c97-7619bf059136-kube-api-access-b6n6p\") pod \"ingress-canary-7hh8k\" (UID: \"e6d6e5de-b05e-4e3d-8c97-7619bf059136\") " pod="openshift-ingress-canary/ingress-canary-7hh8k"
Jul 08 18:40:06.960198 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.960179    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-tmp-dir\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:06.960266 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.960232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:06.960366 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.960315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t76fc\" (UniqueName: \"kubernetes.io/projected/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-kube-api-access-t76fc\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:06.960431 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:06.960417    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 18:40:06.960484 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.960413    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-config-volume\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:06.960484 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:06.960477    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls podName:256c7e40-4220-4c0e-bf44-7dffcc1fb5c3 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:07.460456389 +0000 UTC m=+35.702947494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls") pod "dns-default-4l5d5" (UID: "256c7e40-4220-4c0e-bf44-7dffcc1fb5c3") : secret "dns-default-metrics-tls" not found
Jul 08 18:40:06.964965 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.964939    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6d6e5de-b05e-4e3d-8c97-7619bf059136-cert\") pod \"ingress-canary-7hh8k\" (UID: \"e6d6e5de-b05e-4e3d-8c97-7619bf059136\") " pod="openshift-ingress-canary/ingress-canary-7hh8k"
Jul 08 18:40:06.970519 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.970499    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6n6p\" (UniqueName: \"kubernetes.io/projected/e6d6e5de-b05e-4e3d-8c97-7619bf059136-kube-api-access-b6n6p\") pod \"ingress-canary-7hh8k\" (UID: \"e6d6e5de-b05e-4e3d-8c97-7619bf059136\") " pod="openshift-ingress-canary/ingress-canary-7hh8k"
Jul 08 18:40:06.970519 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.970516    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t76fc\" (UniqueName: \"kubernetes.io/projected/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-kube-api-access-t76fc\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:06.998634 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:06.998608    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7hh8k"
Jul 08 18:40:07.136867 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:07.136653    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7hh8k"]
Jul 08 18:40:07.140297 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:40:07.140267    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d6e5de_b05e_4e3d_8c97_7619bf059136.slice/crio-b81fd902c99a8b6a997bcec1ecd07ab80580bfd49e05fa22f6f3855a2b94105f WatchSource:0}: Error finding container b81fd902c99a8b6a997bcec1ecd07ab80580bfd49e05fa22f6f3855a2b94105f: Status 404 returned error can't find the container with id b81fd902c99a8b6a997bcec1ecd07ab80580bfd49e05fa22f6f3855a2b94105f
Jul 08 18:40:07.219136 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:07.219107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:40:07.219275 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:07.219107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:40:07.219318 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:07.219107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:40:07.222736 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:07.222718    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 18:40:07.222850 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:07.222769    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sc5vc\""
Jul 08 18:40:07.223139 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:07.223125    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 18:40:07.223213 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:07.223175    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 18:40:07.223267 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:07.223245    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-msx7w\""
Jul 08 18:40:07.223542 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:07.223530    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 18:40:07.373656 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:07.373612    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7hh8k" event={"ID":"e6d6e5de-b05e-4e3d-8c97-7619bf059136","Type":"ContainerStarted","Data":"b81fd902c99a8b6a997bcec1ecd07ab80580bfd49e05fa22f6f3855a2b94105f"}
Jul 08 18:40:07.465643 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:07.465566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:07.465762 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:07.465679    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 18:40:07.465762 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:07.465728    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls podName:256c7e40-4220-4c0e-bf44-7dffcc1fb5c3 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:08.465714557 +0000 UTC m=+36.708205661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls") pod "dns-default-4l5d5" (UID: "256c7e40-4220-4c0e-bf44-7dffcc1fb5c3") : secret "dns-default-metrics-tls" not found
Jul 08 18:40:08.473269 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:08.473233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:08.473849 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:08.473367    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 18:40:08.473849 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:08.473436    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls podName:256c7e40-4220-4c0e-bf44-7dffcc1fb5c3 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:10.473415811 +0000 UTC m=+38.715906909 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls") pod "dns-default-4l5d5" (UID: "256c7e40-4220-4c0e-bf44-7dffcc1fb5c3") : secret "dns-default-metrics-tls" not found
Jul 08 18:40:10.486949 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:10.486912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:10.487305 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:10.487072    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 18:40:10.487305 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:10.487132    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls podName:256c7e40-4220-4c0e-bf44-7dffcc1fb5c3 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:14.487117843 +0000 UTC m=+42.729608943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls") pod "dns-default-4l5d5" (UID: "256c7e40-4220-4c0e-bf44-7dffcc1fb5c3") : secret "dns-default-metrics-tls" not found
Jul 08 18:40:11.386021 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:11.385988    2563 generic.go:356] "Generic (PLEG): container finished" podID="eddf9339-cff1-490c-94bd-45eca0498564" containerID="019a274fecaf077b4e643de649762bfd09b42af8b47c00af9239b7d6818894ac" exitCode=0
Jul 08 18:40:11.386174 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:11.386055    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nhg22" event={"ID":"eddf9339-cff1-490c-94bd-45eca0498564","Type":"ContainerDied","Data":"019a274fecaf077b4e643de649762bfd09b42af8b47c00af9239b7d6818894ac"}
Jul 08 18:40:11.387323 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:11.387302    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7hh8k" event={"ID":"e6d6e5de-b05e-4e3d-8c97-7619bf059136","Type":"ContainerStarted","Data":"f5d8347f2b798d5ff04566aee26ba7e14e1ee93bfd203b292df20aaef420659a"}
Jul 08 18:40:11.429571 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:11.429525    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7hh8k" podStartSLOduration=1.92830843 podStartE2EDuration="5.429509911s" totalImagesPullingTime="3.501201481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:40:11.429290282 +0000 UTC m=+39.671781404" watchObservedRunningTime="2026-07-08 18:40:11.429509911 +0000 UTC m=+39.672001032"
Jul 08 18:40:12.392872 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:12.392841    2563 generic.go:356] "Generic (PLEG): container finished" podID="eddf9339-cff1-490c-94bd-45eca0498564" containerID="00f28050772b94939ef2ea347ce293d3ef4114c445d68a2133380d866c8e47ac" exitCode=0
Jul 08 18:40:12.393237 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:12.392910    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nhg22" event={"ID":"eddf9339-cff1-490c-94bd-45eca0498564","Type":"ContainerDied","Data":"00f28050772b94939ef2ea347ce293d3ef4114c445d68a2133380d866c8e47ac"}
Jul 08 18:40:13.398866 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:13.398831    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nhg22" event={"ID":"eddf9339-cff1-490c-94bd-45eca0498564","Type":"ContainerStarted","Data":"e4d83b22d9125d105102f8cccb85a1f87f4563b2134c8f519dce98d22d188753"}
Jul 08 18:40:13.413806 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:13.413781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:13.428310 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:13.428267    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nhg22" podStartSLOduration=13.949164625 podStartE2EDuration="41.42825493s" totalImagesPullingTime="27.479090305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:39:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:40:13.427203781 +0000 UTC m=+41.669694903" watchObservedRunningTime="2026-07-08 18:40:13.42825493 +0000 UTC m=+41.670746050"
Jul 08 18:40:13.641061 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:13.641026    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:13.725772 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:13.725701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:14.513705 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:14.513675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:14.514052 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:14.513833    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 18:40:14.514052 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:14.513903    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls podName:256c7e40-4220-4c0e-bf44-7dffcc1fb5c3 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:22.513886932 +0000 UTC m=+50.756378031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls") pod "dns-default-4l5d5" (UID: "256c7e40-4220-4c0e-bf44-7dffcc1fb5c3") : secret "dns-default-metrics-tls" not found
Jul 08 18:40:16.042276 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:16.042247    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:16.141870 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:16.141842    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:18.006103 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:18.006069    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:18.103381 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:18.103349    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:18.890110 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:18.890079    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:19.101810 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:19.101780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:22.566187 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:22.566156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:22.566515 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:22.566259    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 18:40:22.566515 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:22.566311    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls podName:256c7e40-4220-4c0e-bf44-7dffcc1fb5c3 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:38.566295297 +0000 UTC m=+66.808786410 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls") pod "dns-default-4l5d5" (UID: "256c7e40-4220-4c0e-bf44-7dffcc1fb5c3") : secret "dns-default-metrics-tls" not found
Jul 08 18:40:28.628215 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:28.628183    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:28.729233 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:28.729205    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:29.101683 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:29.101655    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:29.179450 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:29.179420    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:32.370259 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:32.370233    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fsjbh"
Jul 08 18:40:32.531097 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:32.531062    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:32.631556 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:32.631476    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:35.908113 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:35.908083    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:35.969937 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:35.969914    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:37.862514 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:37.862480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret\") pod \"global-pull-secret-syncer-rqbw5\" (UID: \"69e11bcd-c40d-467f-8c92-464f63a8d067\") " pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:40:37.865473 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:37.865457    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 18:40:37.876355 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:37.876334    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69e11bcd-c40d-467f-8c92-464f63a8d067-original-pull-secret\") pod \"global-pull-secret-syncer-rqbw5\" (UID: \"69e11bcd-c40d-467f-8c92-464f63a8d067\") " pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:40:37.963705 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:37.963683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs\") pod \"network-metrics-daemon-r4p8h\" (UID: \"d580cb38-0201-47b0-9d32-6a24141ad0ce\") " pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:40:37.966247 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:37.966231    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 18:40:37.974668 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:37.974653    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 18:40:37.974722 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:37.974709    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs podName:d580cb38-0201-47b0-9d32-6a24141ad0ce nodeName:}" failed. No retries permitted until 2026-07-08 18:41:41.974695474 +0000 UTC m=+130.217186573 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs") pod "network-metrics-daemon-r4p8h" (UID: "d580cb38-0201-47b0-9d32-6a24141ad0ce") : secret "metrics-daemon-secret" not found
Jul 08 18:40:38.064718 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:38.064696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm8qp\" (UniqueName: \"kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp\") pod \"network-check-target-fk596\" (UID: \"00e24eff-47d6-4995-9631-af4c943ace31\") " pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:40:38.067732 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:38.067717    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 18:40:38.078041 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:38.078024    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 18:40:38.088215 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:38.088197    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm8qp\" (UniqueName: \"kubernetes.io/projected/00e24eff-47d6-4995-9631-af4c943ace31-kube-api-access-sm8qp\") pod \"network-check-target-fk596\" (UID: \"00e24eff-47d6-4995-9631-af4c943ace31\") " pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:40:38.130124 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:38.130078    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqbw5"
Jul 08 18:40:38.142120 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:38.142106    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-msx7w\""
Jul 08 18:40:38.150207 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:38.150190    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:40:38.259827 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:38.259802    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rqbw5"]
Jul 08 18:40:38.263867 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:40:38.263839    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e11bcd_c40d_467f_8c92_464f63a8d067.slice/crio-7d73ea1b1e615d5c248eee9ca382da118563129c08514746130bb7bff33d6f3c WatchSource:0}: Error finding container 7d73ea1b1e615d5c248eee9ca382da118563129c08514746130bb7bff33d6f3c: Status 404 returned error can't find the container with id 7d73ea1b1e615d5c248eee9ca382da118563129c08514746130bb7bff33d6f3c
Jul 08 18:40:38.274494 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:38.274471    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fk596"]
Jul 08 18:40:38.277038 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:40:38.277020    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e24eff_47d6_4995_9631_af4c943ace31.slice/crio-355adc06e81b0d67d4d8acbb15928f80f00ec8f77b15a34244e4d183f17f4378 WatchSource:0}: Error finding container 355adc06e81b0d67d4d8acbb15928f80f00ec8f77b15a34244e4d183f17f4378: Status 404 returned error can't find the container with id 355adc06e81b0d67d4d8acbb15928f80f00ec8f77b15a34244e4d183f17f4378
Jul 08 18:40:38.454661 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:38.454583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fk596" event={"ID":"00e24eff-47d6-4995-9631-af4c943ace31","Type":"ContainerStarted","Data":"355adc06e81b0d67d4d8acbb15928f80f00ec8f77b15a34244e4d183f17f4378"}
Jul 08 18:40:38.455530 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:38.455509    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rqbw5" event={"ID":"69e11bcd-c40d-467f-8c92-464f63a8d067","Type":"ContainerStarted","Data":"7d73ea1b1e615d5c248eee9ca382da118563129c08514746130bb7bff33d6f3c"}
Jul 08 18:40:38.567406 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:38.567386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:40:38.567511 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:38.567500    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 18:40:38.567550 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:38.567546    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls podName:256c7e40-4220-4c0e-bf44-7dffcc1fb5c3 nodeName:}" failed. No retries permitted until 2026-07-08 18:41:10.567533079 +0000 UTC m=+98.810024178 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls") pod "dns-default-4l5d5" (UID: "256c7e40-4220-4c0e-bf44-7dffcc1fb5c3") : secret "dns-default-metrics-tls" not found
Jul 08 18:40:39.498290 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.498259    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-ddbpw"]
Jul 08 18:40:39.502886 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.502861    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ddbpw"
Jul 08 18:40:39.505889 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.505870    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-swklw\""
Jul 08 18:40:39.509419 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.509397    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-ddbpw"]
Jul 08 18:40:39.573688 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.573659    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm69s\" (UniqueName: \"kubernetes.io/projected/7c6cdd0b-f2d9-452c-819b-da13c40d55b1-kube-api-access-rm69s\") pod \"network-check-source-989f8b8dc-ddbpw\" (UID: \"7c6cdd0b-f2d9-452c-819b-da13c40d55b1\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ddbpw"
Jul 08 18:40:39.608554 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.608533    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6fdfb86787-4thnt"]
Jul 08 18:40:39.611801 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.611784    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:39.615538 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.615509    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cpx5k\""
Jul 08 18:40:39.615538 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.615526    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 08 18:40:39.615928 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.615910    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 08 18:40:39.616008 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.615959    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 18:40:39.616221 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.616203    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 08 18:40:39.616221 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.616213    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 18:40:39.616352 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.616248    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 08 18:40:39.631845 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.631820    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6fdfb86787-4thnt"]
Jul 08 18:40:39.674536 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.674517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgzz9\" (UniqueName: \"kubernetes.io/projected/54c0a4db-2b2f-4365-ba8b-881be307780b-kube-api-access-vgzz9\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:39.674661 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.674545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-default-certificate\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:39.674661 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.674569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-stats-auth\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:39.674749 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.674661    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm69s\" (UniqueName: \"kubernetes.io/projected/7c6cdd0b-f2d9-452c-819b-da13c40d55b1-kube-api-access-rm69s\") pod \"network-check-source-989f8b8dc-ddbpw\" (UID: \"7c6cdd0b-f2d9-452c-819b-da13c40d55b1\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ddbpw"
Jul 08 18:40:39.674749 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.674689    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:39.674749 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.674707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:39.683972 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.683954    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm69s\" (UniqueName: \"kubernetes.io/projected/7c6cdd0b-f2d9-452c-819b-da13c40d55b1-kube-api-access-rm69s\") pod \"network-check-source-989f8b8dc-ddbpw\" (UID: \"7c6cdd0b-f2d9-452c-819b-da13c40d55b1\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ddbpw"
Jul 08 18:40:39.775027 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.774966    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:39.775027 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.774998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:39.775144 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.775063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgzz9\" (UniqueName: \"kubernetes.io/projected/54c0a4db-2b2f-4365-ba8b-881be307780b-kube-api-access-vgzz9\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:39.775144 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.775093    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-default-certificate\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:39.775144 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:39.775101    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 18:40:39.775275 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:39.775151    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs podName:54c0a4db-2b2f-4365-ba8b-881be307780b nodeName:}" failed. No retries permitted until 2026-07-08 18:40:40.275134593 +0000 UTC m=+68.517625709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs") pod "router-default-6fdfb86787-4thnt" (UID: "54c0a4db-2b2f-4365-ba8b-881be307780b") : secret "router-metrics-certs-default" not found
Jul 08 18:40:39.775275 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.775209    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-stats-auth\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:39.775275 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:39.775219    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle podName:54c0a4db-2b2f-4365-ba8b-881be307780b nodeName:}" failed. No retries permitted until 2026-07-08 18:40:40.275208364 +0000 UTC m=+68.517699481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle") pod "router-default-6fdfb86787-4thnt" (UID: "54c0a4db-2b2f-4365-ba8b-881be307780b") : configmap references non-existent config key: service-ca.crt
Jul 08 18:40:39.777255 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.777232    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-stats-auth\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:39.777343 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.777310    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-default-certificate\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:39.795349 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.795327    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgzz9\" (UniqueName: \"kubernetes.io/projected/54c0a4db-2b2f-4365-ba8b-881be307780b-kube-api-access-vgzz9\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:39.811805 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.811788    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ddbpw"
Jul 08 18:40:39.834607 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.834585    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:39.896199 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.896172    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:39.940521 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:39.940417    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-ddbpw"]
Jul 08 18:40:39.944442 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:40:39.943725    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6cdd0b_f2d9_452c_819b_da13c40d55b1.slice/crio-e1c71a27ce8dd47ec693d44388c0b2e09cd1bd156049faeb8c09ee1cbd74ca13 WatchSource:0}: Error finding container e1c71a27ce8dd47ec693d44388c0b2e09cd1bd156049faeb8c09ee1cbd74ca13: Status 404 returned error can't find the container with id e1c71a27ce8dd47ec693d44388c0b2e09cd1bd156049faeb8c09ee1cbd74ca13
Jul 08 18:40:40.031727 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.031661    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8655dcdc69-tl5xq"]
Jul 08 18:40:40.035978 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.035958    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.038458 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.038439    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 18:40:40.038705 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.038692    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 18:40:40.038788 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.038696    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n6k5m\""
Jul 08 18:40:40.038959 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.038946    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 18:40:40.043977 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.043961    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 18:40:40.046615 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.046597    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8655dcdc69-tl5xq"]
Jul 08 18:40:40.077740 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.077719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-bound-sa-token\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.077840 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.077764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-ca-trust-extracted\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.077909 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.077875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-trusted-ca\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.078067 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.077924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-image-registry-private-configuration\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.078067 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.077969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.078067 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.077997    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhgf2\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-kube-api-access-bhgf2\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.078067 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.078055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-installation-pull-secrets\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.078231 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.078131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-certificates\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.179087 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.179059    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-bound-sa-token\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.179225 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.179109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-ca-trust-extracted\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.179225 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.179202    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-trusted-ca\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.179326 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.179244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-image-registry-private-configuration\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.179326 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.179272    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.179326 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.179298    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhgf2\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-kube-api-access-bhgf2\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.179461 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.179324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-installation-pull-secrets\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.179461 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.179352    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-certificates\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.179461 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:40.179448    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 18:40:40.179613 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:40.179465    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8655dcdc69-tl5xq: secret "image-registry-tls" not found
Jul 08 18:40:40.179613 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.179507    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-ca-trust-extracted\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.179613 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:40.179522    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls podName:f82b1200-8eb2-418a-ab9c-8f0f559e40e7 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:40.67949856 +0000 UTC m=+68.921989665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls") pod "image-registry-8655dcdc69-tl5xq" (UID: "f82b1200-8eb2-418a-ab9c-8f0f559e40e7") : secret "image-registry-tls" not found
Jul 08 18:40:40.180025 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.179983    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-certificates\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.180379 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.180360    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-trusted-ca\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.182465 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.182440    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-installation-pull-secrets\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.182553 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.182440    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-image-registry-private-configuration\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.188885 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.188849    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-bound-sa-token\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.189303 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.189261    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhgf2\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-kube-api-access-bhgf2\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.280334 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.280309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:40.280462 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.280348    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:40.280462 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:40.280448    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 18:40:40.280647 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:40.280482    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle podName:54c0a4db-2b2f-4365-ba8b-881be307780b nodeName:}" failed. No retries permitted until 2026-07-08 18:40:41.280462592 +0000 UTC m=+69.522953692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle") pod "router-default-6fdfb86787-4thnt" (UID: "54c0a4db-2b2f-4365-ba8b-881be307780b") : configmap references non-existent config key: service-ca.crt
Jul 08 18:40:40.280647 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:40.280597    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs podName:54c0a4db-2b2f-4365-ba8b-881be307780b nodeName:}" failed. No retries permitted until 2026-07-08 18:40:41.280583777 +0000 UTC m=+69.523074882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs") pod "router-default-6fdfb86787-4thnt" (UID: "54c0a4db-2b2f-4365-ba8b-881be307780b") : secret "router-metrics-certs-default" not found
Jul 08 18:40:40.463333 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.463289    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ddbpw" event={"ID":"7c6cdd0b-f2d9-452c-819b-da13c40d55b1","Type":"ContainerStarted","Data":"e1c71a27ce8dd47ec693d44388c0b2e09cd1bd156049faeb8c09ee1cbd74ca13"}
Jul 08 18:40:40.684377 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:40.684341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:40.684810 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:40.684515    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 18:40:40.684810 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:40.684530    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8655dcdc69-tl5xq: secret "image-registry-tls" not found
Jul 08 18:40:40.684810 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:40.684588    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls podName:f82b1200-8eb2-418a-ab9c-8f0f559e40e7 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:41.684571702 +0000 UTC m=+69.927062821 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls") pod "image-registry-8655dcdc69-tl5xq" (UID: "f82b1200-8eb2-418a-ab9c-8f0f559e40e7") : secret "image-registry-tls" not found
Jul 08 18:40:41.290730 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:41.290406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:41.290730 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:41.290459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:41.290730 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:41.290657    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 18:40:41.290730 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:41.290669    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle podName:54c0a4db-2b2f-4365-ba8b-881be307780b nodeName:}" failed. No retries permitted until 2026-07-08 18:40:43.290644742 +0000 UTC m=+71.533135856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle") pod "router-default-6fdfb86787-4thnt" (UID: "54c0a4db-2b2f-4365-ba8b-881be307780b") : configmap references non-existent config key: service-ca.crt
Jul 08 18:40:41.290730 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:41.290709    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs podName:54c0a4db-2b2f-4365-ba8b-881be307780b nodeName:}" failed. No retries permitted until 2026-07-08 18:40:43.290693694 +0000 UTC m=+71.533184807 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs") pod "router-default-6fdfb86787-4thnt" (UID: "54c0a4db-2b2f-4365-ba8b-881be307780b") : secret "router-metrics-certs-default" not found
Jul 08 18:40:41.695085 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:41.695039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:41.695764 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:41.695154    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 18:40:41.695764 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:41.695177    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8655dcdc69-tl5xq: secret "image-registry-tls" not found
Jul 08 18:40:41.695764 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:41.695239    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls podName:f82b1200-8eb2-418a-ab9c-8f0f559e40e7 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:43.695219675 +0000 UTC m=+71.937710776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls") pod "image-registry-8655dcdc69-tl5xq" (UID: "f82b1200-8eb2-418a-ab9c-8f0f559e40e7") : secret "image-registry-tls" not found
Jul 08 18:40:42.471509 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:42.471417    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ddbpw" event={"ID":"7c6cdd0b-f2d9-452c-819b-da13c40d55b1","Type":"ContainerStarted","Data":"a1d77f4a0a6682c634a4264d01baff2816d865708226bc343adb7b436d5fda2b"}
Jul 08 18:40:42.473194 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:42.473165    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fk596" event={"ID":"00e24eff-47d6-4995-9631-af4c943ace31","Type":"ContainerStarted","Data":"72ad445ba323e485c54cb05d037539dc5d1a6541a19a2d2168d5824e0b2ccf6a"}
Jul 08 18:40:42.473333 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:42.473315    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:40:42.489295 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:42.489249    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ddbpw" podStartSLOduration=1.226958411 podStartE2EDuration="3.489232505s" totalImagesPullingTime="2.262274094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:40:42.488598863 +0000 UTC m=+70.731089985" watchObservedRunningTime="2026-07-08 18:40:42.489232505 +0000 UTC m=+70.731723628"
Jul 08 18:40:42.508421 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:42.508359    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fk596" podStartSLOduration=66.589600615 podStartE2EDuration="1m10.508346794s" totalImagesPullingTime="3.918746179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:40:42.508334514 +0000 UTC m=+70.750825647" watchObservedRunningTime="2026-07-08 18:40:42.508346794 +0000 UTC m=+70.750837911"
Jul 08 18:40:43.139482 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:43.139447    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:43.233477 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:43.233419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:43.307919 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:43.307886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:43.308089 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:43.307933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:43.308089 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:43.308063    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle podName:54c0a4db-2b2f-4365-ba8b-881be307780b nodeName:}" failed. No retries permitted until 2026-07-08 18:40:47.308041263 +0000 UTC m=+75.550532362 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle") pod "router-default-6fdfb86787-4thnt" (UID: "54c0a4db-2b2f-4365-ba8b-881be307780b") : configmap references non-existent config key: service-ca.crt
Jul 08 18:40:43.308210 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:43.308095    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 18:40:43.308210 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:43.308152    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs podName:54c0a4db-2b2f-4365-ba8b-881be307780b nodeName:}" failed. No retries permitted until 2026-07-08 18:40:47.308135131 +0000 UTC m=+75.550626234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs") pod "router-default-6fdfb86787-4thnt" (UID: "54c0a4db-2b2f-4365-ba8b-881be307780b") : secret "router-metrics-certs-default" not found
Jul 08 18:40:43.712026 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:43.711985    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:43.712192 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:43.712151    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 18:40:43.712192 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:43.712169    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8655dcdc69-tl5xq: secret "image-registry-tls" not found
Jul 08 18:40:43.712309 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:43.712225    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls podName:f82b1200-8eb2-418a-ab9c-8f0f559e40e7 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:47.712207879 +0000 UTC m=+75.954698994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls") pod "image-registry-8655dcdc69-tl5xq" (UID: "f82b1200-8eb2-418a-ab9c-8f0f559e40e7") : secret "image-registry-tls" not found
Jul 08 18:40:44.522733 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.521510    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6s4s7"]
Jul 08 18:40:44.533405 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.533379    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:44.543929 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.543907    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 18:40:44.544554 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.544536    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 18:40:44.544664 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.544557    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 18:40:44.544664 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.544583    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 18:40:44.544664 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.544612    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jtszc\""
Jul 08 18:40:44.566318 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.566291    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6s4s7"]
Jul 08 18:40:44.591546 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.591525    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:44.619191 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.619168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8e3cb9b-b149-443a-af33-487e6f08be18-data-volume\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:44.619286 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.619230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:44.619328 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.619288    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv9s2\" (UniqueName: \"kubernetes.io/projected/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-api-access-zv9s2\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:44.619328 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.619315    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:44.619400 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.619335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d8e3cb9b-b149-443a-af33-487e6f08be18-crio-socket\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:44.720592 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.720561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:44.720698 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.720618    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv9s2\" (UniqueName: \"kubernetes.io/projected/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-api-access-zv9s2\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:44.720698 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.720659    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:44.720698 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:44.720682    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 18:40:44.720792 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.720738    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d8e3cb9b-b149-443a-af33-487e6f08be18-crio-socket\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:44.720792 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:44.720749    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm podName:d8e3cb9b-b149-443a-af33-487e6f08be18 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:45.220734168 +0000 UTC m=+73.463225267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6s4s7" (UID: "d8e3cb9b-b149-443a-af33-487e6f08be18") : configmap "kube-rbac-proxy" not found
Jul 08 18:40:44.720792 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:44.720751    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 18:40:44.720884 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.720688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d8e3cb9b-b149-443a-af33-487e6f08be18-crio-socket\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:44.720884 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:44.720813    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls podName:d8e3cb9b-b149-443a-af33-487e6f08be18 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:45.2207978 +0000 UTC m=+73.463288907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6s4s7" (UID: "d8e3cb9b-b149-443a-af33-487e6f08be18") : secret "insights-runtime-extractor-tls" not found
Jul 08 18:40:44.720884 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.720871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8e3cb9b-b149-443a-af33-487e6f08be18-data-volume\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:44.721169 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.721155    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8e3cb9b-b149-443a-af33-487e6f08be18-data-volume\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:44.732931 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.732916    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv9s2\" (UniqueName: \"kubernetes.io/projected/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-api-access-zv9s2\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:44.797069 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:44.797042    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:45.224004 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:45.223979    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:45.224150 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:45.224047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:45.224150 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:45.224120    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 18:40:45.224150 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:45.224121    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 18:40:45.224251 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:45.224165    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm podName:d8e3cb9b-b149-443a-af33-487e6f08be18 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:46.224152858 +0000 UTC m=+74.466643958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6s4s7" (UID: "d8e3cb9b-b149-443a-af33-487e6f08be18") : configmap "kube-rbac-proxy" not found
Jul 08 18:40:45.224251 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:45.224177    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls podName:d8e3cb9b-b149-443a-af33-487e6f08be18 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:46.224171087 +0000 UTC m=+74.466662185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6s4s7" (UID: "d8e3cb9b-b149-443a-af33-487e6f08be18") : secret "insights-runtime-extractor-tls" not found
Jul 08 18:40:45.351920 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:45.351893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:45.446677 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:45.446645    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:45.481727 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:45.481658    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rqbw5" event={"ID":"69e11bcd-c40d-467f-8c92-464f63a8d067","Type":"ContainerStarted","Data":"eecb1fee5e2bad21d50183d458a6938b833c17ff3d4a19acf8ce4ead3ab01670"}
Jul 08 18:40:45.499910 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:45.499876    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rqbw5" podStartSLOduration=67.014059845 podStartE2EDuration="1m13.499862578s" totalImagesPullingTime="6.485802733s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:40:45.497963593 +0000 UTC m=+73.740454714" watchObservedRunningTime="2026-07-08 18:40:45.499862578 +0000 UTC m=+73.742353699"
Jul 08 18:40:45.548938 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:45.548917    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:45.728698 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:45.728667    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:45.808182 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:45.808121    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:46.007431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:46.007411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:46.108571 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:46.108552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:46.230533 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:46.230514    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:46.230751 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:46.230564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:46.230751 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:46.230654    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 18:40:46.230751 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:46.230669    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 18:40:46.230751 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:46.230714    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls podName:d8e3cb9b-b149-443a-af33-487e6f08be18 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:48.23070209 +0000 UTC m=+76.473193192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6s4s7" (UID: "d8e3cb9b-b149-443a-af33-487e6f08be18") : secret "insights-runtime-extractor-tls" not found
Jul 08 18:40:46.230751 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:46.230729    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm podName:d8e3cb9b-b149-443a-af33-487e6f08be18 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:48.230722136 +0000 UTC m=+76.473213235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6s4s7" (UID: "d8e3cb9b-b149-443a-af33-487e6f08be18") : configmap "kube-rbac-proxy" not found
Jul 08 18:40:46.493202 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:46.493149    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxmt9_ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682/dns-node-resolver/0.log"
Jul 08 18:40:47.295938 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:47.295920    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-62l88_d149a818-b8bc-4e1c-bba0-9de3c65ff3b4/node-ca/0.log"
Jul 08 18:40:47.337706 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:47.337684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:47.337797 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:47.337712    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:47.337843 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:47.337821    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle podName:54c0a4db-2b2f-4365-ba8b-881be307780b nodeName:}" failed. No retries permitted until 2026-07-08 18:40:55.337807738 +0000 UTC m=+83.580298838 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle") pod "router-default-6fdfb86787-4thnt" (UID: "54c0a4db-2b2f-4365-ba8b-881be307780b") : configmap references non-existent config key: service-ca.crt
Jul 08 18:40:47.337843 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:47.337833    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 18:40:47.337928 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:47.337866    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs podName:54c0a4db-2b2f-4365-ba8b-881be307780b nodeName:}" failed. No retries permitted until 2026-07-08 18:40:55.337856484 +0000 UTC m=+83.580347583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs") pod "router-default-6fdfb86787-4thnt" (UID: "54c0a4db-2b2f-4365-ba8b-881be307780b") : secret "router-metrics-certs-default" not found
Jul 08 18:40:47.658052 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:47.658028    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:47.719020 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:47.718993    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:47.741585 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:47.741543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:47.741688 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:47.741676    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 18:40:47.741729 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:47.741689    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8655dcdc69-tl5xq: secret "image-registry-tls" not found
Jul 08 18:40:47.741761 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:47.741736    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls podName:f82b1200-8eb2-418a-ab9c-8f0f559e40e7 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:55.741720085 +0000 UTC m=+83.984211196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls") pod "image-registry-8655dcdc69-tl5xq" (UID: "f82b1200-8eb2-418a-ab9c-8f0f559e40e7") : secret "image-registry-tls" not found
Jul 08 18:40:48.093414 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:48.093389    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7hh8k_e6d6e5de-b05e-4e3d-8c97-7619bf059136/serve-healthcheck-canary/0.log"
Jul 08 18:40:48.245286 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:48.245259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:48.245424 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:48.245350    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:48.245424 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:48.245386    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 18:40:48.245525 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:48.245436    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls podName:d8e3cb9b-b149-443a-af33-487e6f08be18 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:52.245423402 +0000 UTC m=+80.487914501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6s4s7" (UID: "d8e3cb9b-b149-443a-af33-487e6f08be18") : secret "insights-runtime-extractor-tls" not found
Jul 08 18:40:48.245525 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:48.245436    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 18:40:48.245525 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:48.245484    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm podName:d8e3cb9b-b149-443a-af33-487e6f08be18 nodeName:}" failed. No retries permitted until 2026-07-08 18:40:52.245470295 +0000 UTC m=+80.487961415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6s4s7" (UID: "d8e3cb9b-b149-443a-af33-487e6f08be18") : configmap "kube-rbac-proxy" not found
Jul 08 18:40:48.593972 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:48.593951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:49.421914 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:49.421881    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:49.560570 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:49.560545    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:49.659406 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:49.659375    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:49.776027 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:49.775968    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:50.126712 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:50.126686    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:51.318057 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:51.318026    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:51.427256 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:51.427228    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:51.529659 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:51.529620    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:51.697912 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:51.697887    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:51.903369 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:51.903344    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:52.109448 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:52.109424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:52.271775 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:52.271741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:52.271926 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:52.271866    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 18:40:52.271926 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:52.271897    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:40:52.271926 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:52.271912    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls podName:d8e3cb9b-b149-443a-af33-487e6f08be18 nodeName:}" failed. No retries permitted until 2026-07-08 18:41:00.271898384 +0000 UTC m=+88.514389510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6s4s7" (UID: "d8e3cb9b-b149-443a-af33-487e6f08be18") : secret "insights-runtime-extractor-tls" not found
Jul 08 18:40:52.272108 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:52.271943    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 18:40:52.272108 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:52.271983    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm podName:d8e3cb9b-b149-443a-af33-487e6f08be18 nodeName:}" failed. No retries permitted until 2026-07-08 18:41:00.27196787 +0000 UTC m=+88.514458969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6s4s7" (UID: "d8e3cb9b-b149-443a-af33-487e6f08be18") : configmap "kube-rbac-proxy" not found
Jul 08 18:40:53.093274 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:53.093248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:53.176088 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:53.176065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:53.320482 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:53.320456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:53.510901 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:53.510842    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:53.734220 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:53.734198    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:53.899194 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:53.899170    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:53.970485 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:53.970459    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:54.108573 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:54.108489    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:54.700106 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:54.700082    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:55.306972 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:55.306942    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:55.395871 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:55.395833    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:55.396008 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:55.395878    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:55.396008 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:40:55.395986    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle podName:54c0a4db-2b2f-4365-ba8b-881be307780b nodeName:}" failed. No retries permitted until 2026-07-08 18:41:11.395966551 +0000 UTC m=+99.638457650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle") pod "router-default-6fdfb86787-4thnt" (UID: "54c0a4db-2b2f-4365-ba8b-881be307780b") : configmap references non-existent config key: service-ca.crt
Jul 08 18:40:55.398218 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:55.398196    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54c0a4db-2b2f-4365-ba8b-881be307780b-metrics-certs\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:40:55.505906 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:55.505880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:55.608372 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:55.608346    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:55.708720 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:55.708696    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:55.799982 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:55.799963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:55.802173 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:55.802149    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls\") pod \"image-registry-8655dcdc69-tl5xq\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") " pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:55.900895 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:55.900848    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:55.945516 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:55.945498    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:56.069756 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:56.069732    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8655dcdc69-tl5xq"]
Jul 08 18:40:56.073015 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:40:56.072991    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82b1200_8eb2_418a_ab9c_8f0f559e40e7.slice/crio-0be71f8d8168970476a8480b4060a4c756335d4791d09fd068bf1f9e578ba415 WatchSource:0}: Error finding container 0be71f8d8168970476a8480b4060a4c756335d4791d09fd068bf1f9e578ba415: Status 404 returned error can't find the container with id 0be71f8d8168970476a8480b4060a4c756335d4791d09fd068bf1f9e578ba415
Jul 08 18:40:56.103660 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:56.103617    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:56.509415 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:56.509384    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq" event={"ID":"f82b1200-8eb2-418a-ab9c-8f0f559e40e7","Type":"ContainerStarted","Data":"d4abadf7b345421b698c4295f3b1914fe43dc3ccb4edccab2a511167da2ad1e9"}
Jul 08 18:40:56.509868 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:56.509438    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq" event={"ID":"f82b1200-8eb2-418a-ab9c-8f0f559e40e7","Type":"ContainerStarted","Data":"0be71f8d8168970476a8480b4060a4c756335d4791d09fd068bf1f9e578ba415"}
Jul 08 18:40:56.509868 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:56.509515    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:40:56.530923 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:56.530873    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq" podStartSLOduration=16.530859231 podStartE2EDuration="16.530859231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:40:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:40:56.530296509 +0000 UTC m=+84.772787630" watchObservedRunningTime="2026-07-08 18:40:56.530859231 +0000 UTC m=+84.773350351"
Jul 08 18:40:57.108370 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:57.108342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:57.506561 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:57.506501    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:57.705848 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:57.705811    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:57.807888 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:57.807823    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:57.908379 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:57.908358    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:58.129190 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:58.129173    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:59.104263 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:59.104238    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:59.301119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:59.301092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:59.511907 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:59.511827    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:40:59.901831 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:40:59.901804    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:00.007143 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:00.007123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:00.109495 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:00.109470    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:00.335439 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:00.335382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:41:00.335536 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:00.335437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:41:00.335898 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:00.335875    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d8e3cb9b-b149-443a-af33-487e6f08be18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:41:00.337565 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:00.337547    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d8e3cb9b-b149-443a-af33-487e6f08be18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6s4s7\" (UID: \"d8e3cb9b-b149-443a-af33-487e6f08be18\") " pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:41:00.359215 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:00.359173    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:00.441420 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:00.441402    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6s4s7"
Jul 08 18:41:00.452930 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:00.452908    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:00.570818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:00.570795    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6s4s7"]
Jul 08 18:41:00.572922 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:41:00.572900    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e3cb9b_b149_443a_af33_487e6f08be18.slice/crio-49fa857dfd9575b8fa81f779bebeea371ca31c9ee0ebafde26df6fc82c1b19d2 WatchSource:0}: Error finding container 49fa857dfd9575b8fa81f779bebeea371ca31c9ee0ebafde26df6fc82c1b19d2: Status 404 returned error can't find the container with id 49fa857dfd9575b8fa81f779bebeea371ca31c9ee0ebafde26df6fc82c1b19d2
Jul 08 18:41:01.530127 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:01.530091    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6s4s7" event={"ID":"d8e3cb9b-b149-443a-af33-487e6f08be18","Type":"ContainerStarted","Data":"49fa857dfd9575b8fa81f779bebeea371ca31c9ee0ebafde26df6fc82c1b19d2"}
Jul 08 18:41:04.541461 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:04.541386    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6s4s7" event={"ID":"d8e3cb9b-b149-443a-af33-487e6f08be18","Type":"ContainerStarted","Data":"f87a02d3c4877dc7be0daa72e616e1453c11d9c2e0a23146fc35b16ebe082a3c"}
Jul 08 18:41:05.547647 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:05.547606    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6s4s7" event={"ID":"d8e3cb9b-b149-443a-af33-487e6f08be18","Type":"ContainerStarted","Data":"3e83163d9d82e70d174a66b1926161ce6770e8f7848994bc1a9f54a87c22c956"}
Jul 08 18:41:05.710955 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:05.710921    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:05.811540 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:05.811462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:05.880695 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:05.880671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:06.007615 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:06.007555    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:06.377403 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:06.377372    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:06.445610 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:06.445577    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:06.587677 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:06.587618    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:06.658544 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:06.658462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:07.556972 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:07.556903    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6s4s7" event={"ID":"d8e3cb9b-b149-443a-af33-487e6f08be18","Type":"ContainerStarted","Data":"3e57f68b4c587d7592e41e61d2615987d22f736761b9921ed172f44ef0158adf"}
Jul 08 18:41:07.577562 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:07.577516    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6s4s7" podStartSLOduration=16.998743249 podStartE2EDuration="23.57749944s" totalImagesPullingTime="6.578756191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:40:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:41:07.57730164 +0000 UTC m=+95.819792758" watchObservedRunningTime="2026-07-08 18:41:07.57749944 +0000 UTC m=+95.819990561"
Jul 08 18:41:07.599787 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:07.599763    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:07.671813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:07.669218    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:07.791514 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:07.791493    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:08.201976 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:08.201951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:10.374222 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.374186    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"]
Jul 08 18:41:10.377345 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.377323    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.380768 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.380748    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 08 18:41:10.381882 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.381855    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 08 18:41:10.381985 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.381908    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 18:41:10.382050 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.381989    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 18:41:10.382050 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.382026    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 08 18:41:10.382050 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.381986    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 18:41:10.385663 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.385645    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8655dcdc69-tl5xq"]
Jul 08 18:41:10.385787 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.385773    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 08 18:41:10.393803 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.393780    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"]
Jul 08 18:41:10.499657 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.499616    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:10.506512 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.506493    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f0b17586-83b1-4a7a-8431-c7630d7b9476-hub\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.506579 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.506545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0b17586-83b1-4a7a-8431-c7630d7b9476-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.506617 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.506586    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f0b17586-83b1-4a7a-8431-c7630d7b9476-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.506617 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.506606    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f0b17586-83b1-4a7a-8431-c7630d7b9476-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.506700 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.506659    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8462\" (UniqueName: \"kubernetes.io/projected/f0b17586-83b1-4a7a-8431-c7630d7b9476-kube-api-access-z8462\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.506700 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.506682    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f0b17586-83b1-4a7a-8431-c7630d7b9476-ca\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.592691 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.592662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:10.607763 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.607745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f0b17586-83b1-4a7a-8431-c7630d7b9476-hub\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.607831 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.607788    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0b17586-83b1-4a7a-8431-c7630d7b9476-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.607831 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.607807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f0b17586-83b1-4a7a-8431-c7630d7b9476-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.607831 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.607823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f0b17586-83b1-4a7a-8431-c7630d7b9476-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.608022 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.608006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8462\" (UniqueName: \"kubernetes.io/projected/f0b17586-83b1-4a7a-8431-c7630d7b9476-kube-api-access-z8462\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.608094 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.608061    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f0b17586-83b1-4a7a-8431-c7630d7b9476-ca\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.608152 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.608107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:41:10.608583 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.608561    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0b17586-83b1-4a7a-8431-c7630d7b9476-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.610270 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.610244    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f0b17586-83b1-4a7a-8431-c7630d7b9476-hub\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.610361 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.610287    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/256c7e40-4220-4c0e-bf44-7dffcc1fb5c3-metrics-tls\") pod \"dns-default-4l5d5\" (UID: \"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3\") " pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:41:10.610562 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.610542    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f0b17586-83b1-4a7a-8431-c7630d7b9476-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.610610 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.610574    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f0b17586-83b1-4a7a-8431-c7630d7b9476-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.610703 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.610689    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f0b17586-83b1-4a7a-8431-c7630d7b9476-ca\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.620168 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.620148    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8462\" (UniqueName: \"kubernetes.io/projected/f0b17586-83b1-4a7a-8431-c7630d7b9476-kube-api-access-z8462\") pod \"cluster-proxy-proxy-agent-5f6779dd79-28xb7\" (UID: \"f0b17586-83b1-4a7a-8431-c7630d7b9476\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.695111 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.695050    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"
Jul 08 18:41:10.819098 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.819071    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7"]
Jul 08 18:41:10.821649 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:41:10.821607    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0b17586_83b1_4a7a_8431_c7630d7b9476.slice/crio-c1adfd9cc0bab71243d1c3e17d4153ef9ac5c22beb3fee6443001ee402daf436 WatchSource:0}: Error finding container c1adfd9cc0bab71243d1c3e17d4153ef9ac5c22beb3fee6443001ee402daf436: Status 404 returned error can't find the container with id c1adfd9cc0bab71243d1c3e17d4153ef9ac5c22beb3fee6443001ee402daf436
Jul 08 18:41:10.895006 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.894982    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rmskx\""
Jul 08 18:41:10.902872 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:10.902855    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:41:11.033942 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:11.033919    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4l5d5"]
Jul 08 18:41:11.035037 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:41:11.035011    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256c7e40_4220_4c0e_bf44_7dffcc1fb5c3.slice/crio-ea98935bdaf66b038bcb612626d1ed891d18b30c1e82b8112347e9f7b58a5ad4 WatchSource:0}: Error finding container ea98935bdaf66b038bcb612626d1ed891d18b30c1e82b8112347e9f7b58a5ad4: Status 404 returned error can't find the container with id ea98935bdaf66b038bcb612626d1ed891d18b30c1e82b8112347e9f7b58a5ad4
Jul 08 18:41:11.413431 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:11.413401    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:41:11.414022 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:11.414000    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c0a4db-2b2f-4365-ba8b-881be307780b-service-ca-bundle\") pod \"router-default-6fdfb86787-4thnt\" (UID: \"54c0a4db-2b2f-4365-ba8b-881be307780b\") " pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:41:11.422440 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:11.422420    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:41:11.556071 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:11.556038    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6fdfb86787-4thnt"]
Jul 08 18:41:11.559226 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:41:11.559201    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c0a4db_2b2f_4365_ba8b_881be307780b.slice/crio-d35b9bfb32e4d239ab92d6ab5952a798ca5cf8cbc5967c2548be4dd02fa6c5c4 WatchSource:0}: Error finding container d35b9bfb32e4d239ab92d6ab5952a798ca5cf8cbc5967c2548be4dd02fa6c5c4: Status 404 returned error can't find the container with id d35b9bfb32e4d239ab92d6ab5952a798ca5cf8cbc5967c2548be4dd02fa6c5c4
Jul 08 18:41:11.572667 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:11.572620    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4l5d5" event={"ID":"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3","Type":"ContainerStarted","Data":"ea98935bdaf66b038bcb612626d1ed891d18b30c1e82b8112347e9f7b58a5ad4"}
Jul 08 18:41:11.573877 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:11.573843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6fdfb86787-4thnt" event={"ID":"54c0a4db-2b2f-4365-ba8b-881be307780b","Type":"ContainerStarted","Data":"d35b9bfb32e4d239ab92d6ab5952a798ca5cf8cbc5967c2548be4dd02fa6c5c4"}
Jul 08 18:41:11.575140 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:11.575110    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7" event={"ID":"f0b17586-83b1-4a7a-8431-c7630d7b9476","Type":"ContainerStarted","Data":"c1adfd9cc0bab71243d1c3e17d4153ef9ac5c22beb3fee6443001ee402daf436"}
Jul 08 18:41:12.581327 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:12.581289    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6fdfb86787-4thnt" event={"ID":"54c0a4db-2b2f-4365-ba8b-881be307780b","Type":"ContainerStarted","Data":"a355315abd7e2c1c5b3ffddc5a333d728c428a83100a803bee115716894ac443"}
Jul 08 18:41:13.422818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:13.422781    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:41:13.425916 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:13.425889    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:41:13.470004 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:13.469930    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6fdfb86787-4thnt" podStartSLOduration=34.46991305 podStartE2EDuration="34.46991305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:40:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:41:12.602988334 +0000 UTC m=+100.845479455" watchObservedRunningTime="2026-07-08 18:41:13.46991305 +0000 UTC m=+101.712404171"
Jul 08 18:41:13.478344 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:13.478322    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fk596"
Jul 08 18:41:13.586044 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:13.586008    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:41:13.587515 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:13.587491    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6fdfb86787-4thnt"
Jul 08 18:41:15.284351 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:15.284321    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:15.386195 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:15.386163    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:15.464153 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:15.464076    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:15.594743 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:15.594714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4l5d5" event={"ID":"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3","Type":"ContainerStarted","Data":"bfa221afb96f7b8c62d7ea8ccac03da5839b0dcd4c33075b36f76b1e0d092b57"}
Jul 08 18:41:15.594896 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:15.594759    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4l5d5" event={"ID":"256c7e40-4220-4c0e-bf44-7dffcc1fb5c3","Type":"ContainerStarted","Data":"2c35141257ba61c91d347c128066ff87f8aadbc9dd1083ec97e05acb674bfead"}
Jul 08 18:41:15.594896 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:15.594829    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:41:15.596803 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:15.596766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7" event={"ID":"f0b17586-83b1-4a7a-8431-c7630d7b9476","Type":"ContainerStarted","Data":"4a984281028d47374a97395286be3f4f43663e0f56b5d52f256e5c8ddc4fc12b"}
Jul 08 18:41:15.596803 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:15.596803    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7" event={"ID":"f0b17586-83b1-4a7a-8431-c7630d7b9476","Type":"ContainerStarted","Data":"5236f4656a0b4a70deb1b496b239305810e818d4c66f44a05c2b86a03a89860a"}
Jul 08 18:41:15.596966 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:15.596816    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7" event={"ID":"f0b17586-83b1-4a7a-8431-c7630d7b9476","Type":"ContainerStarted","Data":"789f5557e339904a418232389d4dcea98455bb5dfb6b5b57d713e09235be1a27"}
Jul 08 18:41:15.616171 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:15.616131    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4l5d5" podStartSLOduration=65.721496435 podStartE2EDuration="1m9.616120713s" totalImagesPullingTime="3.894624278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:41:15.614413058 +0000 UTC m=+103.856904180" watchObservedRunningTime="2026-07-08 18:41:15.616120713 +0000 UTC m=+103.858611834"
Jul 08 18:41:15.634937 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:15.634896    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f6779dd79-28xb7" podStartSLOduration=1.464079579 podStartE2EDuration="5.63488439s" totalImagesPullingTime="4.170804811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:41:15.634394002 +0000 UTC m=+103.876885122" watchObservedRunningTime="2026-07-08 18:41:15.63488439 +0000 UTC m=+103.877375506"
Jul 08 18:41:15.742335 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:15.742276    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:18.213770 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:18.213740    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:18.271937 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:18.271904    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:18.498961 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:18.498898    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:18.585521 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:18.585497    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:18.993926 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:18.993906    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:19.463046 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:19.463020    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:19.519265 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:19.519239    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:20.211057 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:20.211019    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:20.267453 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:20.267425    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:20.390384 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:20.390365    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:41:21.808641 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:21.808601    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:23.668609 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:23.668579    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:23.766286 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:23.766254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:23.888636 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:23.888607    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:23.937552 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:23.937498    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mncmb"]
Jul 08 18:41:23.940571 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:23.940556    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:23.943277 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:23.943175    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 18:41:23.943846 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:23.943828    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 18:41:23.943917 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:23.943828    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 18:41:23.943917 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:23.943896    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 18:41:23.944824 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:23.944806    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 18:41:23.944959 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:23.944825    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 18:41:23.944959 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:23.944848    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-846kr\""
Jul 08 18:41:23.989888 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:23.989854    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:24.083907 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.083884    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:24.101454 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.101431    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.101530 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.101456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.101530 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.101475    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kwv4\" (UniqueName: \"kubernetes.io/projected/0b516475-1994-4ecc-a564-d98a967ca8ee-kube-api-access-9kwv4\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.101530 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.101491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b516475-1994-4ecc-a564-d98a967ca8ee-sys\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.101653 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.101570    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-textfile\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.101653 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.101596    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0b516475-1994-4ecc-a564-d98a967ca8ee-root\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.101653 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.101612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-tls\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.101653 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.101648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-wtmp\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.101837 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.101710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b516475-1994-4ecc-a564-d98a967ca8ee-metrics-client-ca\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.202775 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.202726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-textfile\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.202775 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.202753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0b516475-1994-4ecc-a564-d98a967ca8ee-root\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.202775 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.202769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-tls\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.202970 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.202787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-wtmp\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.202970 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.202819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b516475-1994-4ecc-a564-d98a967ca8ee-metrics-client-ca\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.202970 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.202829    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0b516475-1994-4ecc-a564-d98a967ca8ee-root\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.202970 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.202887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.202970 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.202914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.202970 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.202936    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-wtmp\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.202970 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.202940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kwv4\" (UniqueName: \"kubernetes.io/projected/0b516475-1994-4ecc-a564-d98a967ca8ee-kube-api-access-9kwv4\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.203303 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.202986    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b516475-1994-4ecc-a564-d98a967ca8ee-sys\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.203303 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.203087    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b516475-1994-4ecc-a564-d98a967ca8ee-sys\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.203303 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:41:24.203129    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 18:41:24.203303 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:41:24.203206    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-tls podName:0b516475-1994-4ecc-a564-d98a967ca8ee nodeName:}" failed. No retries permitted until 2026-07-08 18:41:24.703188215 +0000 UTC m=+112.945679328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-tls") pod "node-exporter-mncmb" (UID: "0b516475-1994-4ecc-a564-d98a967ca8ee") : secret "node-exporter-tls" not found
Jul 08 18:41:24.203303 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.203240    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-textfile\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.203530 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.203511    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b516475-1994-4ecc-a564-d98a967ca8ee-metrics-client-ca\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.203566 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.203511    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.205197 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.205181    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.212023 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.212004    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kwv4\" (UniqueName: \"kubernetes.io/projected/0b516475-1994-4ecc-a564-d98a967ca8ee-kube-api-access-9kwv4\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.222848 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.222826    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:24.337542 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.337520    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:24.436961 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.436920    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:24.579055 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.578988    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:24.679997 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.679973    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:24.706079 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.706056    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-tls\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.708151 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.708133    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b516475-1994-4ecc-a564-d98a967ca8ee-node-exporter-tls\") pod \"node-exporter-mncmb\" (UID: \"0b516475-1994-4ecc-a564-d98a967ca8ee\") " pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.780244 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.780220    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:24.849381 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.849359    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mncmb"
Jul 08 18:41:24.861199 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:41:24.861181    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b516475_1994_4ecc_a564_d98a967ca8ee.slice/crio-c9333b42a1fcec4bc17a15b61aa7871f1915f98b3fe9d5b0808ddd72b840efed WatchSource:0}: Error finding container c9333b42a1fcec4bc17a15b61aa7871f1915f98b3fe9d5b0808ddd72b840efed: Status 404 returned error can't find the container with id c9333b42a1fcec4bc17a15b61aa7871f1915f98b3fe9d5b0808ddd72b840efed
Jul 08 18:41:24.908378 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:24.908346    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:25.035145 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:25.035111    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:25.313103 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:25.313031    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:25.379297 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:25.379230    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:25.602791 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:25.602771    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4l5d5"
Jul 08 18:41:25.627405 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:25.627380    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mncmb" event={"ID":"0b516475-1994-4ecc-a564-d98a967ca8ee","Type":"ContainerStarted","Data":"c9333b42a1fcec4bc17a15b61aa7871f1915f98b3fe9d5b0808ddd72b840efed"}
Jul 08 18:41:25.722576 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:25.722538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:25.819240 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:25.819213    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:26.633323 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:26.633292    2563 generic.go:356] "Generic (PLEG): container finished" podID="0b516475-1994-4ecc-a564-d98a967ca8ee" containerID="5353edbb66a58ba1426384048e6771ba14aadbb574d06f92aab8a9eeff366d67" exitCode=0
Jul 08 18:41:26.633481 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:26.633379    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mncmb" event={"ID":"0b516475-1994-4ecc-a564-d98a967ca8ee","Type":"ContainerDied","Data":"5353edbb66a58ba1426384048e6771ba14aadbb574d06f92aab8a9eeff366d67"}
Jul 08 18:41:26.944315 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:26.944243    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:27.045669 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:27.045619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:27.155089 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:27.155059    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:27.333231 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:27.333154    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:27.638240 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:27.638217    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mncmb" event={"ID":"0b516475-1994-4ecc-a564-d98a967ca8ee","Type":"ContainerStarted","Data":"232b924e4d4db6248bb5a3e3fd82810bbca4e3ad6b33b2b36be49d62101d369e"}
Jul 08 18:41:27.638351 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:27.638259    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mncmb" event={"ID":"0b516475-1994-4ecc-a564-d98a967ca8ee","Type":"ContainerStarted","Data":"f9b24518f68630fa80c55394499e2b9d5c09a95101d32b55028168cde165c3c7"}
Jul 08 18:41:28.014203 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:28.014125    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:28.680671 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:28.680610    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:28.787854 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:28.787829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:28.997988 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:28.997894    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:30.235021 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.234987    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:30.236591 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.236551    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mncmb" podStartSLOduration=5.990544169 podStartE2EDuration="7.236537841s" totalImagesPullingTime="1.184547448s" totalInitContainerRuntime="61.446224ms" isStatefulPod=true podCreationTimestamp="2026-07-08 18:41:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:41:27.662464239 +0000 UTC m=+115.904955359" watchObservedRunningTime="2026-07-08 18:41:30.236537841 +0000 UTC m=+118.479028962"
Jul 08 18:41:30.236807 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.236795    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 18:41:30.240310 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.240295    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.243400 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.243371    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 18:41:30.243400 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.243389    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 18:41:30.243568 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.243371    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 18:41:30.243568 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.243422    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8jn0h55u6ju1k\""
Jul 08 18:41:30.243568 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.243379    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 18:41:30.243568 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.243371    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 18:41:30.243568 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.243393    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 18:41:30.243807 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.243794    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4ktbf\""
Jul 08 18:41:30.244719 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.244693    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 18:41:30.244719 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.244700    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 18:41:30.244871 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.244737    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 18:41:30.244871 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.244815    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 18:41:30.245031 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.245018    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 18:41:30.245135 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.245122    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 18:41:30.246425 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.246407    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 18:41:30.249024 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.249008    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 18:41:30.251920 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.251906    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 18:41:30.257402 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.257380    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 18:41:30.345811 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.345792    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.345925 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.345832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.345925 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.345857    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.345925 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.345896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.345925 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.345921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-web-config\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.346112 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.345946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.346112 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.346003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.346112 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.346030    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.346112 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.346053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.346112 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.346097    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.346333 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.346125    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/397b433c-b044-4baa-b7e6-65dbea480647-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.346333 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.346155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/397b433c-b044-4baa-b7e6-65dbea480647-config-out\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.346333 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.346177    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.346333 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.346207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.346333 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.346236    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-config\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.346333 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.346263    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.346333 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.346301    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.346333 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.346317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.346590 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.346337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.346590 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.346355    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kckk\" (UniqueName: \"kubernetes.io/projected/397b433c-b044-4baa-b7e6-65dbea480647-kube-api-access-7kckk\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.430024 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.430000    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:30.447487 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.447463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.447575 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.447504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.447575 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.447532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.447575 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.447559    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.447740 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.447584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kckk\" (UniqueName: \"kubernetes.io/projected/397b433c-b044-4baa-b7e6-65dbea480647-kube-api-access-7kckk\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.447740 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.447611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.447740 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.447667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.447740 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.447693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.447740 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.447721    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.447976 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.447746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-web-config\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.447976 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.447769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.447976 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.447813    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.447976 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.447841    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.447976 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.447867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.448207 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.448056    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.448981 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.448952    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.449114 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.449088    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.449304 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.449277    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.449372 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.449334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/397b433c-b044-4baa-b7e6-65dbea480647-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.449372 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.449364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/397b433c-b044-4baa-b7e6-65dbea480647-config-out\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.449484 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.449390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.449484 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.449429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.449484 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.449467    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-config\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.453022 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.451208    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.453022 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.451551    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.453022 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.451901    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.453022 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.452223    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.453022 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.452558    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.453022 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.452728    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.453022 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.452971    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-web-config\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.453476 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.453044    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.453476 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.453406    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.453476 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.453415    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.453866 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.453826    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.454037 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.454009    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/397b433c-b044-4baa-b7e6-65dbea480647-config-out\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.454500 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.454474    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-config\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.454973 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.454948    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.455882 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.455863    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/397b433c-b044-4baa-b7e6-65dbea480647-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.455973 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.455878    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.460354 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.460333    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kckk\" (UniqueName: \"kubernetes.io/projected/397b433c-b044-4baa-b7e6-65dbea480647-kube-api-access-7kckk\") pod \"prometheus-k8s-0\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.541218 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.541158    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:30.550222 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.550194    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:30.645619 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.645592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:30.702972 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.702950    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 18:41:30.705714 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:41:30.705686    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod397b433c_b044_4baa_b7e6_65dbea480647.slice/crio-1074d0791f2f1f52a329df0a757e2cc3190ba3db1749b21411e503d1305aa626 WatchSource:0}: Error finding container 1074d0791f2f1f52a329df0a757e2cc3190ba3db1749b21411e503d1305aa626: Status 404 returned error can't find the container with id 1074d0791f2f1f52a329df0a757e2cc3190ba3db1749b21411e503d1305aa626
Jul 08 18:41:30.742144 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:30.742126    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:31.652809 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:31.652771    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"397b433c-b044-4baa-b7e6-65dbea480647","Type":"ContainerStarted","Data":"1074d0791f2f1f52a329df0a757e2cc3190ba3db1749b21411e503d1305aa626"}
Jul 08 18:41:32.288691 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:32.288670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:32.386254 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:32.386231    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:32.619997 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:32.619967    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:32.657767 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:32.657742    2563 generic.go:356] "Generic (PLEG): container finished" podID="397b433c-b044-4baa-b7e6-65dbea480647" containerID="d5136a4bed9825c2221a166267f9688f9c96db8eacb942751b08e7c1e7fe26b6" exitCode=0
Jul 08 18:41:32.658138 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:32.657821    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"397b433c-b044-4baa-b7e6-65dbea480647","Type":"ContainerDied","Data":"d5136a4bed9825c2221a166267f9688f9c96db8eacb942751b08e7c1e7fe26b6"}
Jul 08 18:41:33.628366 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:33.628323    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:33.705196 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:33.705166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:35.406656 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:35.406578    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq" podUID="f82b1200-8eb2-418a-ab9c-8f0f559e40e7" containerName="registry" containerID="cri-o://d4abadf7b345421b698c4295f3b1914fe43dc3ccb4edccab2a511167da2ad1e9" gracePeriod=30
Jul 08 18:41:36.550779 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.550755    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:41:36.671854 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.671784    2563 generic.go:356] "Generic (PLEG): container finished" podID="f82b1200-8eb2-418a-ab9c-8f0f559e40e7" containerID="d4abadf7b345421b698c4295f3b1914fe43dc3ccb4edccab2a511167da2ad1e9" exitCode=0
Jul 08 18:41:36.671854 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.671822    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq"
Jul 08 18:41:36.671854 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.671835    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq" event={"ID":"f82b1200-8eb2-418a-ab9c-8f0f559e40e7","Type":"ContainerDied","Data":"d4abadf7b345421b698c4295f3b1914fe43dc3ccb4edccab2a511167da2ad1e9"}
Jul 08 18:41:36.672038 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.671879    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8655dcdc69-tl5xq" event={"ID":"f82b1200-8eb2-418a-ab9c-8f0f559e40e7","Type":"ContainerDied","Data":"0be71f8d8168970476a8480b4060a4c756335d4791d09fd068bf1f9e578ba415"}
Jul 08 18:41:36.672038 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.671900    2563 scope.go:117] "RemoveContainer" containerID="d4abadf7b345421b698c4295f3b1914fe43dc3ccb4edccab2a511167da2ad1e9"
Jul 08 18:41:36.701250 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.701231    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-bound-sa-token\") pod \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") "
Jul 08 18:41:36.701346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.701254    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhgf2\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-kube-api-access-bhgf2\") pod \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") "
Jul 08 18:41:36.701346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.701277    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-certificates\") pod \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") "
Jul 08 18:41:36.701346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.701298    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-trusted-ca\") pod \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") "
Jul 08 18:41:36.701476 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.701355    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-ca-trust-extracted\") pod \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") "
Jul 08 18:41:36.701476 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.701390    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls\") pod \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") "
Jul 08 18:41:36.701476 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.701423    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-image-registry-private-configuration\") pod \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") "
Jul 08 18:41:36.701476 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.701447    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-installation-pull-secrets\") pod \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\" (UID: \"f82b1200-8eb2-418a-ab9c-8f0f559e40e7\") "
Jul 08 18:41:36.702011 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.701949    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f82b1200-8eb2-418a-ab9c-8f0f559e40e7" (UID: "f82b1200-8eb2-418a-ab9c-8f0f559e40e7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:41:36.702011 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.701976    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f82b1200-8eb2-418a-ab9c-8f0f559e40e7" (UID: "f82b1200-8eb2-418a-ab9c-8f0f559e40e7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:41:36.703779 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.703758    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f82b1200-8eb2-418a-ab9c-8f0f559e40e7" (UID: "f82b1200-8eb2-418a-ab9c-8f0f559e40e7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:41:36.703996 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.703976    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-kube-api-access-bhgf2" (OuterVolumeSpecName: "kube-api-access-bhgf2") pod "f82b1200-8eb2-418a-ab9c-8f0f559e40e7" (UID: "f82b1200-8eb2-418a-ab9c-8f0f559e40e7"). InnerVolumeSpecName "kube-api-access-bhgf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:41:36.703996 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.703986    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f82b1200-8eb2-418a-ab9c-8f0f559e40e7" (UID: "f82b1200-8eb2-418a-ab9c-8f0f559e40e7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:41:36.704099 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.704063    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f82b1200-8eb2-418a-ab9c-8f0f559e40e7" (UID: "f82b1200-8eb2-418a-ab9c-8f0f559e40e7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:41:36.704135 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.704097    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f82b1200-8eb2-418a-ab9c-8f0f559e40e7" (UID: "f82b1200-8eb2-418a-ab9c-8f0f559e40e7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:41:36.712241 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.712217    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f82b1200-8eb2-418a-ab9c-8f0f559e40e7" (UID: "f82b1200-8eb2-418a-ab9c-8f0f559e40e7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:41:36.775893 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.775877    2563 scope.go:117] "RemoveContainer" containerID="d4abadf7b345421b698c4295f3b1914fe43dc3ccb4edccab2a511167da2ad1e9"
Jul 08 18:41:36.776181 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:41:36.776160    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4abadf7b345421b698c4295f3b1914fe43dc3ccb4edccab2a511167da2ad1e9\": container with ID starting with d4abadf7b345421b698c4295f3b1914fe43dc3ccb4edccab2a511167da2ad1e9 not found: ID does not exist" containerID="d4abadf7b345421b698c4295f3b1914fe43dc3ccb4edccab2a511167da2ad1e9"
Jul 08 18:41:36.776255 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.776188    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4abadf7b345421b698c4295f3b1914fe43dc3ccb4edccab2a511167da2ad1e9"} err="failed to get container status \"d4abadf7b345421b698c4295f3b1914fe43dc3ccb4edccab2a511167da2ad1e9\": rpc error: code = NotFound desc = could not find container \"d4abadf7b345421b698c4295f3b1914fe43dc3ccb4edccab2a511167da2ad1e9\": container with ID starting with d4abadf7b345421b698c4295f3b1914fe43dc3ccb4edccab2a511167da2ad1e9 not found: ID does not exist"
Jul 08 18:41:36.802930 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.802911    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-bound-sa-token\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:41:36.802930 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.802931    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhgf2\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-kube-api-access-bhgf2\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:41:36.803038 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.802941    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-certificates\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:41:36.803038 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.802949    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-trusted-ca\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:41:36.803038 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.802957    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-ca-trust-extracted\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:41:36.803038 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.802965    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-registry-tls\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:41:36.803038 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.802973    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-image-registry-private-configuration\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:41:36.803038 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.802981    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f82b1200-8eb2-418a-ab9c-8f0f559e40e7-installation-pull-secrets\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:41:36.996109 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:36.996061    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8655dcdc69-tl5xq"]
Jul 08 18:41:37.000546 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:37.000517    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8655dcdc69-tl5xq"]
Jul 08 18:41:37.537576 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:37.537544    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:37.633395 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:37.633356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:37.679376 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:37.679339    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"397b433c-b044-4baa-b7e6-65dbea480647","Type":"ContainerStarted","Data":"194e568be0105facc38fc73d8f9af180aba27ff5963849adfa8ae636c0c9c123"}
Jul 08 18:41:37.679591 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:37.679438    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"397b433c-b044-4baa-b7e6-65dbea480647","Type":"ContainerStarted","Data":"983ff32eaa97666fd9b82be74b4a3776ce5cbf243920b617740df0dde9ddea9e"}
Jul 08 18:41:38.223715 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:38.223683    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f82b1200-8eb2-418a-ab9c-8f0f559e40e7" path="/var/lib/kubelet/pods/f82b1200-8eb2-418a-ab9c-8f0f559e40e7/volumes"
Jul 08 18:41:38.526813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:38.526729    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:38.628591 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:38.628566    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:39.628004 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:39.627973    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:39.682135 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:39.682113    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:39.688883 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:39.688862    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"397b433c-b044-4baa-b7e6-65dbea480647","Type":"ContainerStarted","Data":"e5ceb179ee059f24a8a8788cefb9648d560309c1b2aff8a8b86542d338c3913b"}
Jul 08 18:41:39.688958 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:39.688915    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"397b433c-b044-4baa-b7e6-65dbea480647","Type":"ContainerStarted","Data":"840c93817ce778dd1fe060dbd2d2afb8facd8b4eaba0323d5ac4304a89f88ae8"}
Jul 08 18:41:39.688958 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:39.688941    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"397b433c-b044-4baa-b7e6-65dbea480647","Type":"ContainerStarted","Data":"f036cacb7bd81a8c9e6aaf51dbf0c43734c1c40c18de272835be1523501ad043"}
Jul 08 18:41:39.689038 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:39.688970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"397b433c-b044-4baa-b7e6-65dbea480647","Type":"ContainerStarted","Data":"1ff1944882d17fe491d7e5cadcdb3d88a4318e6c0ed593bd6eceb570818bfa45"}
Jul 08 18:41:39.719578 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:39.719533    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.8856271740000001 podStartE2EDuration="9.719514976s" totalImagesPullingTime="7.814669347s" totalInitContainerRuntime="19.218455ms" isStatefulPod=false podCreationTimestamp="2026-07-08 18:41:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:41:39.717381212 +0000 UTC m=+127.959872370" watchObservedRunningTime="2026-07-08 18:41:39.719514976 +0000 UTC m=+127.962006097"
Jul 08 18:41:40.550823 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:40.550777    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:41:41.820888 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:41.820858    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:41.881257 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:41.881232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:42.043147 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:42.043120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs\") pod \"network-metrics-daemon-r4p8h\" (UID: \"d580cb38-0201-47b0-9d32-6a24141ad0ce\") " pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:41:42.045220 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:42.045203    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d580cb38-0201-47b0-9d32-6a24141ad0ce-metrics-certs\") pod \"network-metrics-daemon-r4p8h\" (UID: \"d580cb38-0201-47b0-9d32-6a24141ad0ce\") " pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:41:42.337590 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:42.337568    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sc5vc\""
Jul 08 18:41:42.344901 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:42.344885    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4p8h"
Jul 08 18:41:42.420752 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:42.420730    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:42.471252 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:42.471227    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r4p8h"]
Jul 08 18:41:42.474053 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:41:42.474025    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd580cb38_0201_47b0_9d32_6a24141ad0ce.slice/crio-b32650fe16b31bfa69bee9b2d4cdbcee56bbf0e5465113c0f5e440e4a646a3df WatchSource:0}: Error finding container b32650fe16b31bfa69bee9b2d4cdbcee56bbf0e5465113c0f5e440e4a646a3df: Status 404 returned error can't find the container with id b32650fe16b31bfa69bee9b2d4cdbcee56bbf0e5465113c0f5e440e4a646a3df
Jul 08 18:41:42.701743 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:42.701712    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r4p8h" event={"ID":"d580cb38-0201-47b0-9d32-6a24141ad0ce","Type":"ContainerStarted","Data":"b32650fe16b31bfa69bee9b2d4cdbcee56bbf0e5465113c0f5e440e4a646a3df"}
Jul 08 18:41:43.150046 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:43.150008    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:43.224446 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:43.224412    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:43.707412 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:43.707381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r4p8h" event={"ID":"d580cb38-0201-47b0-9d32-6a24141ad0ce","Type":"ContainerStarted","Data":"614de0e25979d4f0522a04f847031ec29ad04c9db464e7a3958bd8714f52948d"}
Jul 08 18:41:44.712583 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:44.712547    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r4p8h" event={"ID":"d580cb38-0201-47b0-9d32-6a24141ad0ce","Type":"ContainerStarted","Data":"064c92edf0b9cdbdf832de83f5783a2a494332a8214cacd71806d8066ecbf4b8"}
Jul 08 18:41:44.731265 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:44.731216    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r4p8h" podStartSLOduration=131.593237993 podStartE2EDuration="2m12.731202986s" totalImagesPullingTime="1.137964993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:41:44.730222106 +0000 UTC m=+132.972713227" watchObservedRunningTime="2026-07-08 18:41:44.731202986 +0000 UTC m=+132.973694107"
Jul 08 18:41:44.828976 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:44.828945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:44.889157 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:44.889134    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:45.395720 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:45.395697    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:45.593526 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:45.593505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:54.021954 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:54.021925    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:54.087011 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:41:54.086984    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:42:00.455793 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:00.455766    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:42:00.528486 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:00.528462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:42:01.454098 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:01.454062    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:42:01.517658 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:01.517619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:42:06.882540 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:06.882504    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:42:06.985676 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:06.985653    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:42:07.085338 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:07.085315    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:42:15.366056 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:15.366022    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:42:15.431284 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:15.431257    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:42:30.551006 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:30.550941    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:30.564542 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:30.564522    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:30.878005 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:30.877984    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:43.314218 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:43.314182    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:42:43.601574 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:43.601552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:42:48.729834 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.729800    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 18:42:48.730640 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.730574    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="prometheus" containerID="cri-o://983ff32eaa97666fd9b82be74b4a3776ce5cbf243920b617740df0dde9ddea9e" gracePeriod=600
Jul 08 18:42:48.734803 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.730819    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="kube-rbac-proxy" containerID="cri-o://840c93817ce778dd1fe060dbd2d2afb8facd8b4eaba0323d5ac4304a89f88ae8" gracePeriod=600
Jul 08 18:42:48.734803 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.730980    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e5ceb179ee059f24a8a8788cefb9648d560309c1b2aff8a8b86542d338c3913b" gracePeriod=600
Jul 08 18:42:48.734803 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.731030    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="config-reloader" containerID="cri-o://194e568be0105facc38fc73d8f9af180aba27ff5963849adfa8ae636c0c9c123" gracePeriod=600
Jul 08 18:42:48.734803 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.730986    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="kube-rbac-proxy-web" containerID="cri-o://f036cacb7bd81a8c9e6aaf51dbf0c43734c1c40c18de272835be1523501ad043" gracePeriod=600
Jul 08 18:42:48.734803 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.731173    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="thanos-sidecar" containerID="cri-o://1ff1944882d17fe491d7e5cadcdb3d88a4318e6c0ed593bd6eceb570818bfa45" gracePeriod=600
Jul 08 18:42:48.926909 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.926882    2563 generic.go:356] "Generic (PLEG): container finished" podID="397b433c-b044-4baa-b7e6-65dbea480647" containerID="e5ceb179ee059f24a8a8788cefb9648d560309c1b2aff8a8b86542d338c3913b" exitCode=0
Jul 08 18:42:48.926909 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.926903    2563 generic.go:356] "Generic (PLEG): container finished" podID="397b433c-b044-4baa-b7e6-65dbea480647" containerID="840c93817ce778dd1fe060dbd2d2afb8facd8b4eaba0323d5ac4304a89f88ae8" exitCode=0
Jul 08 18:42:48.926909 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.926910    2563 generic.go:356] "Generic (PLEG): container finished" podID="397b433c-b044-4baa-b7e6-65dbea480647" containerID="f036cacb7bd81a8c9e6aaf51dbf0c43734c1c40c18de272835be1523501ad043" exitCode=0
Jul 08 18:42:48.927148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.926916    2563 generic.go:356] "Generic (PLEG): container finished" podID="397b433c-b044-4baa-b7e6-65dbea480647" containerID="1ff1944882d17fe491d7e5cadcdb3d88a4318e6c0ed593bd6eceb570818bfa45" exitCode=0
Jul 08 18:42:48.927148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.926921    2563 generic.go:356] "Generic (PLEG): container finished" podID="397b433c-b044-4baa-b7e6-65dbea480647" containerID="194e568be0105facc38fc73d8f9af180aba27ff5963849adfa8ae636c0c9c123" exitCode=0
Jul 08 18:42:48.927148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.926926    2563 generic.go:356] "Generic (PLEG): container finished" podID="397b433c-b044-4baa-b7e6-65dbea480647" containerID="983ff32eaa97666fd9b82be74b4a3776ce5cbf243920b617740df0dde9ddea9e" exitCode=0
Jul 08 18:42:48.927148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.926955    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"397b433c-b044-4baa-b7e6-65dbea480647","Type":"ContainerDied","Data":"e5ceb179ee059f24a8a8788cefb9648d560309c1b2aff8a8b86542d338c3913b"}
Jul 08 18:42:48.927148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.927074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"397b433c-b044-4baa-b7e6-65dbea480647","Type":"ContainerDied","Data":"840c93817ce778dd1fe060dbd2d2afb8facd8b4eaba0323d5ac4304a89f88ae8"}
Jul 08 18:42:48.927148 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.927120    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"397b433c-b044-4baa-b7e6-65dbea480647","Type":"ContainerDied","Data":"f036cacb7bd81a8c9e6aaf51dbf0c43734c1c40c18de272835be1523501ad043"}
Jul 08 18:42:48.927386 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.927159    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"397b433c-b044-4baa-b7e6-65dbea480647","Type":"ContainerDied","Data":"1ff1944882d17fe491d7e5cadcdb3d88a4318e6c0ed593bd6eceb570818bfa45"}
Jul 08 18:42:48.927386 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.927201    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"397b433c-b044-4baa-b7e6-65dbea480647","Type":"ContainerDied","Data":"194e568be0105facc38fc73d8f9af180aba27ff5963849adfa8ae636c0c9c123"}
Jul 08 18:42:48.927386 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.927243    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"397b433c-b044-4baa-b7e6-65dbea480647","Type":"ContainerDied","Data":"983ff32eaa97666fd9b82be74b4a3776ce5cbf243920b617740df0dde9ddea9e"}
Jul 08 18:42:48.960771 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:48.960747    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:49.096287 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096264    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-kube-rbac-proxy\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096413 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096298    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-config\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096413 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096324    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-kubelet-serving-ca-bundle\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096413 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096360    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-grpc-tls\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096413 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096390    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096595 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096429    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kckk\" (UniqueName: \"kubernetes.io/projected/397b433c-b044-4baa-b7e6-65dbea480647-kube-api-access-7kckk\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096595 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096457    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/397b433c-b044-4baa-b7e6-65dbea480647-tls-assets\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096595 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096481    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/397b433c-b044-4baa-b7e6-65dbea480647-config-out\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096595 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096504    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-serving-certs-ca-bundle\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096595 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096528    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-2\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096595 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096564    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-thanos-prometheus-http-client-file\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096595 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096596    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-tls\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096963 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096651    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-trusted-ca-bundle\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096963 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096677    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-1\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096963 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096704    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-metrics-client-certs\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096963 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096751    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-metrics-client-ca\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096963 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096783    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-0\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096963 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096777    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:42:49.096963 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096813    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-web-config\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096963 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096844    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.096963 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.096874    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-db\") pod \"397b433c-b044-4baa-b7e6-65dbea480647\" (UID: \"397b433c-b044-4baa-b7e6-65dbea480647\") "
Jul 08 18:42:49.097391 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.097069    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.097391 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.097338    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:42:49.098270 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.098235    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:42:49.098740 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.098714    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:42:49.099017 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.098979    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-config" (OuterVolumeSpecName: "config") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:42:49.099017 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.098992    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/397b433c-b044-4baa-b7e6-65dbea480647-kube-api-access-7kckk" (OuterVolumeSpecName: "kube-api-access-7kckk") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "kube-api-access-7kckk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:42:49.099191 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.099045    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:42:49.099191 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.099087    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:42:49.099191 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.099113    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/397b433c-b044-4baa-b7e6-65dbea480647-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:42:49.099420 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.099393    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:42:49.100424 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.100012    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397b433c-b044-4baa-b7e6-65dbea480647-config-out" (OuterVolumeSpecName: "config-out") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:42:49.100424 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.100096    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:42:49.100424 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.100375    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:42:49.100607 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.100446    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:42:49.100607 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.100540    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:42:49.100884 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.100862    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:42:49.101331 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.101313    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:42:49.101563 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.101547    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:42:49.101817 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.101792    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:42:49.109992 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.109970    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-web-config" (OuterVolumeSpecName: "web-config") pod "397b433c-b044-4baa-b7e6-65dbea480647" (UID: "397b433c-b044-4baa-b7e6-65dbea480647"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:42:49.197344 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197323    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197344 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197343    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kckk\" (UniqueName: \"kubernetes.io/projected/397b433c-b044-4baa-b7e6-65dbea480647-kube-api-access-7kckk\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197453 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197354    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/397b433c-b044-4baa-b7e6-65dbea480647-tls-assets\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197453 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197363    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/397b433c-b044-4baa-b7e6-65dbea480647-config-out\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197453 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197371    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197453 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197379    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197453 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197387    2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197453 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197396    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197453 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197404    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197453 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197412    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197453 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197420    2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-metrics-client-certs\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197453 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197427    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-configmap-metrics-client-ca\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197453 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197436    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197788 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197462    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-web-config\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197788 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197471    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197788 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197480    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/397b433c-b044-4baa-b7e6-65dbea480647-prometheus-k8s-db\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197788 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197488    2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-kube-rbac-proxy\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197788 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197496    2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-config\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.197788 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.197505    2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/397b433c-b044-4baa-b7e6-65dbea480647-secret-grpc-tls\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 18:42:49.933438 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.933412    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"397b433c-b044-4baa-b7e6-65dbea480647","Type":"ContainerDied","Data":"1074d0791f2f1f52a329df0a757e2cc3190ba3db1749b21411e503d1305aa626"}
Jul 08 18:42:49.933783 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.933441    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:49.933783 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.933487    2563 scope.go:117] "RemoveContainer" containerID="e5ceb179ee059f24a8a8788cefb9648d560309c1b2aff8a8b86542d338c3913b"
Jul 08 18:42:49.941096 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.941040    2563 scope.go:117] "RemoveContainer" containerID="840c93817ce778dd1fe060dbd2d2afb8facd8b4eaba0323d5ac4304a89f88ae8"
Jul 08 18:42:49.947903 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.947885    2563 scope.go:117] "RemoveContainer" containerID="f036cacb7bd81a8c9e6aaf51dbf0c43734c1c40c18de272835be1523501ad043"
Jul 08 18:42:49.953971 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.953957    2563 scope.go:117] "RemoveContainer" containerID="1ff1944882d17fe491d7e5cadcdb3d88a4318e6c0ed593bd6eceb570818bfa45"
Jul 08 18:42:49.957277 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.957247    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 18:42:49.960565 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.960549    2563 scope.go:117] "RemoveContainer" containerID="194e568be0105facc38fc73d8f9af180aba27ff5963849adfa8ae636c0c9c123"
Jul 08 18:42:49.962387 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.962367    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 18:42:49.966991 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.966972    2563 scope.go:117] "RemoveContainer" containerID="983ff32eaa97666fd9b82be74b4a3776ce5cbf243920b617740df0dde9ddea9e"
Jul 08 18:42:49.973342 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.973327    2563 scope.go:117] "RemoveContainer" containerID="d5136a4bed9825c2221a166267f9688f9c96db8eacb942751b08e7c1e7fe26b6"
Jul 08 18:42:49.987375 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987356    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 18:42:49.987559 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987549    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f82b1200-8eb2-418a-ab9c-8f0f559e40e7" containerName="registry"
Jul 08 18:42:49.987598 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987560    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f82b1200-8eb2-418a-ab9c-8f0f559e40e7" containerName="registry"
Jul 08 18:42:49.987598 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987569    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="config-reloader"
Jul 08 18:42:49.987598 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987574    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="config-reloader"
Jul 08 18:42:49.987598 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987583    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="kube-rbac-proxy"
Jul 08 18:42:49.987598 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987588    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="kube-rbac-proxy"
Jul 08 18:42:49.987598 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987594    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="kube-rbac-proxy-thanos"
Jul 08 18:42:49.987598 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987599    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="kube-rbac-proxy-thanos"
Jul 08 18:42:49.987813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987608    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="prometheus"
Jul 08 18:42:49.987813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987613    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="prometheus"
Jul 08 18:42:49.987813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987634    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="kube-rbac-proxy-web"
Jul 08 18:42:49.987813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987642    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="kube-rbac-proxy-web"
Jul 08 18:42:49.987813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987655    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="init-config-reloader"
Jul 08 18:42:49.987813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987662    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="init-config-reloader"
Jul 08 18:42:49.987813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987667    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="thanos-sidecar"
Jul 08 18:42:49.987813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987672    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="thanos-sidecar"
Jul 08 18:42:49.987813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987709    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="kube-rbac-proxy"
Jul 08 18:42:49.987813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987716    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f82b1200-8eb2-418a-ab9c-8f0f559e40e7" containerName="registry"
Jul 08 18:42:49.987813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987722    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="config-reloader"
Jul 08 18:42:49.987813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987727    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="thanos-sidecar"
Jul 08 18:42:49.987813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987733    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="kube-rbac-proxy-thanos"
Jul 08 18:42:49.987813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987739    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="prometheus"
Jul 08 18:42:49.987813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.987744    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="397b433c-b044-4baa-b7e6-65dbea480647" containerName="kube-rbac-proxy-web"
Jul 08 18:42:49.990700 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.990688    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:49.993378 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.993362    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 18:42:49.993597 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.993581    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 18:42:49.993597 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.993591    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 18:42:49.993739 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.993705    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4ktbf\""
Jul 08 18:42:49.993938 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.993925    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 18:42:49.994243 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.994223    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 18:42:49.995128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.994957    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8jn0h55u6ju1k\""
Jul 08 18:42:49.995128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.995000    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 18:42:49.995128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.995005    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 18:42:49.995128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.995013    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 18:42:49.995128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.994962    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 18:42:49.995780 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.995759    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 18:42:49.995951 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.995931    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 18:42:49.996153 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.996127    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 18:42:49.996240 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.996197    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 18:42:49.999077 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:49.999023    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 18:42:50.000210 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.000195    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 18:42:50.007372 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.007354    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 18:42:50.102395 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.102485 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102401    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.102485 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.102485 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.102592 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.102592 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.102592 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102555    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-config\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.102592 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102570    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.102802 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102605    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqt2r\" (UniqueName: \"kubernetes.io/projected/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-kube-api-access-pqt2r\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.102802 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.102802 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.102802 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102759    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.102802 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102798    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.103040 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.103040 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.103040 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.103040 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.103040 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102934    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.103040 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.103040 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.102994    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.203664 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.203636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.203664 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.203669    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.203813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.203688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.203813 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.203808    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.203909 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.203840    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.203909 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.203870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.203909 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.203895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204058 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.203919    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204058 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.203945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204058 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.203972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204058 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.203997    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204058 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.204027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-config\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204058 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.204051    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204335 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.204054    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204335 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.204103    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqt2r\" (UniqueName: \"kubernetes.io/projected/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-kube-api-access-pqt2r\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204335 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.204137    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204335 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.204169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204335 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.204209    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204335 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.204250    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204335 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.204274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204335 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.204303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204335 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.204328    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204788 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.204389    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204788 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.204497    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.204956 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.204936    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.205165 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.205139    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.206748 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.206723    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.207081 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.207043    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.207159 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.207095    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.207159 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.207097    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.207616 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.207592    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.207824 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.207801    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.208264 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.208245    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.209072 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.209034    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.209202 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.209184    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-config\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.209442 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.209422    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.209522 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.209511    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.209577 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.209513    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.214420 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.210193    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.216248 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.216225    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqt2r\" (UniqueName: \"kubernetes.io/projected/ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd-kube-api-access-pqt2r\") pod \"prometheus-k8s-0\" (UID: \"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.223238 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.223217    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="397b433c-b044-4baa-b7e6-65dbea480647" path="/var/lib/kubelet/pods/397b433c-b044-4baa-b7e6-65dbea480647/volumes"
Jul 08 18:42:50.299712 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.299659    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:42:50.435497 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.435462    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 18:42:50.438284 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:42:50.438261    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3bfcb2_7dac_4951_a18f_2a8caeed9fdd.slice/crio-165dab558fbbb951a885cd5c341f5de0ca8df0304a59670bf9a863a83817c7c1 WatchSource:0}: Error finding container 165dab558fbbb951a885cd5c341f5de0ca8df0304a59670bf9a863a83817c7c1: Status 404 returned error can't find the container with id 165dab558fbbb951a885cd5c341f5de0ca8df0304a59670bf9a863a83817c7c1
Jul 08 18:42:50.939867 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.939837    2563 generic.go:356] "Generic (PLEG): container finished" podID="ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd" containerID="fe77afd4f07720768446977f1263af19b52e0ef7b42b478d0113959b06da76f9" exitCode=0
Jul 08 18:42:50.940189 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.939888    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd","Type":"ContainerDied","Data":"fe77afd4f07720768446977f1263af19b52e0ef7b42b478d0113959b06da76f9"}
Jul 08 18:42:50.940189 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:50.939942    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd","Type":"ContainerStarted","Data":"165dab558fbbb951a885cd5c341f5de0ca8df0304a59670bf9a863a83817c7c1"}
Jul 08 18:42:51.946964 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:51.946935    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd","Type":"ContainerStarted","Data":"072f8897be0707cd01658b81192d5168f5b3256817deb46e78fe59ab126b5cff"}
Jul 08 18:42:51.947305 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:51.946996    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd","Type":"ContainerStarted","Data":"4be1457f41647c0ec1402dec9a92b5e50f5ff4799e431adb9c8a3ac2b1cf36c9"}
Jul 08 18:42:51.947305 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:51.947023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd","Type":"ContainerStarted","Data":"6613b459a87f664a45d9d389491453b5b30288294fcafc0f7b385d316e3041d9"}
Jul 08 18:42:51.947305 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:51.947046    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd","Type":"ContainerStarted","Data":"7a36e761a9187a5912fbc0702c760d2f245c7798a7abc54528d50dfc7614420a"}
Jul 08 18:42:51.947305 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:51.947083    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd","Type":"ContainerStarted","Data":"a51a47ea2ad69d5fb8efd0cac7025b15c9645270265d87555295d7e3d8608ee4"}
Jul 08 18:42:51.947305 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:51.947107    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd","Type":"ContainerStarted","Data":"66f61d7beb7b7829cc832550bf9c93eae2a1be41b68f9c2bf85df5e59449b117"}
Jul 08 18:42:51.977987 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:51.977921    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.958845168 podStartE2EDuration="2.977905485s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.060317ms" isStatefulPod=false podCreationTimestamp="2026-07-08 18:42:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:42:51.975583797 +0000 UTC m=+200.218074917" watchObservedRunningTime="2026-07-08 18:42:51.977905485 +0000 UTC m=+200.220396607"
Jul 08 18:42:52.601618 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:52.601584    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:42:52.686137 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:52.686107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:42:55.300346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:42:55.300317    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:43:03.930279 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:43:03.930247    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:43:03.993824 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:43:03.993794    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:43:04.055986 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:43:04.055959    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:43:29.274434 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:43:29.274396    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:43:50.300291 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:43:50.300266    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:43:50.314918 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:43:50.314895    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:43:51.154797 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:43:51.154772    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 18:43:58.613203 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:43:58.613132    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:43:58.674703 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:43:58.674673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:44:05.956013 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:05.955979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:44:06.023324 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:06.023301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:44:10.479295 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:10.479270    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:44:10.544449 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:10.544419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:44:15.364230 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:15.364181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:44:15.463636 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:15.463597    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:44:15.520848 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:15.520825    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:44:17.368107 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:17.368069    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:44:17.470703 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:17.470669    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:44:17.573306 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:17.573279    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:44:23.656009 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:23.655975    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:44:23.727605 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:23.727574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:44:32.095172 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:32.095145    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 18:44:32.098303 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:32.098282    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 18:44:32.102989 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:32.102969    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 18:44:36.004318 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:36.004283    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:44:55.282143 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:55.282116    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:44:55.374613 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:44:55.374586    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:27.131401 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:27.131332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:29.032060 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:29.032029    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:30.754019 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:30.753989    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:30.852582 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:30.852553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:31.847777 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:31.847746    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:31.985000 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:31.984974    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:33.009399 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:33.009370    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:33.117657 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:33.117616    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:35.016936 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:35.016909    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:35.424384 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:35.424356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:37.556666 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:37.556639    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:37.799314 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:37.799290    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:42.885688 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:42.885660    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:43.529470 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:43.529438    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:43.625396 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:43.625353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:43.709233 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:43.709212    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:49.926723 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:49.926692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:50.041871 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:50.041846    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:51.797667 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:51.797635    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:58.140597 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:58.140567    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:58.240947 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:45:58.240922    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:06.575682 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:06.575648    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:06.666874 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:06.666849    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:06.996176 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:06.996139    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:07.303868 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.303803    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:07.404025 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.403992    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:07.468654 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.468619    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"]
Jul 08 18:46:07.471675 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.471653    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.474931 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.474913    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 18:46:07.475215 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.475200    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 18:46:07.475554 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.475533    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 18:46:07.475688 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.475655    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-56jvk\""
Jul 08 18:46:07.476221 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.476205    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 18:46:07.494202 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.494177    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"]
Jul 08 18:46:07.513585 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.513564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36ecd5f9-267f-4a9a-86a4-a02c8c37b676-tmp\") pod \"opendatahub-operator-controller-manager-6c5cf545b9-8flvw\" (UID: \"36ecd5f9-267f-4a9a-86a4-a02c8c37b676\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.513688 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.513600    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36ecd5f9-267f-4a9a-86a4-a02c8c37b676-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c5cf545b9-8flvw\" (UID: \"36ecd5f9-267f-4a9a-86a4-a02c8c37b676\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.513688 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.513640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36ecd5f9-267f-4a9a-86a4-a02c8c37b676-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c5cf545b9-8flvw\" (UID: \"36ecd5f9-267f-4a9a-86a4-a02c8c37b676\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.513761 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.513696    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36ecd5f9-267f-4a9a-86a4-a02c8c37b676-manifests\") pod \"opendatahub-operator-controller-manager-6c5cf545b9-8flvw\" (UID: \"36ecd5f9-267f-4a9a-86a4-a02c8c37b676\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.513761 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.513720    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6zgp\" (UniqueName: \"kubernetes.io/projected/36ecd5f9-267f-4a9a-86a4-a02c8c37b676-kube-api-access-z6zgp\") pod \"opendatahub-operator-controller-manager-6c5cf545b9-8flvw\" (UID: \"36ecd5f9-267f-4a9a-86a4-a02c8c37b676\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.587016 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.586960    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:07.614511 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.614484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6zgp\" (UniqueName: \"kubernetes.io/projected/36ecd5f9-267f-4a9a-86a4-a02c8c37b676-kube-api-access-z6zgp\") pod \"opendatahub-operator-controller-manager-6c5cf545b9-8flvw\" (UID: \"36ecd5f9-267f-4a9a-86a4-a02c8c37b676\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.614602 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.614523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36ecd5f9-267f-4a9a-86a4-a02c8c37b676-tmp\") pod \"opendatahub-operator-controller-manager-6c5cf545b9-8flvw\" (UID: \"36ecd5f9-267f-4a9a-86a4-a02c8c37b676\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.614602 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.614546    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36ecd5f9-267f-4a9a-86a4-a02c8c37b676-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c5cf545b9-8flvw\" (UID: \"36ecd5f9-267f-4a9a-86a4-a02c8c37b676\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.614718 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.614658    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36ecd5f9-267f-4a9a-86a4-a02c8c37b676-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c5cf545b9-8flvw\" (UID: \"36ecd5f9-267f-4a9a-86a4-a02c8c37b676\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.614761 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.614744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36ecd5f9-267f-4a9a-86a4-a02c8c37b676-manifests\") pod \"opendatahub-operator-controller-manager-6c5cf545b9-8flvw\" (UID: \"36ecd5f9-267f-4a9a-86a4-a02c8c37b676\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.615031 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.615007    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36ecd5f9-267f-4a9a-86a4-a02c8c37b676-manifests\") pod \"opendatahub-operator-controller-manager-6c5cf545b9-8flvw\" (UID: \"36ecd5f9-267f-4a9a-86a4-a02c8c37b676\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.616893 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.616872    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36ecd5f9-267f-4a9a-86a4-a02c8c37b676-tmp\") pod \"opendatahub-operator-controller-manager-6c5cf545b9-8flvw\" (UID: \"36ecd5f9-267f-4a9a-86a4-a02c8c37b676\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.617065 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.617048    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36ecd5f9-267f-4a9a-86a4-a02c8c37b676-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c5cf545b9-8flvw\" (UID: \"36ecd5f9-267f-4a9a-86a4-a02c8c37b676\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.617106 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.617048    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36ecd5f9-267f-4a9a-86a4-a02c8c37b676-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c5cf545b9-8flvw\" (UID: \"36ecd5f9-267f-4a9a-86a4-a02c8c37b676\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.628647 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.628612    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6zgp\" (UniqueName: \"kubernetes.io/projected/36ecd5f9-267f-4a9a-86a4-a02c8c37b676-kube-api-access-z6zgp\") pod \"opendatahub-operator-controller-manager-6c5cf545b9-8flvw\" (UID: \"36ecd5f9-267f-4a9a-86a4-a02c8c37b676\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.687219 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.687194    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:07.781352 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.781333    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:07.810566 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.810539    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:07.908221 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.908197    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:07.912506 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.912486    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"]
Jul 08 18:46:07.919734 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:46:07.919711    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36ecd5f9_267f_4a9a_86a4_a02c8c37b676.slice/crio-eacb759757be13a83f0b813050d5fa6a0d942c0c498f21486985d34afd23b82d WatchSource:0}: Error finding container eacb759757be13a83f0b813050d5fa6a0d942c0c498f21486985d34afd23b82d: Status 404 returned error can't find the container with id eacb759757be13a83f0b813050d5fa6a0d942c0c498f21486985d34afd23b82d
Jul 08 18:46:07.921346 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.921329    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 18:46:07.984542 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:07.984522    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:08.585418 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:08.585392    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw" event={"ID":"36ecd5f9-267f-4a9a-86a4-a02c8c37b676","Type":"ContainerStarted","Data":"eacb759757be13a83f0b813050d5fa6a0d942c0c498f21486985d34afd23b82d"}
Jul 08 18:46:11.599427 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:11.599399    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw" event={"ID":"36ecd5f9-267f-4a9a-86a4-a02c8c37b676","Type":"ContainerStarted","Data":"699d1d10256bd9425881683cbc0a187f75146fe07f19a44d45d95f439dbfe85f"}
Jul 08 18:46:12.604047 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:12.604014    2563 generic.go:356] "Generic (PLEG): container finished" podID="36ecd5f9-267f-4a9a-86a4-a02c8c37b676" containerID="699d1d10256bd9425881683cbc0a187f75146fe07f19a44d45d95f439dbfe85f" exitCode=0
Jul 08 18:46:12.604408 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:12.604103    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw" event={"ID":"36ecd5f9-267f-4a9a-86a4-a02c8c37b676","Type":"ContainerDied","Data":"699d1d10256bd9425881683cbc0a187f75146fe07f19a44d45d95f439dbfe85f"}
Jul 08 18:46:13.610054 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:13.610024    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw" event={"ID":"36ecd5f9-267f-4a9a-86a4-a02c8c37b676","Type":"ContainerStarted","Data":"81705f0a749a16605455cbfb652ea5fd87547a315ecb762735c228b7015c22a5"}
Jul 08 18:46:13.610414 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:13.610134    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:13.636043 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:13.635997    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw" podStartSLOduration=2.044703396 podStartE2EDuration="6.635980248s" totalImagesPullingTime="3.505520207s" totalInitContainerRuntime="1.085756645s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:46:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:13.634078012 +0000 UTC m=+401.876569145" watchObservedRunningTime="2026-07-08 18:46:13.635980248 +0000 UTC m=+401.878471370"
Jul 08 18:46:16.073374 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:16.073340    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:16.175015 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:16.174983    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:24.615879 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:24.615850    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c5cf545b9-8flvw"
Jul 08 18:46:26.974528 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:26.974495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:27.130819 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.130790    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:27.406322 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.406289    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:27.528309 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.528280    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:27.585332 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.585307    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs"]
Jul 08 18:46:27.588401 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.588386    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs"
Jul 08 18:46:27.592010 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.591992    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dd6dt\""
Jul 08 18:46:27.593165 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.593149    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 18:46:27.593256 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.593178    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 18:46:27.607665 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.607642    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs"]
Jul 08 18:46:27.653806 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.653773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6d20a96-4f3c-4b7b-beb8-10d89f173758-tmp\") pod \"kube-auth-proxy-8b75dd56d-kszqs\" (UID: \"e6d20a96-4f3c-4b7b-beb8-10d89f173758\") " pod="openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs"
Jul 08 18:46:27.653906 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.653806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hbkc\" (UniqueName: \"kubernetes.io/projected/e6d20a96-4f3c-4b7b-beb8-10d89f173758-kube-api-access-5hbkc\") pod \"kube-auth-proxy-8b75dd56d-kszqs\" (UID: \"e6d20a96-4f3c-4b7b-beb8-10d89f173758\") " pod="openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs"
Jul 08 18:46:27.653906 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.653891    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6d20a96-4f3c-4b7b-beb8-10d89f173758-tls-certs\") pod \"kube-auth-proxy-8b75dd56d-kszqs\" (UID: \"e6d20a96-4f3c-4b7b-beb8-10d89f173758\") " pod="openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs"
Jul 08 18:46:27.755101 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.755044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6d20a96-4f3c-4b7b-beb8-10d89f173758-tmp\") pod \"kube-auth-proxy-8b75dd56d-kszqs\" (UID: \"e6d20a96-4f3c-4b7b-beb8-10d89f173758\") " pod="openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs"
Jul 08 18:46:27.755101 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.755075    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hbkc\" (UniqueName: \"kubernetes.io/projected/e6d20a96-4f3c-4b7b-beb8-10d89f173758-kube-api-access-5hbkc\") pod \"kube-auth-proxy-8b75dd56d-kszqs\" (UID: \"e6d20a96-4f3c-4b7b-beb8-10d89f173758\") " pod="openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs"
Jul 08 18:46:27.755263 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.755140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6d20a96-4f3c-4b7b-beb8-10d89f173758-tls-certs\") pod \"kube-auth-proxy-8b75dd56d-kszqs\" (UID: \"e6d20a96-4f3c-4b7b-beb8-10d89f173758\") " pod="openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs"
Jul 08 18:46:27.757117 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.757099    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6d20a96-4f3c-4b7b-beb8-10d89f173758-tmp\") pod \"kube-auth-proxy-8b75dd56d-kszqs\" (UID: \"e6d20a96-4f3c-4b7b-beb8-10d89f173758\") " pod="openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs"
Jul 08 18:46:27.757393 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.757372    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6d20a96-4f3c-4b7b-beb8-10d89f173758-tls-certs\") pod \"kube-auth-proxy-8b75dd56d-kszqs\" (UID: \"e6d20a96-4f3c-4b7b-beb8-10d89f173758\") " pod="openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs"
Jul 08 18:46:27.766224 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.766200    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hbkc\" (UniqueName: \"kubernetes.io/projected/e6d20a96-4f3c-4b7b-beb8-10d89f173758-kube-api-access-5hbkc\") pod \"kube-auth-proxy-8b75dd56d-kszqs\" (UID: \"e6d20a96-4f3c-4b7b-beb8-10d89f173758\") " pod="openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs"
Jul 08 18:46:27.897170 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:27.897147    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs"
Jul 08 18:46:28.043930 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:28.043907    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs"]
Jul 08 18:46:28.045090 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:46:28.045065    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d20a96_4f3c_4b7b_beb8_10d89f173758.slice/crio-41d8a29d7adf825a6c0a91aed928f651a5ceb628b0c8922d5c431b8063968ff0 WatchSource:0}: Error finding container 41d8a29d7adf825a6c0a91aed928f651a5ceb628b0c8922d5c431b8063968ff0: Status 404 returned error can't find the container with id 41d8a29d7adf825a6c0a91aed928f651a5ceb628b0c8922d5c431b8063968ff0
Jul 08 18:46:28.085249 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:28.085227    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:28.184557 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:28.184528    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:28.321867 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:28.321780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:28.660499 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:28.660468    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs" event={"ID":"e6d20a96-4f3c-4b7b-beb8-10d89f173758","Type":"ContainerStarted","Data":"41d8a29d7adf825a6c0a91aed928f651a5ceb628b0c8922d5c431b8063968ff0"}
Jul 08 18:46:29.038577 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:29.038483    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:29.223917 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:29.223888    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:29.296824 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:29.296750    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:29.397119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:29.397094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:30.550700 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:30.550672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:31.671607 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:31.671574    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs" event={"ID":"e6d20a96-4f3c-4b7b-beb8-10d89f173758","Type":"ContainerStarted","Data":"67a973b3c61b10ce038508261dc44a060e0c408e852e6a257dfb7056954b00de"}
Jul 08 18:46:31.692367 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:31.692322    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8b75dd56d-kszqs" podStartSLOduration=1.630204869 podStartE2EDuration="4.692307078s" totalImagesPullingTime="3.062102209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:31.691117417 +0000 UTC m=+419.933608544" watchObservedRunningTime="2026-07-08 18:46:31.692307078 +0000 UTC m=+419.934798199"
Jul 08 18:46:33.862609 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:33.862555    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:33.960480 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:33.960445    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:34.790885 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:34.790834    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:35.031552 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:35.031520    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:35.136795 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:35.136769    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:37.061280 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.061249    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"]
Jul 08 18:46:37.065807 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.065789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"
Jul 08 18:46:37.078972 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.078953    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 08 18:46:37.079095 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.078955    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-l9x86\""
Jul 08 18:46:37.080051 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.080038    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 18:46:37.080105 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.080069    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 08 18:46:37.083344 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.083327    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 18:46:37.083344 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.083342    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 08 18:46:37.114850 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.114830    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"]
Jul 08 18:46:37.121737 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.121717    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhb9h\" (UniqueName: \"kubernetes.io/projected/e15e8731-6ffa-4e3e-a228-e65949aa64a5-kube-api-access-jhb9h\") pod \"lws-controller-manager-58c5974cc6-c69fc\" (UID: \"e15e8731-6ffa-4e3e-a228-e65949aa64a5\") " pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"
Jul 08 18:46:37.121838 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.121750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e15e8731-6ffa-4e3e-a228-e65949aa64a5-manager-config\") pod \"lws-controller-manager-58c5974cc6-c69fc\" (UID: \"e15e8731-6ffa-4e3e-a228-e65949aa64a5\") " pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"
Jul 08 18:46:37.121838 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.121813    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e15e8731-6ffa-4e3e-a228-e65949aa64a5-cert\") pod \"lws-controller-manager-58c5974cc6-c69fc\" (UID: \"e15e8731-6ffa-4e3e-a228-e65949aa64a5\") " pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"
Jul 08 18:46:37.121838 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.121830    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e15e8731-6ffa-4e3e-a228-e65949aa64a5-metrics-cert\") pod \"lws-controller-manager-58c5974cc6-c69fc\" (UID: \"e15e8731-6ffa-4e3e-a228-e65949aa64a5\") " pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"
Jul 08 18:46:37.222415 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.222392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhb9h\" (UniqueName: \"kubernetes.io/projected/e15e8731-6ffa-4e3e-a228-e65949aa64a5-kube-api-access-jhb9h\") pod \"lws-controller-manager-58c5974cc6-c69fc\" (UID: \"e15e8731-6ffa-4e3e-a228-e65949aa64a5\") " pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"
Jul 08 18:46:37.222531 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.222421    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e15e8731-6ffa-4e3e-a228-e65949aa64a5-manager-config\") pod \"lws-controller-manager-58c5974cc6-c69fc\" (UID: \"e15e8731-6ffa-4e3e-a228-e65949aa64a5\") " pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"
Jul 08 18:46:37.222579 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.222546    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e15e8731-6ffa-4e3e-a228-e65949aa64a5-cert\") pod \"lws-controller-manager-58c5974cc6-c69fc\" (UID: \"e15e8731-6ffa-4e3e-a228-e65949aa64a5\") " pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"
Jul 08 18:46:37.222655 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.222579    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e15e8731-6ffa-4e3e-a228-e65949aa64a5-metrics-cert\") pod \"lws-controller-manager-58c5974cc6-c69fc\" (UID: \"e15e8731-6ffa-4e3e-a228-e65949aa64a5\") " pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"
Jul 08 18:46:37.223043 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.223021    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e15e8731-6ffa-4e3e-a228-e65949aa64a5-manager-config\") pod \"lws-controller-manager-58c5974cc6-c69fc\" (UID: \"e15e8731-6ffa-4e3e-a228-e65949aa64a5\") " pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"
Jul 08 18:46:37.224951 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.224933    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e15e8731-6ffa-4e3e-a228-e65949aa64a5-metrics-cert\") pod \"lws-controller-manager-58c5974cc6-c69fc\" (UID: \"e15e8731-6ffa-4e3e-a228-e65949aa64a5\") " pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"
Jul 08 18:46:37.225036 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.224973    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e15e8731-6ffa-4e3e-a228-e65949aa64a5-cert\") pod \"lws-controller-manager-58c5974cc6-c69fc\" (UID: \"e15e8731-6ffa-4e3e-a228-e65949aa64a5\") " pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"
Jul 08 18:46:37.232483 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.232461    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhb9h\" (UniqueName: \"kubernetes.io/projected/e15e8731-6ffa-4e3e-a228-e65949aa64a5-kube-api-access-jhb9h\") pod \"lws-controller-manager-58c5974cc6-c69fc\" (UID: \"e15e8731-6ffa-4e3e-a228-e65949aa64a5\") " pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"
Jul 08 18:46:37.374542 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.374522    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"
Jul 08 18:46:37.500136 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.500115    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"]
Jul 08 18:46:37.502030 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:46:37.502003    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15e8731_6ffa_4e3e_a228_e65949aa64a5.slice/crio-09d6bf9d5dc7d2aa489b614b7bce4b6970efff90e1e2da840a1131900ff4b5fb WatchSource:0}: Error finding container 09d6bf9d5dc7d2aa489b614b7bce4b6970efff90e1e2da840a1131900ff4b5fb: Status 404 returned error can't find the container with id 09d6bf9d5dc7d2aa489b614b7bce4b6970efff90e1e2da840a1131900ff4b5fb
Jul 08 18:46:37.645280 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.645195    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:37.693565 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:37.693540    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc" event={"ID":"e15e8731-6ffa-4e3e-a228-e65949aa64a5","Type":"ContainerStarted","Data":"09d6bf9d5dc7d2aa489b614b7bce4b6970efff90e1e2da840a1131900ff4b5fb"}
Jul 08 18:46:38.933012 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:38.932970    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:39.138818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:39.138789    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:39.226891 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:39.226784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:39.347357 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:39.347326    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:40.315007 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:40.314956    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:40.448992 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:40.448905    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:40.613586 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:40.613561    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:46:40.707055 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:40.706982    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc" event={"ID":"e15e8731-6ffa-4e3e-a228-e65949aa64a5","Type":"ContainerStarted","Data":"3a18f416999d14ac86407e486e0a0223b27f88404c91f9df764dfe0ba9eea87c"}
Jul 08 18:46:40.707173 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:40.707059    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"
Jul 08 18:46:40.742053 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:40.742017    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc" podStartSLOduration=1.106163716 podStartE2EDuration="3.742003883s" totalImagesPullingTime="2.635840167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:46:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:40.740269716 +0000 UTC m=+428.982760838" watchObservedRunningTime="2026-07-08 18:46:40.742003883 +0000 UTC m=+428.984495003"
Jul 08 18:46:51.712446 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:46:51.712416    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58c5974cc6-c69fc"
Jul 08 18:47:28.519842 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:47:28.519806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:47:28.639440 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:47:28.639409    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:47:28.784145 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:47:28.784065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:47:53.770722 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:47:53.770693    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:47:53.828760 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:47:53.828727    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:47:53.902544 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:47:53.902515    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:47:53.966930 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:47:53.966908    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:47:54.585372 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:47:54.585344    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:47:57.485296 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:47:57.485265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:47:58.086074 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:47:58.086046    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:02.898800 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:02.898772    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:04.600842 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:04.600807    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:04.732738 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:04.732704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:04.933225 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:04.933150    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:05.037908 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:05.037880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:05.950574 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:05.950544    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:06.741911 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:06.741880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:08.896120 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:08.896090    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:09.331353 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:09.331265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:12.542311 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:12.542276    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:14.532726 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:14.532693    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:14.633162 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:14.633130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:14.907514 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:14.907486    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:15.009619 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:15.009593    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:18.420761 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:18.420726    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:18.535040 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:18.535000    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:19.271960 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:19.271928    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:21.199007 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:21.198970    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:21.267818 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:21.267786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:22.171180 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:22.171149    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:22.279497 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:22.279469    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:23.703059 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.703011    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h"]
Jul 08 18:48:23.706155 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.706139    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h"
Jul 08 18:48:23.709598 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.709571    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 08 18:48:23.709760 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.709609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:23.709832 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.709798    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fzfvr\""
Jul 08 18:48:23.709832 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.709805    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 08 18:48:23.710798 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.710783    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 18:48:23.710925 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.710862    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 18:48:23.717862 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.717836    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h"]
Jul 08 18:48:23.807401 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.807366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/704ff380-f6af-47ef-a4a3-afac5b7c8c4a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4bm9h\" (UID: \"704ff380-f6af-47ef-a4a3-afac5b7c8c4a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h"
Jul 08 18:48:23.807558 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.807414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxjlf\" (UniqueName: \"kubernetes.io/projected/704ff380-f6af-47ef-a4a3-afac5b7c8c4a-kube-api-access-dxjlf\") pod \"kuadrant-console-plugin-66b5774985-4bm9h\" (UID: \"704ff380-f6af-47ef-a4a3-afac5b7c8c4a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h"
Jul 08 18:48:23.807558 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.807494    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/704ff380-f6af-47ef-a4a3-afac5b7c8c4a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4bm9h\" (UID: \"704ff380-f6af-47ef-a4a3-afac5b7c8c4a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h"
Jul 08 18:48:23.908729 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.908697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/704ff380-f6af-47ef-a4a3-afac5b7c8c4a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4bm9h\" (UID: \"704ff380-f6af-47ef-a4a3-afac5b7c8c4a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h"
Jul 08 18:48:23.908729 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.908731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxjlf\" (UniqueName: \"kubernetes.io/projected/704ff380-f6af-47ef-a4a3-afac5b7c8c4a-kube-api-access-dxjlf\") pod \"kuadrant-console-plugin-66b5774985-4bm9h\" (UID: \"704ff380-f6af-47ef-a4a3-afac5b7c8c4a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h"
Jul 08 18:48:23.908925 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.908794    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/704ff380-f6af-47ef-a4a3-afac5b7c8c4a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4bm9h\" (UID: \"704ff380-f6af-47ef-a4a3-afac5b7c8c4a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h"
Jul 08 18:48:23.908982 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:48:23.908924    2563 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 08 18:48:23.908982 ip-10-0-129-111 kubenswrapper[2563]: E0708 18:48:23.908974    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704ff380-f6af-47ef-a4a3-afac5b7c8c4a-plugin-serving-cert podName:704ff380-f6af-47ef-a4a3-afac5b7c8c4a nodeName:}" failed. No retries permitted until 2026-07-08 18:48:24.408959614 +0000 UTC m=+532.651450713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/704ff380-f6af-47ef-a4a3-afac5b7c8c4a-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-4bm9h" (UID: "704ff380-f6af-47ef-a4a3-afac5b7c8c4a") : secret "plugin-serving-cert" not found
Jul 08 18:48:23.909487 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.909462    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/704ff380-f6af-47ef-a4a3-afac5b7c8c4a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4bm9h\" (UID: \"704ff380-f6af-47ef-a4a3-afac5b7c8c4a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h"
Jul 08 18:48:23.919231 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:23.919202    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxjlf\" (UniqueName: \"kubernetes.io/projected/704ff380-f6af-47ef-a4a3-afac5b7c8c4a-kube-api-access-dxjlf\") pod \"kuadrant-console-plugin-66b5774985-4bm9h\" (UID: \"704ff380-f6af-47ef-a4a3-afac5b7c8c4a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h"
Jul 08 18:48:24.139392 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:24.139362    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:24.412596 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:24.412504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/704ff380-f6af-47ef-a4a3-afac5b7c8c4a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4bm9h\" (UID: \"704ff380-f6af-47ef-a4a3-afac5b7c8c4a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h"
Jul 08 18:48:24.415073 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:24.415049    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/704ff380-f6af-47ef-a4a3-afac5b7c8c4a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4bm9h\" (UID: \"704ff380-f6af-47ef-a4a3-afac5b7c8c4a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h"
Jul 08 18:48:24.614858 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:24.614827    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h"
Jul 08 18:48:24.740071 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:24.740048    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h"]
Jul 08 18:48:24.742031 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:48:24.742003    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod704ff380_f6af_47ef_a4a3_afac5b7c8c4a.slice/crio-4681cde181bf1d20ff0059c25d137504bce4744a9df00426b76c932269abaaf6 WatchSource:0}: Error finding container 4681cde181bf1d20ff0059c25d137504bce4744a9df00426b76c932269abaaf6: Status 404 returned error can't find the container with id 4681cde181bf1d20ff0059c25d137504bce4744a9df00426b76c932269abaaf6
Jul 08 18:48:25.069476 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:25.069389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h" event={"ID":"704ff380-f6af-47ef-a4a3-afac5b7c8c4a","Type":"ContainerStarted","Data":"4681cde181bf1d20ff0059c25d137504bce4744a9df00426b76c932269abaaf6"}
Jul 08 18:48:25.659230 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:25.659201    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:25.760067 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:25.760030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:31.028969 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:31.028913    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:33.699763 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:33.699724    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:33.791360 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:33.791294    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:34.381665 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:34.381597    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:34.486007 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:34.485977    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:37.318238 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:37.318196    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:37.418656 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:37.418607    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:41.893248 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:41.893216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:41.995513 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:41.995483    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:44.452590 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:44.452539    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:44.554865 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:44.554823    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:48:50.173780 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:50.173742    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h" event={"ID":"704ff380-f6af-47ef-a4a3-afac5b7c8c4a","Type":"ContainerStarted","Data":"2acf94cc40e3f81b6df194a0d77c779353b66b4aaec88746529a1ca24ee75743"}
Jul 08 18:48:50.191278 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:48:50.191230    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4bm9h" podStartSLOduration=2.5859175089999997 podStartE2EDuration="27.191215173s" totalImagesPullingTime="24.605297664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:48:50.189789652 +0000 UTC m=+558.432280777" watchObservedRunningTime="2026-07-08 18:48:50.191215173 +0000 UTC m=+558.433706294"
Jul 08 18:49:05.696711 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:05.696683    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:49:05.754216 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:05.754180    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:49:07.435702 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:07.435675    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:49:07.688753 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:07.688663    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:49:24.480002 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:24.479970    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:49:24.579288 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:24.579260    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:49:24.679097 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:24.679072    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:49:24.767783 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:24.767720    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:49:24.801863 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:24.801836    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:49:24.801999 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:24.801877    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:49:24.801999 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:24.801967    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"
Jul 08 18:49:24.804467 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:24.804444    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 18:49:24.907588 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:24.907567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e5e0039-167b-4f95-b00c-198c923caa42-config-file\") pod \"limitador-limitador-54d6d988d5-b9dwk\" (UID: \"5e5e0039-167b-4f95-b00c-198c923caa42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"
Jul 08 18:49:24.907698 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:24.907598    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj22l\" (UniqueName: \"kubernetes.io/projected/5e5e0039-167b-4f95-b00c-198c923caa42-kube-api-access-gj22l\") pod \"limitador-limitador-54d6d988d5-b9dwk\" (UID: \"5e5e0039-167b-4f95-b00c-198c923caa42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"
Jul 08 18:49:25.008325 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:25.008303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e5e0039-167b-4f95-b00c-198c923caa42-config-file\") pod \"limitador-limitador-54d6d988d5-b9dwk\" (UID: \"5e5e0039-167b-4f95-b00c-198c923caa42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"
Jul 08 18:49:25.008413 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:25.008334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj22l\" (UniqueName: \"kubernetes.io/projected/5e5e0039-167b-4f95-b00c-198c923caa42-kube-api-access-gj22l\") pod \"limitador-limitador-54d6d988d5-b9dwk\" (UID: \"5e5e0039-167b-4f95-b00c-198c923caa42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"
Jul 08 18:49:25.008980 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:25.008962    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e5e0039-167b-4f95-b00c-198c923caa42-config-file\") pod \"limitador-limitador-54d6d988d5-b9dwk\" (UID: \"5e5e0039-167b-4f95-b00c-198c923caa42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"
Jul 08 18:49:25.016657 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:25.016615    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj22l\" (UniqueName: \"kubernetes.io/projected/5e5e0039-167b-4f95-b00c-198c923caa42-kube-api-access-gj22l\") pod \"limitador-limitador-54d6d988d5-b9dwk\" (UID: \"5e5e0039-167b-4f95-b00c-198c923caa42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"
Jul 08 18:49:25.111849 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:25.111824    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"
Jul 08 18:49:25.234084 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:25.234061    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:49:25.236327 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:49:25.236300    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5e0039_167b_4f95_b00c_198c923caa42.slice/crio-374a0840937b0f46957e21ad271990fe1ab0025d14a9348ccac957243d817008 WatchSource:0}: Error finding container 374a0840937b0f46957e21ad271990fe1ab0025d14a9348ccac957243d817008: Status 404 returned error can't find the container with id 374a0840937b0f46957e21ad271990fe1ab0025d14a9348ccac957243d817008
Jul 08 18:49:25.296815 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:25.296789    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-b9dwk" event={"ID":"5e5e0039-167b-4f95-b00c-198c923caa42","Type":"ContainerStarted","Data":"374a0840937b0f46957e21ad271990fe1ab0025d14a9348ccac957243d817008"}
Jul 08 18:49:25.306350 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:25.306327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:49:25.407423 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:25.407368    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:49:28.314551 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:28.314522    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-b9dwk" event={"ID":"5e5e0039-167b-4f95-b00c-198c923caa42","Type":"ContainerStarted","Data":"c31e6d4ba8cc332a8924de4f2743ec657341c7477024e59716158c9ac93b7ed6"}
Jul 08 18:49:28.314944 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:28.314656    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"
Jul 08 18:49:28.334168 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:28.334121    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-b9dwk" podStartSLOduration=1.847500434 podStartE2EDuration="4.334106851s" totalImagesPullingTime="2.486606417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:49:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:49:28.333156293 +0000 UTC m=+596.575647414" watchObservedRunningTime="2026-07-08 18:49:28.334106851 +0000 UTC m=+596.576597973"
Jul 08 18:49:32.119362 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:32.119339    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 18:49:32.124074 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:32.124057    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 18:49:39.320098 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:39.320070    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"
Jul 08 18:49:43.741151 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:43.741122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:49:43.840603 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:43.840574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:49:44.252163 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:49:44.252139    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:03.418262 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:03.418183    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:03.655444 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:03.655412    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:09.902697 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:09.902666    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:09.994692 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:09.994668    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:10.095709 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:10.095680    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:10.229551 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:10.229486    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:13.938766 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:13.938739    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:14.030671 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:14.030619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:22.958311 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:22.958282    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:23.059382 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:23.059355    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:34.722842 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:34.722813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:49.934838 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:49.934808    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:50.349824 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:50.349790    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:50.674082 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:50.674009    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:50.826823 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:50.826788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:50.925207 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:50.925127    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:51.041226 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:50:51.041198    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:51:01.630591 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:51:01.630564    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:01.724879 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:51:01.724852    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:05.527079 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:51:05.527051    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:07.707562 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:51:07.707527    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:07.808800 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:51:07.808773    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:21.267100 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:51:21.267068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:22.705438 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:51:22.705411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:23.135594 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:51:23.135562    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:51:29.179119 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:51:29.179014    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:29.997228 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:51:29.997192    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:51:42.882887 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:51:42.882856    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:47.238131 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:51:47.238102    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:48.384475 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:51:48.384443    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:51:50.912197 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:51:50.912161    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:53.808281 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:51:53.808237    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:54.782766 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:51:54.782733    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:52:13.233012 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:13.232979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:15.191593 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:15.191557    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:52:30.593661 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.593612    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"]
Jul 08 18:52:30.596579 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.596561    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.599559 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.599539    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 18:52:30.600974 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.600948    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 08 18:52:30.600974 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.600961    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gwjg6\""
Jul 08 18:52:30.601191 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.601012    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 18:52:30.607568 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.607547    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"]
Jul 08 18:52:30.632096 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.632031    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:30.692458 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.692437    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2388dc9-839c-46e6-9015-2c9693f3b302-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.692538 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.692471    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2388dc9-839c-46e6-9015-2c9693f3b302-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.692538 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.692522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2388dc9-839c-46e6-9015-2c9693f3b302-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.692606 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.692547    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2388dc9-839c-46e6-9015-2c9693f3b302-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.692606 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.692577    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7wv7\" (UniqueName: \"kubernetes.io/projected/c2388dc9-839c-46e6-9015-2c9693f3b302-kube-api-access-g7wv7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.692606 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.692602    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2388dc9-839c-46e6-9015-2c9693f3b302-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.793557 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.793532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2388dc9-839c-46e6-9015-2c9693f3b302-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.793673 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.793566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2388dc9-839c-46e6-9015-2c9693f3b302-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.793673 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.793588    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2388dc9-839c-46e6-9015-2c9693f3b302-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.793759 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.793703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7wv7\" (UniqueName: \"kubernetes.io/projected/c2388dc9-839c-46e6-9015-2c9693f3b302-kube-api-access-g7wv7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.793759 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.793742    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2388dc9-839c-46e6-9015-2c9693f3b302-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.793836 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.793814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2388dc9-839c-46e6-9015-2c9693f3b302-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.793922 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.793897    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2388dc9-839c-46e6-9015-2c9693f3b302-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.794106 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.794087    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2388dc9-839c-46e6-9015-2c9693f3b302-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.794106 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.794100    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2388dc9-839c-46e6-9015-2c9693f3b302-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.795798 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.795780    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2388dc9-839c-46e6-9015-2c9693f3b302-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.796084 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.796069    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2388dc9-839c-46e6-9015-2c9693f3b302-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.801585 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.801563    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7wv7\" (UniqueName: \"kubernetes.io/projected/c2388dc9-839c-46e6-9015-2c9693f3b302-kube-api-access-g7wv7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2\" (UID: \"c2388dc9-839c-46e6-9015-2c9693f3b302\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:30.905308 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:30.905257    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:31.038588 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:31.038567    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"]
Jul 08 18:52:31.040723 ip-10-0-129-111 kubenswrapper[2563]: W0708 18:52:31.040695    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2388dc9_839c_46e6_9015_2c9693f3b302.slice/crio-fe8c08f8f9ca83ba50b617f6ad1235eff8d632b17bf78bd27d81689d7035fbe8 WatchSource:0}: Error finding container fe8c08f8f9ca83ba50b617f6ad1235eff8d632b17bf78bd27d81689d7035fbe8: Status 404 returned error can't find the container with id fe8c08f8f9ca83ba50b617f6ad1235eff8d632b17bf78bd27d81689d7035fbe8
Jul 08 18:52:31.042117 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:31.042102    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 18:52:31.958460 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:31.958407    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2" event={"ID":"c2388dc9-839c-46e6-9015-2c9693f3b302","Type":"ContainerStarted","Data":"fe8c08f8f9ca83ba50b617f6ad1235eff8d632b17bf78bd27d81689d7035fbe8"}
Jul 08 18:52:32.963014 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:32.962983    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2" event={"ID":"c2388dc9-839c-46e6-9015-2c9693f3b302","Type":"ContainerStarted","Data":"507658522c8fbd52fe4be28eda5e4e9b354c4498b389ed8b5281f5f39649ea18"}
Jul 08 18:52:32.981956 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:32.981906    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2" podStartSLOduration=1.946457927 podStartE2EDuration="2.98188826s" totalImagesPullingTime="1.035430333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:52:32.981532641 +0000 UTC m=+781.224023753" watchObservedRunningTime="2026-07-08 18:52:32.98188826 +0000 UTC m=+781.224379384"
Jul 08 18:52:33.491829 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:33.491799    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:52:34.689310 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:34.689281    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:40.906492 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:40.906456    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:40.906492 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:40.906497    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:40.918511 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:40.918490    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:52:41.001643 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:52:41.001609    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2"
Jul 08 18:53:22.415004 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:53:22.414967    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:53:22.509507 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:53:22.509483    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:53:23.656250 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:53:23.656218    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:53:23.745602 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:53:23.745579    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:53:51.884909 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:53:51.884879    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:54:01.390244 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:54:01.390212    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:54:12.285958 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:54:12.285931    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:54:21.600425 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:54:21.600396    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:54:32.142011 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:54:32.141986    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 18:54:32.144462 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:54:32.144440    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 18:54:33.292128 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:54:33.292091    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:54:34.805601 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:54:34.805570    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:54:36.388903 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:54:36.388872    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:10.543540 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:55:10.543509    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:10.644992 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:55:10.644972    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:16.921020 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:55:16.920986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:17.096983 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:55:17.096951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:17.277032 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:55:17.276970    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:17.419386 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:55:17.419361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:23.506791 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:55:23.506758    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:23.592616 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:55:23.592585    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:40.600796 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:55:40.600764    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:55:50.206564 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:55:50.206530    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:55:59.886945 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:55:59.886871    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:56:08.259953 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:56:08.259918    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:56:09.401403 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:56:09.401373    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:56:21.289810 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:56:21.289776    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:56:32.108507 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:56:32.108473    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:56:43.479002 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:56:43.478973    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:56:53.693874 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:56:53.693841    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:57:19.487116 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:57:19.487081    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:57:31.689871 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:57:31.689785    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:57:56.979434 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:57:56.979403    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:58:07.391397 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:58:07.391362    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:58:23.387916 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:58:23.387886    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:58:27.731775 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:58:27.731738    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:58:27.817099 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:58:27.817075    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:58:34.498985 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:58:34.498954    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:58:44.217041 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:58:44.217011    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:58:53.713154 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:58:53.713120    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:58:59.023286 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:58:59.023243    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 18:59:03.096237 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:59:03.096189    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 18:59:32.171599 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:59:32.171574    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 18:59:32.172235 ip-10-0-129-111 kubenswrapper[2563]: I0708 18:59:32.172217    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 19:00:20.887330 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:00:20.887293    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:00:20.938435 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:00:20.938401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:00:51.089363 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:00:51.089288    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:01:00.489549 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:01:00.489518    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:01:13.487814 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:01:13.487776    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:01:24.290968 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:01:24.290935    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:01:35.984608 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:01:35.984572    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:01:46.787585 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:01:46.787553    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:01:55.784357 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:01:55.784280    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:01:57.087256 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:01:57.087228    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:01:58.515953 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:01:58.515921    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:02:07.800137 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:02:07.800085    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:02:17.497282 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:02:17.497236    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:02:26.793367 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:02:26.793339    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:02:38.620902 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:02:38.620870    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:02:59.212185 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:02:59.212151    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:03:09.297104 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:03:09.297068    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:03:19.493709 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:03:19.493679    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:03:29.303185 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:03:29.302973    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:03:36.098786 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:03:36.098751    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:03:52.431165 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:03:52.431139    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:03:54.920447 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:03:54.920413    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:04:02.283068 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:04:02.283030    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:04:11.702708 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:04:11.702672    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:04:22.401043 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:04:22.401009    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:04:31.501644 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:04:31.501589    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:04:32.193462 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:04:32.193424    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 19:04:32.193810 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:04:32.193793    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 19:04:41.586547 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:04:41.586514    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:04:50.539305 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:04:50.539272    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:04:55.194822 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:04:55.194749    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:05:04.586336 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:05:04.586306    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:05:14.286850 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:05:14.286818    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:05:24.224770 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:05:24.224743    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:05:37.285194 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:05:37.285157    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:05:45.587366 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:05:45.587335    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:05:57.190773 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:05:57.190742    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:06:03.320226 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:03.320194    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:09.487734 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:09.487699    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:06:19.085477 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:19.085447    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:06:21.787739 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:21.787710    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:27.461766 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:27.461692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:33.090973 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:33.090943    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:06:35.771488 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:35.771458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:41.053125 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:41.053090    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:44.103703 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:44.103670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:44.204027 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:44.203994    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:44.590465 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:44.590435    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:45.294692 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:45.294668    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:06:50.557993 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:50.557959    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:50.661593 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:50.661567    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:50.783924 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:50.783901    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:50.884125 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:50.884101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:51.984664 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:51.984618    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:52.072128 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:52.072097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:52.133196 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:52.133172    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:52.545554 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:52.545526    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:52.667610 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:52.667586    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:52.786048 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:52.786025    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:54.969570 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:54.969544    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:55.784604 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:55.784573    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:06:57.080767 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:57.080738    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:57.270620 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:57.270592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:57.368785 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:57.368743    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:57.489641 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:57.489597    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:06:58.647264 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:06:58.647235    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:03.256878 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.256849    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:03.325836 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.325814    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:03.440105 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.440076    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"]
Jul 08 19:07:03.443378 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.443358    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.446592 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.446567    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8f5e817a-openshift-default-dockercfg-prx2n\""
Jul 08 19:07:03.446725 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.446606    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 19:07:03.456176 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.456156    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"]
Jul 08 19:07:03.482491 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.482472    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:03.582957 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.582880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:03.608106 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.608085    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvqht\" (UniqueName: \"kubernetes.io/projected/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-kube-api-access-fvqht\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.608203 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.608133    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-credential-socket\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.608203 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.608165    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-token\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.608203 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.608193    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-workload-certs\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.608365 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.608227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istiod-ca-cert\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.608365 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.608255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-podinfo\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.608365 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.608286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-workload-socket\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.608365 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.608319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-data\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.608365 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.608345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-envoy\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.709404 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.709385    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvqht\" (UniqueName: \"kubernetes.io/projected/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-kube-api-access-fvqht\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.709493 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.709418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-credential-socket\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.709493 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.709438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-token\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.709493 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.709474    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-workload-certs\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.709696 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.709512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istiod-ca-cert\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.709696 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.709531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-podinfo\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.709696 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.709551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-workload-socket\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.709696 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.709572    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-data\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.709696 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.709597    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-envoy\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.709938 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.709866    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-credential-socket\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.709988 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.709957    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-workload-certs\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.710047 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.710019    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-data\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.710096 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.710046    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-workload-socket\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.710192 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.710171    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istiod-ca-cert\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.711786 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.711765    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-envoy\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.711965 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.711949    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-podinfo\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.717619 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.717592    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvqht\" (UniqueName: \"kubernetes.io/projected/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-kube-api-access-fvqht\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.718200 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.718179    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-token\") pod \"e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") " pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.754013 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.753992    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:03.878513 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.878484    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"]
Jul 08 19:07:03.881672 ip-10-0-129-111 kubenswrapper[2563]: W0708 19:07:03.881645    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ddc07bc_06b4_4db9_8048_d5d3d7c6b39e.slice/crio-77862a43eb53d0550b2742a1c54f17955b30a44934d2b20ac75dd08e0289edaa WatchSource:0}: Error finding container 77862a43eb53d0550b2742a1c54f17955b30a44934d2b20ac75dd08e0289edaa: Status 404 returned error can't find the container with id 77862a43eb53d0550b2742a1c54f17955b30a44934d2b20ac75dd08e0289edaa
Jul 08 19:07:03.883773 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:03.883759    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 19:07:04.117014 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:04.116984    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27" event={"ID":"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e","Type":"ContainerStarted","Data":"77862a43eb53d0550b2742a1c54f17955b30a44934d2b20ac75dd08e0289edaa"}
Jul 08 19:07:04.598424 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:04.598391    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:04.706776 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:04.706749    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:04.907876 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:04.907803    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:05.332640 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:05.332546    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:05.430107 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:05.430076    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:05.530665 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:05.530617    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:05.690433 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:05.690401    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:07:06.432514 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:06.432472    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:07:06.432641 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:06.432552    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:07:06.432641 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:06.432578    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:07:07.133522 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:07.133491    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27" event={"ID":"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e","Type":"ContainerStarted","Data":"086a6ae54b6a4dd384f77713e17c2f4fb37b4c67eb6e44b6132dfe6b6af421f7"}
Jul 08 19:07:07.156457 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:07.156410    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27" podStartSLOduration=1.6080695189999998 podStartE2EDuration="4.156392942s" totalImagesPullingTime="2.548323423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:07:07.155297479 +0000 UTC m=+1655.397788599" watchObservedRunningTime="2026-07-08 19:07:07.156392942 +0000 UTC m=+1655.398884064"
Jul 08 19:07:07.448585 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:07.448559    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:07.755052 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:07.754986    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:07.759460 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:07.759439    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:08.137867 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:08.137842    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:08.138684 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:08.138668    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:09.899444 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:09.899417    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:10.351834 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:10.351810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:16.124601 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:16.124563    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"]
Jul 08 19:07:16.125097 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:16.124781    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27" podUID="7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e" containerName="istio-proxy" containerID="cri-o://086a6ae54b6a4dd384f77713e17c2f4fb37b4c67eb6e44b6132dfe6b6af421f7" gracePeriod=30
Jul 08 19:07:16.178487 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:16.178455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:16.332199 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:16.332170    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:18.555560 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:18.555531    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:21.362911 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.362890    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:21.431483 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.431427    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-token\") pod \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") "
Jul 08 19:07:21.431483 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.431458    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-workload-certs\") pod \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") "
Jul 08 19:07:21.431700 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.431488    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-envoy\") pod \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") "
Jul 08 19:07:21.431700 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.431505    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istiod-ca-cert\") pod \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") "
Jul 08 19:07:21.431700 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.431537    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-podinfo\") pod \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") "
Jul 08 19:07:21.431700 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.431568    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-credential-socket\") pod \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") "
Jul 08 19:07:21.431903 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.431723    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvqht\" (UniqueName: \"kubernetes.io/projected/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-kube-api-access-fvqht\") pod \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") "
Jul 08 19:07:21.431903 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.431771    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-data\") pod \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") "
Jul 08 19:07:21.431903 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.431804    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-workload-socket\") pod \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\" (UID: \"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e\") "
Jul 08 19:07:21.431903 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.431819    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e" (UID: "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:07:21.432110 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.432040    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e" (UID: "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:07:21.432110 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.432068    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e" (UID: "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:07:21.432110 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.432090    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-credential-socket\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:07:21.432110 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.432050    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-data" (OuterVolumeSpecName: "istio-data") pod "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e" (UID: "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:07:21.432290 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.432266    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e" (UID: "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:07:21.433706 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.433686    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-token" (OuterVolumeSpecName: "istio-token") pod "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e" (UID: "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:07:21.433804 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.433717    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e" (UID: "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 19:07:21.433991 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.433965    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e" (UID: "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:07:21.434082 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.433979    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-kube-api-access-fvqht" (OuterVolumeSpecName: "kube-api-access-fvqht") pod "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e" (UID: "7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e"). InnerVolumeSpecName "kube-api-access-fvqht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:07:21.532655 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.532616    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-envoy\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:07:21.532655 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.532651    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istiod-ca-cert\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:07:21.532777 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.532660    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-podinfo\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:07:21.532777 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.532668    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvqht\" (UniqueName: \"kubernetes.io/projected/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-kube-api-access-fvqht\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:07:21.532777 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.532677    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-data\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:07:21.532777 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.532685    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-workload-socket\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:07:21.532777 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.532693    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-istio-token\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:07:21.532777 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:21.532701    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e-workload-certs\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:07:22.191336 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:22.191308    2563 generic.go:356] "Generic (PLEG): container finished" podID="7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e" containerID="086a6ae54b6a4dd384f77713e17c2f4fb37b4c67eb6e44b6132dfe6b6af421f7" exitCode=0
Jul 08 19:07:22.191487 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:22.191352    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"
Jul 08 19:07:22.191487 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:22.191385    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27" event={"ID":"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e","Type":"ContainerDied","Data":"086a6ae54b6a4dd384f77713e17c2f4fb37b4c67eb6e44b6132dfe6b6af421f7"}
Jul 08 19:07:22.191487 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:22.191434    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27" event={"ID":"7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e","Type":"ContainerDied","Data":"77862a43eb53d0550b2742a1c54f17955b30a44934d2b20ac75dd08e0289edaa"}
Jul 08 19:07:22.191487 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:22.191456    2563 scope.go:117] "RemoveContainer" containerID="086a6ae54b6a4dd384f77713e17c2f4fb37b4c67eb6e44b6132dfe6b6af421f7"
Jul 08 19:07:22.199742 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:22.199722    2563 scope.go:117] "RemoveContainer" containerID="086a6ae54b6a4dd384f77713e17c2f4fb37b4c67eb6e44b6132dfe6b6af421f7"
Jul 08 19:07:22.199985 ip-10-0-129-111 kubenswrapper[2563]: E0708 19:07:22.199967    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"086a6ae54b6a4dd384f77713e17c2f4fb37b4c67eb6e44b6132dfe6b6af421f7\": container with ID starting with 086a6ae54b6a4dd384f77713e17c2f4fb37b4c67eb6e44b6132dfe6b6af421f7 not found: ID does not exist" containerID="086a6ae54b6a4dd384f77713e17c2f4fb37b4c67eb6e44b6132dfe6b6af421f7"
Jul 08 19:07:22.200038 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:22.199993    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"086a6ae54b6a4dd384f77713e17c2f4fb37b4c67eb6e44b6132dfe6b6af421f7"} err="failed to get container status \"086a6ae54b6a4dd384f77713e17c2f4fb37b4c67eb6e44b6132dfe6b6af421f7\": rpc error: code = NotFound desc = could not find container \"086a6ae54b6a4dd384f77713e17c2f4fb37b4c67eb6e44b6132dfe6b6af421f7\": container with ID starting with 086a6ae54b6a4dd384f77713e17c2f4fb37b4c67eb6e44b6132dfe6b6af421f7 not found: ID does not exist"
Jul 08 19:07:22.214887 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:22.214864    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"]
Jul 08 19:07:22.218307 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:22.218286    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8f5e817a-openshift-default-df94f7b45-45h27"]
Jul 08 19:07:22.223937 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:22.223919    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e" path="/var/lib/kubelet/pods/7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e/volumes"
Jul 08 19:07:22.928664 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:22.928614    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:23.122658 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:23.122614    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:24.095310 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:24.095279    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:24.214478 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:24.214448    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:24.337781 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:24.337748    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:24.609697 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:24.609667    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:24.821155 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:24.821125    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:24.921193 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:24.921121    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:26.874425 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:26.874392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:26.906429 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:26.906403    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:07:28.610159 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:28.610127    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:28.783944 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:28.783915    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:28.881143 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:28.881083    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:29.089113 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:29.089081    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:31.428955 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:31.428926    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:35.216270 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:35.216236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:35.295980 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:35.295951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:35.590330 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:35.590301    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:07:35.727571 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:35.727546    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:35.831738 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:35.831709    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:35.936426 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:35.936365    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:37.453762 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:37.453733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:43.459563 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:43.459533    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:43.567691 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:43.567664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:43.668838 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:43.668811    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:43.764195 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:43.764136    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:44.446466 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:44.446417    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:07:48.835298 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:07:48.835270    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:10.399517 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:10.399487    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:16.983646 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:16.983596    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:17.122140 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:17.122106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:17.246973 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:17.246904    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:33.250479 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:33.250445    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:39.365957 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:39.365926    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:39.467811 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:39.467779    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:39.561894 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:39.561870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:50.171643 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:50.171596    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:51.026944 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:51.026912    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:57.116822 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:57.116793    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:57.227906 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:57.227878    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:57.317419 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:57.317393    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:57.418065 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:57.418012    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:58.220348 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:58.220320    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:58.319906 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:58.319877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:58.421476 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:58.421453    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:08:59.804793 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:08:59.804763    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:09:00.168712 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:00.168687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:06.179565 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:06.179535    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:06.279810 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:06.279783    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:06.870201 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:06.870174    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:07.295642 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:07.295550    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:09:12.837709 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:12.837677    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:12.912901 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:12.912876    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:13.092119 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.092048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:13.404589 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.404513    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"]
Jul 08 19:09:13.404834 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.404820    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e" containerName="istio-proxy"
Jul 08 19:09:13.404878 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.404835    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e" containerName="istio-proxy"
Jul 08 19:09:13.404914 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.404887    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ddc07bc-06b4-4db9-8048-d5d3d7c6b39e" containerName="istio-proxy"
Jul 08 19:09:13.407673 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.407657    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.410376 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.410347    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 19:09:13.410376 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.410347    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5071b272-openshift-default-dockercfg-z9kgx\""
Jul 08 19:09:13.431334 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.431309    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"]
Jul 08 19:09:13.448414 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.448392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:13.515071 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.515047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cz9g\" (UniqueName: \"kubernetes.io/projected/419f9771-36a1-45a2-9e51-d3b0df6724ff-kube-api-access-4cz9g\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.515180 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.515079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-token\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.515180 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.515111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-credential-socket\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.515180 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.515126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-workload-certs\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.515309 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.515174    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-data\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.515309 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.515248    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/419f9771-36a1-45a2-9e51-d3b0df6724ff-istiod-ca-cert\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.515309 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.515288    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-envoy\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.515414 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.515313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-workload-socket\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.515414 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.515335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-podinfo\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.616031 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.616006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-credential-socket\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.616153 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.616036    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-workload-certs\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.616153 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.616059    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-data\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.616153 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.616094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/419f9771-36a1-45a2-9e51-d3b0df6724ff-istiod-ca-cert\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.616153 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.616134    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-envoy\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.616362 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.616163    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-workload-socket\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.616362 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.616200    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-podinfo\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.616362 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.616249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cz9g\" (UniqueName: \"kubernetes.io/projected/419f9771-36a1-45a2-9e51-d3b0df6724ff-kube-api-access-4cz9g\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.616362 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.616286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-token\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.616544 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.616423    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-credential-socket\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.616544 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.616446    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-data\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.616544 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.616504    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-workload-certs\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.616724 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.616654    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-workload-socket\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.616871 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.616849    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/419f9771-36a1-45a2-9e51-d3b0df6724ff-istiod-ca-cert\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.618427 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.618405    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-envoy\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.618705 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.618686    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-podinfo\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.624291 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.624267    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-token\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.624503 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.624485    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cz9g\" (UniqueName: \"kubernetes.io/projected/419f9771-36a1-45a2-9e51-d3b0df6724ff-kube-api-access-4cz9g\") pod \"e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") " pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.716839 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.716791    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:13.719838 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.719822    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:13.846135 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.846111    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"]
Jul 08 19:09:13.848070 ip-10-0-129-111 kubenswrapper[2563]: W0708 19:09:13.848043    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419f9771_36a1_45a2_9e51_d3b0df6724ff.slice/crio-a5071d63bf87ee5d90fffe80e4ae5ef6fdc21be6944d9bd124c5bdc9aa35aa45 WatchSource:0}: Error finding container a5071d63bf87ee5d90fffe80e4ae5ef6fdc21be6944d9bd124c5bdc9aa35aa45: Status 404 returned error can't find the container with id a5071d63bf87ee5d90fffe80e4ae5ef6fdc21be6944d9bd124c5bdc9aa35aa45
Jul 08 19:09:13.850230 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.850195    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:09:13.850310 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.850267    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:09:13.850310 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:13.850298    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:09:14.618044 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:14.618014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p" event={"ID":"419f9771-36a1-45a2-9e51-d3b0df6724ff","Type":"ContainerStarted","Data":"555baaf2826068dc092fe71dfccdb4e50b5c3560074ac87848b5b6433b63b7f9"}
Jul 08 19:09:14.618219 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:14.618066    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p" event={"ID":"419f9771-36a1-45a2-9e51-d3b0df6724ff","Type":"ContainerStarted","Data":"a5071d63bf87ee5d90fffe80e4ae5ef6fdc21be6944d9bd124c5bdc9aa35aa45"}
Jul 08 19:09:14.656666 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:14.656607    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p" podStartSLOduration=1.656593756 podStartE2EDuration="1.656593756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:09:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:09:14.655135176 +0000 UTC m=+1782.897626290" watchObservedRunningTime="2026-07-08 19:09:14.656593756 +0000 UTC m=+1782.899084876"
Jul 08 19:09:14.717113 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:14.717088    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:14.721909 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:14.721891    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:15.622136 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:15.622104    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:15.623073 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:15.623053    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:16.587645 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:16.587600    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:09:16.669907 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:16.669878    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:16.771956 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:16.771934    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:16.846300 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:16.846275    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:17.190528 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:17.190443    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:17.399932 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:17.399908    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:17.500929 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:17.500852    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:21.225208 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:21.225179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:21.884737 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:21.884708    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:21.982764 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:21.982733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:22.394137 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:22.394107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:25.524017 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:25.523922    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:09:28.128034 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:28.127993    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:28.234742 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:28.234702    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:28.573609 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:28.573525    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:29.006366 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:29.006334    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:29.062404 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:29.062375    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:30.623834 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:30.623802    2563 patch_prober.go:28] interesting pod/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Jul 08 19:09:30.624220 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:30.623855    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p" podUID="419f9771-36a1-45a2-9e51-d3b0df6724ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Jul 08 19:09:30.683488 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:30.683462    2563 generic.go:356] "Generic (PLEG): container finished" podID="419f9771-36a1-45a2-9e51-d3b0df6724ff" containerID="555baaf2826068dc092fe71dfccdb4e50b5c3560074ac87848b5b6433b63b7f9" exitCode=0
Jul 08 19:09:30.683589 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:30.683539    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p" event={"ID":"419f9771-36a1-45a2-9e51-d3b0df6724ff","Type":"ContainerDied","Data":"555baaf2826068dc092fe71dfccdb4e50b5c3560074ac87848b5b6433b63b7f9"}
Jul 08 19:09:30.683893 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:30.683880    2563 scope.go:117] "RemoveContainer" containerID="555baaf2826068dc092fe71dfccdb4e50b5c3560074ac87848b5b6433b63b7f9"
Jul 08 19:09:30.684725 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:30.684698    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:09:30.684788 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:30.684763    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:09:30.684826 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:30.684791    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:09:31.689735 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:31.689699    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p" event={"ID":"419f9771-36a1-45a2-9e51-d3b0df6724ff","Type":"ContainerStarted","Data":"cbc457db03dc9246d5582adffd61f0cd6c65359dbd19940e7e974a213f019a4f"}
Jul 08 19:09:31.717727 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:31.717359    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:31.717727 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:31.717462    2563 patch_prober.go:28] interesting pod/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Jul 08 19:09:31.717727 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:31.717502    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p" podUID="419f9771-36a1-45a2-9e51-d3b0df6724ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Jul 08 19:09:32.242238 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:32.242210    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 19:09:32.242968 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:32.242942    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 19:09:32.717721 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:32.717689    2563 patch_prober.go:28] interesting pod/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Jul 08 19:09:32.718256 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:32.718226    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p" podUID="419f9771-36a1-45a2-9e51-d3b0df6724ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Jul 08 19:09:33.584460 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:33.584429    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:09:33.718135 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:33.718101    2563 patch_prober.go:28] interesting pod/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Jul 08 19:09:33.718592 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:33.718161    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p" podUID="419f9771-36a1-45a2-9e51-d3b0df6724ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Jul 08 19:09:34.727019 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:34.726980    2563 patch_prober.go:28] interesting pod/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Jul 08 19:09:34.727507 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:34.727050    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p" podUID="419f9771-36a1-45a2-9e51-d3b0df6724ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Jul 08 19:09:35.085006 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:35.084926    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:35.201056 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:35.201023    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:35.375572 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:35.375533    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"]
Jul 08 19:09:35.375773 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:35.375750    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p" podUID="419f9771-36a1-45a2-9e51-d3b0df6724ff" containerName="istio-proxy" containerID="cri-o://cbc457db03dc9246d5582adffd61f0cd6c65359dbd19940e7e974a213f019a4f" gracePeriod=30
Jul 08 19:09:35.404818 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:35.404794    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:35.780866 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:35.780787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:35.875619 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:35.875593    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:36.026829 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:36.026802    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:40.918402 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:40.918380    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:41.038804 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.038736    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-data\") pod \"419f9771-36a1-45a2-9e51-d3b0df6724ff\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") "
Jul 08 19:09:41.038924 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.038820    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cz9g\" (UniqueName: \"kubernetes.io/projected/419f9771-36a1-45a2-9e51-d3b0df6724ff-kube-api-access-4cz9g\") pod \"419f9771-36a1-45a2-9e51-d3b0df6724ff\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") "
Jul 08 19:09:41.038924 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.038845    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/419f9771-36a1-45a2-9e51-d3b0df6724ff-istiod-ca-cert\") pod \"419f9771-36a1-45a2-9e51-d3b0df6724ff\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") "
Jul 08 19:09:41.038924 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.038864    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-token\") pod \"419f9771-36a1-45a2-9e51-d3b0df6724ff\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") "
Jul 08 19:09:41.038924 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.038884    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-workload-socket\") pod \"419f9771-36a1-45a2-9e51-d3b0df6724ff\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") "
Jul 08 19:09:41.039141 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.038991    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-credential-socket\") pod \"419f9771-36a1-45a2-9e51-d3b0df6724ff\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") "
Jul 08 19:09:41.039141 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.039036    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-workload-certs\") pod \"419f9771-36a1-45a2-9e51-d3b0df6724ff\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") "
Jul 08 19:09:41.039141 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.039100    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-envoy\") pod \"419f9771-36a1-45a2-9e51-d3b0df6724ff\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") "
Jul 08 19:09:41.039141 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.039123    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-podinfo\") pod \"419f9771-36a1-45a2-9e51-d3b0df6724ff\" (UID: \"419f9771-36a1-45a2-9e51-d3b0df6724ff\") "
Jul 08 19:09:41.039531 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.039140    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "419f9771-36a1-45a2-9e51-d3b0df6724ff" (UID: "419f9771-36a1-45a2-9e51-d3b0df6724ff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:09:41.039531 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.039232    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/419f9771-36a1-45a2-9e51-d3b0df6724ff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "419f9771-36a1-45a2-9e51-d3b0df6724ff" (UID: "419f9771-36a1-45a2-9e51-d3b0df6724ff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:09:41.039531 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.039327    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "419f9771-36a1-45a2-9e51-d3b0df6724ff" (UID: "419f9771-36a1-45a2-9e51-d3b0df6724ff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:09:41.039835 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.039804    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-data" (OuterVolumeSpecName: "istio-data") pod "419f9771-36a1-45a2-9e51-d3b0df6724ff" (UID: "419f9771-36a1-45a2-9e51-d3b0df6724ff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:09:41.039902 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.039809    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "419f9771-36a1-45a2-9e51-d3b0df6724ff" (UID: "419f9771-36a1-45a2-9e51-d3b0df6724ff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:09:41.040021 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.039994    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/419f9771-36a1-45a2-9e51-d3b0df6724ff-istiod-ca-cert\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:09:41.040021 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.040020    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-workload-socket\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:09:41.040150 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.040036    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-credential-socket\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:09:41.043697 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.041400    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-token" (OuterVolumeSpecName: "istio-token") pod "419f9771-36a1-45a2-9e51-d3b0df6724ff" (UID: "419f9771-36a1-45a2-9e51-d3b0df6724ff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:09:41.046575 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.046549    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "419f9771-36a1-45a2-9e51-d3b0df6724ff" (UID: "419f9771-36a1-45a2-9e51-d3b0df6724ff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 19:09:41.046917 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.046721    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "419f9771-36a1-45a2-9e51-d3b0df6724ff" (UID: "419f9771-36a1-45a2-9e51-d3b0df6724ff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:09:41.046917 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.046724    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/419f9771-36a1-45a2-9e51-d3b0df6724ff-kube-api-access-4cz9g" (OuterVolumeSpecName: "kube-api-access-4cz9g") pod "419f9771-36a1-45a2-9e51-d3b0df6724ff" (UID: "419f9771-36a1-45a2-9e51-d3b0df6724ff"). InnerVolumeSpecName "kube-api-access-4cz9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:09:41.140714 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.140694    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cz9g\" (UniqueName: \"kubernetes.io/projected/419f9771-36a1-45a2-9e51-d3b0df6724ff-kube-api-access-4cz9g\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:09:41.140714 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.140714    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-token\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:09:41.140835 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.140723    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-workload-certs\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:09:41.140835 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.140731    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-envoy\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:09:41.140835 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.140739    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-podinfo\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:09:41.140835 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.140746    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/419f9771-36a1-45a2-9e51-d3b0df6724ff-istio-data\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:09:41.726582 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.726558    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:41.735695 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.735671    2563 generic.go:356] "Generic (PLEG): container finished" podID="419f9771-36a1-45a2-9e51-d3b0df6724ff" containerID="cbc457db03dc9246d5582adffd61f0cd6c65359dbd19940e7e974a213f019a4f" exitCode=0
Jul 08 19:09:41.735787 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.735729    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"
Jul 08 19:09:41.735787 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.735747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p" event={"ID":"419f9771-36a1-45a2-9e51-d3b0df6724ff","Type":"ContainerDied","Data":"cbc457db03dc9246d5582adffd61f0cd6c65359dbd19940e7e974a213f019a4f"}
Jul 08 19:09:41.735876 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.735797    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p" event={"ID":"419f9771-36a1-45a2-9e51-d3b0df6724ff","Type":"ContainerDied","Data":"a5071d63bf87ee5d90fffe80e4ae5ef6fdc21be6944d9bd124c5bdc9aa35aa45"}
Jul 08 19:09:41.735876 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.735819    2563 scope.go:117] "RemoveContainer" containerID="cbc457db03dc9246d5582adffd61f0cd6c65359dbd19940e7e974a213f019a4f"
Jul 08 19:09:41.744798 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.744783    2563 scope.go:117] "RemoveContainer" containerID="555baaf2826068dc092fe71dfccdb4e50b5c3560074ac87848b5b6433b63b7f9"
Jul 08 19:09:41.752369 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.752345    2563 scope.go:117] "RemoveContainer" containerID="cbc457db03dc9246d5582adffd61f0cd6c65359dbd19940e7e974a213f019a4f"
Jul 08 19:09:41.752595 ip-10-0-129-111 kubenswrapper[2563]: E0708 19:09:41.752578    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbc457db03dc9246d5582adffd61f0cd6c65359dbd19940e7e974a213f019a4f\": container with ID starting with cbc457db03dc9246d5582adffd61f0cd6c65359dbd19940e7e974a213f019a4f not found: ID does not exist" containerID="cbc457db03dc9246d5582adffd61f0cd6c65359dbd19940e7e974a213f019a4f"
Jul 08 19:09:41.752688 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.752600    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbc457db03dc9246d5582adffd61f0cd6c65359dbd19940e7e974a213f019a4f"} err="failed to get container status \"cbc457db03dc9246d5582adffd61f0cd6c65359dbd19940e7e974a213f019a4f\": rpc error: code = NotFound desc = could not find container \"cbc457db03dc9246d5582adffd61f0cd6c65359dbd19940e7e974a213f019a4f\": container with ID starting with cbc457db03dc9246d5582adffd61f0cd6c65359dbd19940e7e974a213f019a4f not found: ID does not exist"
Jul 08 19:09:41.752688 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.752614    2563 scope.go:117] "RemoveContainer" containerID="555baaf2826068dc092fe71dfccdb4e50b5c3560074ac87848b5b6433b63b7f9"
Jul 08 19:09:41.752836 ip-10-0-129-111 kubenswrapper[2563]: E0708 19:09:41.752819    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"555baaf2826068dc092fe71dfccdb4e50b5c3560074ac87848b5b6433b63b7f9\": container with ID starting with 555baaf2826068dc092fe71dfccdb4e50b5c3560074ac87848b5b6433b63b7f9 not found: ID does not exist" containerID="555baaf2826068dc092fe71dfccdb4e50b5c3560074ac87848b5b6433b63b7f9"
Jul 08 19:09:41.752874 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.752841    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"555baaf2826068dc092fe71dfccdb4e50b5c3560074ac87848b5b6433b63b7f9"} err="failed to get container status \"555baaf2826068dc092fe71dfccdb4e50b5c3560074ac87848b5b6433b63b7f9\": rpc error: code = NotFound desc = could not find container \"555baaf2826068dc092fe71dfccdb4e50b5c3560074ac87848b5b6433b63b7f9\": container with ID starting with 555baaf2826068dc092fe71dfccdb4e50b5c3560074ac87848b5b6433b63b7f9 not found: ID does not exist"
Jul 08 19:09:41.758114 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.758093    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"]
Jul 08 19:09:41.765391 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.765371    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5071b272-openshift-default-7bcffcc7f5-tfh4p"]
Jul 08 19:09:41.787616 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.787593    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:41.868168 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.868145    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:41.970364 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:41.970342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:42.088768 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:42.088749    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:42.223130 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:42.223108    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="419f9771-36a1-45a2-9e51-d3b0df6724ff" path="/var/lib/kubelet/pods/419f9771-36a1-45a2-9e51-d3b0df6724ff/volumes"
Jul 08 19:09:47.903638 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:47.903603    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:47.962384 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:47.962355    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:54.946751 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:54.946715    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:55.280688 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.280593    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"]
Jul 08 19:09:55.280980 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.280939    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="419f9771-36a1-45a2-9e51-d3b0df6724ff" containerName="istio-proxy"
Jul 08 19:09:55.281073 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.280983    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="419f9771-36a1-45a2-9e51-d3b0df6724ff" containerName="istio-proxy"
Jul 08 19:09:55.281126 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.281082    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="419f9771-36a1-45a2-9e51-d3b0df6724ff" containerName="istio-proxy"
Jul 08 19:09:55.281126 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.281096    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="419f9771-36a1-45a2-9e51-d3b0df6724ff" containerName="istio-proxy"
Jul 08 19:09:55.285601 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.285580    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.288903 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.288883    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 19:09:55.289120 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.289096    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2ab8abd0-openshift-default-dockercfg-bbgq2\""
Jul 08 19:09:55.300847 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.300826    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"]
Jul 08 19:09:55.310942 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.310917    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:55.441456 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.441432    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-istio-envoy\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.441607 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.441461    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-credential-socket\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.441607 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.441482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-workload-socket\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.441607 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.441501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a75eb467-658c-476b-bc51-41801fd71b23-istio-podinfo\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.441827 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.441645    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-workload-certs\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.441827 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.441699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a75eb467-658c-476b-bc51-41801fd71b23-istiod-ca-cert\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.441827 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.441735    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a75eb467-658c-476b-bc51-41801fd71b23-istio-token\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.441827 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.441763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-istio-data\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.441827 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.441808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb7xx\" (UniqueName: \"kubernetes.io/projected/a75eb467-658c-476b-bc51-41801fd71b23-kube-api-access-qb7xx\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.462831 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.462807    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:55.543005 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.542947    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-istio-envoy\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.543005 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.542974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-credential-socket\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.543005 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.542991    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-workload-socket\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.543216 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.543009    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a75eb467-658c-476b-bc51-41801fd71b23-istio-podinfo\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.543216 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.543042    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-workload-certs\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.543216 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.543192    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a75eb467-658c-476b-bc51-41801fd71b23-istiod-ca-cert\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.543369 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.543264    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a75eb467-658c-476b-bc51-41801fd71b23-istio-token\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.543643 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.543293    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-istio-data\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.543731 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.543676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb7xx\" (UniqueName: \"kubernetes.io/projected/a75eb467-658c-476b-bc51-41801fd71b23-kube-api-access-qb7xx\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.543731 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.543373    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-workload-socket\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.543840 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.543454    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-workload-certs\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.543840 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.543604    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-istio-data\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.543840 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.543421    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-credential-socket\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.544002 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.543880    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a75eb467-658c-476b-bc51-41801fd71b23-istiod-ca-cert\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.545304 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.545286    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-istio-envoy\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.545609 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.545590    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a75eb467-658c-476b-bc51-41801fd71b23-istio-podinfo\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.551663 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.551640    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a75eb467-658c-476b-bc51-41801fd71b23-istio-token\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.552055 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.552033    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb7xx\" (UniqueName: \"kubernetes.io/projected/a75eb467-658c-476b-bc51-41801fd71b23-kube-api-access-qb7xx\") pod \"e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") " pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.594947 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.594925    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:55.728093 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.728061    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"]
Jul 08 19:09:55.730926 ip-10-0-129-111 kubenswrapper[2563]: W0708 19:09:55.730903    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75eb467_658c_476b_bc51_41801fd71b23.slice/crio-b81c09242c02a4131864d62afeae0c6e6386e604c4633225d8966479703a32a9 WatchSource:0}: Error finding container b81c09242c02a4131864d62afeae0c6e6386e604c4633225d8966479703a32a9: Status 404 returned error can't find the container with id b81c09242c02a4131864d62afeae0c6e6386e604c4633225d8966479703a32a9
Jul 08 19:09:55.733078 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.733048    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:09:55.733152 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.733111    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:09:55.733152 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.733141    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:09:55.790641 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.790601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp" event={"ID":"a75eb467-658c-476b-bc51-41801fd71b23","Type":"ContainerStarted","Data":"ef4f3f80dd54d4f108c0349e7529b3df06b8053a416b56efe699560a35ac5e18"}
Jul 08 19:09:55.790723 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:55.790668    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp" event={"ID":"a75eb467-658c-476b-bc51-41801fd71b23","Type":"ContainerStarted","Data":"b81c09242c02a4131864d62afeae0c6e6386e604c4633225d8966479703a32a9"}
Jul 08 19:09:56.817253 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:56.817202    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp" podStartSLOduration=1.81718664 podStartE2EDuration="1.81718664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:09:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:09:56.815849873 +0000 UTC m=+1825.058340994" watchObservedRunningTime="2026-07-08 19:09:56.81718664 +0000 UTC m=+1825.059677818"
Jul 08 19:09:57.595687 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:57.595653    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:57.600166 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:57.600144    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:57.797739 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:57.797718    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:57.798392 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:57.798374    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:09:58.823331 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:58.823302    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:58.918529 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:58.918503    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:59.162806 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:59.162778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:59.261603 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:59.261578    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:59.748730 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:59.748702    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:09:59.849900 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:09:59.849877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:10:01.574745 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:01.574715    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:10:01.675186 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:01.675159    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:10:02.341305 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:02.341281    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:10:02.442527 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:02.442500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:10:03.364178 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:03.364150    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:10:03.585031 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:03.584998    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:10:11.862306 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:11.862269    2563 generic.go:356] "Generic (PLEG): container finished" podID="a75eb467-658c-476b-bc51-41801fd71b23" containerID="ef4f3f80dd54d4f108c0349e7529b3df06b8053a416b56efe699560a35ac5e18" exitCode=0
Jul 08 19:10:11.862705 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:11.862338    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp" event={"ID":"a75eb467-658c-476b-bc51-41801fd71b23","Type":"ContainerDied","Data":"ef4f3f80dd54d4f108c0349e7529b3df06b8053a416b56efe699560a35ac5e18"}
Jul 08 19:10:11.862758 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:11.862704    2563 scope.go:117] "RemoveContainer" containerID="ef4f3f80dd54d4f108c0349e7529b3df06b8053a416b56efe699560a35ac5e18"
Jul 08 19:10:11.863693 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:11.863662    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:10:11.863761 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:11.863746    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:10:11.863812 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:11.863796    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:10:12.798213 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:12.798178    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:10:12.868418 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:12.868383    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp" event={"ID":"a75eb467-658c-476b-bc51-41801fd71b23","Type":"ContainerStarted","Data":"e0e976492800c5e465eb414fced45982de72d6f4ab71a9756296ca5e8c87ab8c"}
Jul 08 19:10:13.596068 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:13.596033    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:10:13.597012 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:13.596981    2563 patch_prober.go:28] interesting pod/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body=
Jul 08 19:10:13.597138 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:13.597052    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp" podUID="a75eb467-658c-476b-bc51-41801fd71b23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 08 19:10:14.595377 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:14.595337    2563 patch_prober.go:28] interesting pod/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body=
Jul 08 19:10:14.595875 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:14.595395    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp" podUID="a75eb467-658c-476b-bc51-41801fd71b23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 08 19:10:15.595449 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:15.595417    2563 patch_prober.go:28] interesting pod/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body=
Jul 08 19:10:15.595843 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:15.595479    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp" podUID="a75eb467-658c-476b-bc51-41801fd71b23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 08 19:10:16.599825 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.599794    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:10:16.600277 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.600142    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:10:16.600965 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.600945    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:10:16.686123 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.686093    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"]
Jul 08 19:10:16.686376 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.686365    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="419f9771-36a1-45a2-9e51-d3b0df6724ff" containerName="istio-proxy"
Jul 08 19:10:16.686425 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.686378    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="419f9771-36a1-45a2-9e51-d3b0df6724ff" containerName="istio-proxy"
Jul 08 19:10:16.689830 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.689806    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.692429 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.692404    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2ab8abd0\"/\"openshift-service-ca.crt\""
Jul 08 19:10:16.692548 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.692515    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2ab8abd0\"/\"default-dockercfg-rs5mg\""
Jul 08 19:10:16.692638 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.692611    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2ab8abd0\"/\"kube-root-ca.crt\""
Jul 08 19:10:16.692696 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.692682    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2ab8abd0\"/\"e2e-lifecycle-model-2ab8abd0-kserve-self-signed-certs\""
Jul 08 19:10:16.708084 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.708060    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"]
Jul 08 19:10:16.711576 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.711556    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:10:16.721648 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.721619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-home\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.721732 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.721667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-model-cache\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.721732 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.721684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-tmp-dir\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.721812 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.721756    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-tls-certs\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.721857 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.721806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm9l7\" (UniqueName: \"kubernetes.io/projected/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-kube-api-access-vm9l7\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.721895 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.721852    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-dshm\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.822323 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.822294    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-tls-certs\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.822416 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.822333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm9l7\" (UniqueName: \"kubernetes.io/projected/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-kube-api-access-vm9l7\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.822416 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.822353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-dshm\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.822416 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.822392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-home\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.822561 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.822433    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-model-cache\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.822561 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.822460    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-tmp-dir\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.822903 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.822877    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-home\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.822903 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.822896    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-tmp-dir\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.823066 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.822877    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-model-cache\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.824448 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.824424    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-dshm\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.824815 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.824799    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-tls-certs\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.831275 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.831256    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm9l7\" (UniqueName: \"kubernetes.io/projected/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-kube-api-access-vm9l7\") pod \"e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") " pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:16.999271 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:16.999201    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:17.138844 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:17.138818    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"]
Jul 08 19:10:17.141590 ip-10-0-129-111 kubenswrapper[2563]: W0708 19:10:17.141560    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode638b6ee_c6d0_4d83_9025_e2f90a1b9605.slice/crio-ae2af5c79aaaa17d5040a1ebfa57317324a392cbd0f33e2cd06a49bb17435c0c WatchSource:0}: Error finding container ae2af5c79aaaa17d5040a1ebfa57317324a392cbd0f33e2cd06a49bb17435c0c: Status 404 returned error can't find the container with id ae2af5c79aaaa17d5040a1ebfa57317324a392cbd0f33e2cd06a49bb17435c0c
Jul 08 19:10:17.890723 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:17.890689    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc" event={"ID":"e638b6ee-c6d0-4d83-9025-e2f90a1b9605","Type":"ContainerStarted","Data":"494f9154b4c557333b03f6fe9e7fae3089c5bab2f0e9b7b401cb1ac8c9a10c60"}
Jul 08 19:10:17.891074 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:17.890732    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc" event={"ID":"e638b6ee-c6d0-4d83-9025-e2f90a1b9605","Type":"ContainerStarted","Data":"ae2af5c79aaaa17d5040a1ebfa57317324a392cbd0f33e2cd06a49bb17435c0c"}
Jul 08 19:10:17.912835 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:17.912780    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc" podStartSLOduration=1.912761659 podStartE2EDuration="1.912761659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:10:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:10:17.910021043 +0000 UTC m=+1846.152512165" watchObservedRunningTime="2026-07-08 19:10:17.912761659 +0000 UTC m=+1846.155252781"
Jul 08 19:10:20.286570 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:20.286538    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:10:26.999824 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:26.999795    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:27.000195 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:26.999834    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:27.011856 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:27.011837    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:27.941157 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:27.941128    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:10:59.439520 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:10:59.439446    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:11:01.601264 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:01.601226    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:11:02.084698 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:02.084604    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:11:07.772927 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:07.772892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:11:12.748480 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:12.748445    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"]
Jul 08 19:11:12.793200 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:12.793169    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:11:13.279202 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:13.279169    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:11:27.768001 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:27.767940    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc" podUID="e638b6ee-c6d0-4d83-9025-e2f90a1b9605" containerName="main" containerID="cri-o://494f9154b4c557333b03f6fe9e7fae3089c5bab2f0e9b7b401cb1ac8c9a10c60" gracePeriod=45
Jul 08 19:11:27.931328 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:27.931290    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc" podUID="e638b6ee-c6d0-4d83-9025-e2f90a1b9605" containerName="main" probeResult="failure" output="Get \"https://10.133.0.24:8000/ready\": dial tcp 10.133.0.24:8000: connect: connection refused"
Jul 08 19:11:28.005979 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.005949    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:11:28.147309 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.147277    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-tmp-dir\") pod \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") "
Jul 08 19:11:28.147470 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.147323    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-tls-certs\") pod \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") "
Jul 08 19:11:28.147470 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.147371    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-dshm\") pod \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") "
Jul 08 19:11:28.147470 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.147413    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm9l7\" (UniqueName: \"kubernetes.io/projected/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-kube-api-access-vm9l7\") pod \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") "
Jul 08 19:11:28.147470 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.147448    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-model-cache\") pod \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") "
Jul 08 19:11:28.147708 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.147475    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-home\") pod \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\" (UID: \"e638b6ee-c6d0-4d83-9025-e2f90a1b9605\") "
Jul 08 19:11:28.147708 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.147556    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e638b6ee-c6d0-4d83-9025-e2f90a1b9605" (UID: "e638b6ee-c6d0-4d83-9025-e2f90a1b9605"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:11:28.147806 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.147762    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-model-cache" (OuterVolumeSpecName: "model-cache") pod "e638b6ee-c6d0-4d83-9025-e2f90a1b9605" (UID: "e638b6ee-c6d0-4d83-9025-e2f90a1b9605"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:11:28.147806 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.147795    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-tmp-dir\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:11:28.147883 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.147806    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-home" (OuterVolumeSpecName: "home") pod "e638b6ee-c6d0-4d83-9025-e2f90a1b9605" (UID: "e638b6ee-c6d0-4d83-9025-e2f90a1b9605"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:11:28.149515 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.149490    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e638b6ee-c6d0-4d83-9025-e2f90a1b9605" (UID: "e638b6ee-c6d0-4d83-9025-e2f90a1b9605"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 19:11:28.149891 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.149863    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-dshm" (OuterVolumeSpecName: "dshm") pod "e638b6ee-c6d0-4d83-9025-e2f90a1b9605" (UID: "e638b6ee-c6d0-4d83-9025-e2f90a1b9605"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:11:28.149979 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.149901    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-kube-api-access-vm9l7" (OuterVolumeSpecName: "kube-api-access-vm9l7") pod "e638b6ee-c6d0-4d83-9025-e2f90a1b9605" (UID: "e638b6ee-c6d0-4d83-9025-e2f90a1b9605"). InnerVolumeSpecName "kube-api-access-vm9l7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:11:28.174787 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.174765    2563 generic.go:356] "Generic (PLEG): container finished" podID="e638b6ee-c6d0-4d83-9025-e2f90a1b9605" containerID="494f9154b4c557333b03f6fe9e7fae3089c5bab2f0e9b7b401cb1ac8c9a10c60" exitCode=0
Jul 08 19:11:28.175005 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.174814    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"
Jul 08 19:11:28.175005 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.174837    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc" event={"ID":"e638b6ee-c6d0-4d83-9025-e2f90a1b9605","Type":"ContainerDied","Data":"494f9154b4c557333b03f6fe9e7fae3089c5bab2f0e9b7b401cb1ac8c9a10c60"}
Jul 08 19:11:28.175005 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.174869    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc" event={"ID":"e638b6ee-c6d0-4d83-9025-e2f90a1b9605","Type":"ContainerDied","Data":"ae2af5c79aaaa17d5040a1ebfa57317324a392cbd0f33e2cd06a49bb17435c0c"}
Jul 08 19:11:28.175005 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.174889    2563 scope.go:117] "RemoveContainer" containerID="494f9154b4c557333b03f6fe9e7fae3089c5bab2f0e9b7b401cb1ac8c9a10c60"
Jul 08 19:11:28.183431 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.183415    2563 scope.go:117] "RemoveContainer" containerID="494f9154b4c557333b03f6fe9e7fae3089c5bab2f0e9b7b401cb1ac8c9a10c60"
Jul 08 19:11:28.183716 ip-10-0-129-111 kubenswrapper[2563]: E0708 19:11:28.183696    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"494f9154b4c557333b03f6fe9e7fae3089c5bab2f0e9b7b401cb1ac8c9a10c60\": container with ID starting with 494f9154b4c557333b03f6fe9e7fae3089c5bab2f0e9b7b401cb1ac8c9a10c60 not found: ID does not exist" containerID="494f9154b4c557333b03f6fe9e7fae3089c5bab2f0e9b7b401cb1ac8c9a10c60"
Jul 08 19:11:28.183772 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.183724    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"494f9154b4c557333b03f6fe9e7fae3089c5bab2f0e9b7b401cb1ac8c9a10c60"} err="failed to get container status \"494f9154b4c557333b03f6fe9e7fae3089c5bab2f0e9b7b401cb1ac8c9a10c60\": rpc error: code = NotFound desc = could not find container \"494f9154b4c557333b03f6fe9e7fae3089c5bab2f0e9b7b401cb1ac8c9a10c60\": container with ID starting with 494f9154b4c557333b03f6fe9e7fae3089c5bab2f0e9b7b401cb1ac8c9a10c60 not found: ID does not exist"
Jul 08 19:11:28.196175 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.196153    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"]
Jul 08 19:11:28.199430 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.199411    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-2ab8abd0/e2e-lifecycle-model-2ab8abd0-kserve-7c89cf7cf5-mndkc"]
Jul 08 19:11:28.223369 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.223349    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e638b6ee-c6d0-4d83-9025-e2f90a1b9605" path="/var/lib/kubelet/pods/e638b6ee-c6d0-4d83-9025-e2f90a1b9605/volumes"
Jul 08 19:11:28.248874 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.248855    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-dshm\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:11:28.248874 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.248871    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm9l7\" (UniqueName: \"kubernetes.io/projected/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-kube-api-access-vm9l7\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:11:28.248995 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.248881    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-model-cache\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:11:28.248995 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.248890    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-home\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:11:28.248995 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:28.248898    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e638b6ee-c6d0-4d83-9025-e2f90a1b9605-tls-certs\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:11:48.890970 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:48.890936    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:11:50.308410 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:50.308378    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:11:52.529772 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:52.529743    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:11:56.182188 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:56.182156    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:11:56.239992 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:56.239967    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:11:56.465493 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:56.465404    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"]
Jul 08 19:11:56.465687 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:56.465657    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp" podUID="a75eb467-658c-476b-bc51-41801fd71b23" containerName="istio-proxy" containerID="cri-o://e0e976492800c5e465eb414fced45982de72d6f4ab71a9756296ca5e8c87ab8c" gracePeriod=30
Jul 08 19:11:56.483175 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:56.483139    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:11:57.821403 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:57.821365    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:11:57.918920 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:57.918893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:11:58.018976 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:58.018939    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:11:58.790122 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:58.790096    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:11:58.887889 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:58.887864    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:11:58.989660 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:11:58.989620    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:00.467785 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:00.467759    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:01.601705 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.601678    2563 patch_prober.go:28] interesting pod/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body=
Jul 08 19:12:01.602028 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.601730    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp" podUID="a75eb467-658c-476b-bc51-41801fd71b23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 08 19:12:01.699077 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.699056    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:12:01.789371 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.789309    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a75eb467-658c-476b-bc51-41801fd71b23-istiod-ca-cert\") pod \"a75eb467-658c-476b-bc51-41801fd71b23\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") "
Jul 08 19:12:01.789371 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.789350    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-workload-socket\") pod \"a75eb467-658c-476b-bc51-41801fd71b23\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") "
Jul 08 19:12:01.789580 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.789391    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-istio-data\") pod \"a75eb467-658c-476b-bc51-41801fd71b23\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") "
Jul 08 19:12:01.789580 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.789430    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-credential-socket\") pod \"a75eb467-658c-476b-bc51-41801fd71b23\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") "
Jul 08 19:12:01.789580 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.789447    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qb7xx\" (UniqueName: \"kubernetes.io/projected/a75eb467-658c-476b-bc51-41801fd71b23-kube-api-access-qb7xx\") pod \"a75eb467-658c-476b-bc51-41801fd71b23\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") "
Jul 08 19:12:01.789580 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.789476    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-istio-envoy\") pod \"a75eb467-658c-476b-bc51-41801fd71b23\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") "
Jul 08 19:12:01.789580 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.789498    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-workload-certs\") pod \"a75eb467-658c-476b-bc51-41801fd71b23\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") "
Jul 08 19:12:01.789580 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.789568    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a75eb467-658c-476b-bc51-41801fd71b23-istio-podinfo\") pod \"a75eb467-658c-476b-bc51-41801fd71b23\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") "
Jul 08 19:12:01.789908 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.789594    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a75eb467-658c-476b-bc51-41801fd71b23-istio-token\") pod \"a75eb467-658c-476b-bc51-41801fd71b23\" (UID: \"a75eb467-658c-476b-bc51-41801fd71b23\") "
Jul 08 19:12:01.789908 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.789836    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a75eb467-658c-476b-bc51-41801fd71b23" (UID: "a75eb467-658c-476b-bc51-41801fd71b23"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:12:01.790016 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.789921    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a75eb467-658c-476b-bc51-41801fd71b23" (UID: "a75eb467-658c-476b-bc51-41801fd71b23"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:12:01.790138 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.790108    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a75eb467-658c-476b-bc51-41801fd71b23" (UID: "a75eb467-658c-476b-bc51-41801fd71b23"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:12:01.790194 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.790176    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a75eb467-658c-476b-bc51-41801fd71b23-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a75eb467-658c-476b-bc51-41801fd71b23" (UID: "a75eb467-658c-476b-bc51-41801fd71b23"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:12:01.790473 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.790432    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-istio-data" (OuterVolumeSpecName: "istio-data") pod "a75eb467-658c-476b-bc51-41801fd71b23" (UID: "a75eb467-658c-476b-bc51-41801fd71b23"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:12:01.792030 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.792008    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a75eb467-658c-476b-bc51-41801fd71b23" (UID: "a75eb467-658c-476b-bc51-41801fd71b23"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:12:01.792123 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.792058    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a75eb467-658c-476b-bc51-41801fd71b23-kube-api-access-qb7xx" (OuterVolumeSpecName: "kube-api-access-qb7xx") pod "a75eb467-658c-476b-bc51-41801fd71b23" (UID: "a75eb467-658c-476b-bc51-41801fd71b23"). InnerVolumeSpecName "kube-api-access-qb7xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:12:01.792380 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.792360    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a75eb467-658c-476b-bc51-41801fd71b23-istio-token" (OuterVolumeSpecName: "istio-token") pod "a75eb467-658c-476b-bc51-41801fd71b23" (UID: "a75eb467-658c-476b-bc51-41801fd71b23"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:12:01.792428 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.792362    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a75eb467-658c-476b-bc51-41801fd71b23-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a75eb467-658c-476b-bc51-41801fd71b23" (UID: "a75eb467-658c-476b-bc51-41801fd71b23"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 19:12:01.890854 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.890835    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-credential-socket\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:12:01.890854 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.890855    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qb7xx\" (UniqueName: \"kubernetes.io/projected/a75eb467-658c-476b-bc51-41801fd71b23-kube-api-access-qb7xx\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:12:01.890976 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.890865    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-istio-envoy\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:12:01.890976 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.890873    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-workload-certs\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:12:01.890976 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.890881    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a75eb467-658c-476b-bc51-41801fd71b23-istio-podinfo\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:12:01.890976 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.890888    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a75eb467-658c-476b-bc51-41801fd71b23-istio-token\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:12:01.890976 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.890896    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a75eb467-658c-476b-bc51-41801fd71b23-istiod-ca-cert\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:12:01.890976 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.890903    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-workload-socket\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:12:01.890976 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:01.890910    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a75eb467-658c-476b-bc51-41801fd71b23-istio-data\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:12:02.328354 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:02.328318    2563 generic.go:356] "Generic (PLEG): container finished" podID="a75eb467-658c-476b-bc51-41801fd71b23" containerID="e0e976492800c5e465eb414fced45982de72d6f4ab71a9756296ca5e8c87ab8c" exitCode=0
Jul 08 19:12:02.328535 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:02.328369    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"
Jul 08 19:12:02.328535 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:02.328396    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp" event={"ID":"a75eb467-658c-476b-bc51-41801fd71b23","Type":"ContainerDied","Data":"e0e976492800c5e465eb414fced45982de72d6f4ab71a9756296ca5e8c87ab8c"}
Jul 08 19:12:02.328535 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:02.328479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp" event={"ID":"a75eb467-658c-476b-bc51-41801fd71b23","Type":"ContainerDied","Data":"b81c09242c02a4131864d62afeae0c6e6386e604c4633225d8966479703a32a9"}
Jul 08 19:12:02.328535 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:02.328511    2563 scope.go:117] "RemoveContainer" containerID="e0e976492800c5e465eb414fced45982de72d6f4ab71a9756296ca5e8c87ab8c"
Jul 08 19:12:02.336515 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:02.336499    2563 scope.go:117] "RemoveContainer" containerID="ef4f3f80dd54d4f108c0349e7529b3df06b8053a416b56efe699560a35ac5e18"
Jul 08 19:12:02.343506 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:02.343488    2563 scope.go:117] "RemoveContainer" containerID="e0e976492800c5e465eb414fced45982de72d6f4ab71a9756296ca5e8c87ab8c"
Jul 08 19:12:02.343843 ip-10-0-129-111 kubenswrapper[2563]: E0708 19:12:02.343826    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0e976492800c5e465eb414fced45982de72d6f4ab71a9756296ca5e8c87ab8c\": container with ID starting with e0e976492800c5e465eb414fced45982de72d6f4ab71a9756296ca5e8c87ab8c not found: ID does not exist" containerID="e0e976492800c5e465eb414fced45982de72d6f4ab71a9756296ca5e8c87ab8c"
Jul 08 19:12:02.343910 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:02.343850    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e976492800c5e465eb414fced45982de72d6f4ab71a9756296ca5e8c87ab8c"} err="failed to get container status \"e0e976492800c5e465eb414fced45982de72d6f4ab71a9756296ca5e8c87ab8c\": rpc error: code = NotFound desc = could not find container \"e0e976492800c5e465eb414fced45982de72d6f4ab71a9756296ca5e8c87ab8c\": container with ID starting with e0e976492800c5e465eb414fced45982de72d6f4ab71a9756296ca5e8c87ab8c not found: ID does not exist"
Jul 08 19:12:02.343910 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:02.343865    2563 scope.go:117] "RemoveContainer" containerID="ef4f3f80dd54d4f108c0349e7529b3df06b8053a416b56efe699560a35ac5e18"
Jul 08 19:12:02.344075 ip-10-0-129-111 kubenswrapper[2563]: E0708 19:12:02.344061    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef4f3f80dd54d4f108c0349e7529b3df06b8053a416b56efe699560a35ac5e18\": container with ID starting with ef4f3f80dd54d4f108c0349e7529b3df06b8053a416b56efe699560a35ac5e18 not found: ID does not exist" containerID="ef4f3f80dd54d4f108c0349e7529b3df06b8053a416b56efe699560a35ac5e18"
Jul 08 19:12:02.344112 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:02.344078    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef4f3f80dd54d4f108c0349e7529b3df06b8053a416b56efe699560a35ac5e18"} err="failed to get container status \"ef4f3f80dd54d4f108c0349e7529b3df06b8053a416b56efe699560a35ac5e18\": rpc error: code = NotFound desc = could not find container \"ef4f3f80dd54d4f108c0349e7529b3df06b8053a416b56efe699560a35ac5e18\": container with ID starting with ef4f3f80dd54d4f108c0349e7529b3df06b8053a416b56efe699560a35ac5e18 not found: ID does not exist"
Jul 08 19:12:02.347499 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:02.347479    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"]
Jul 08 19:12:02.353481 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:02.353462    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2ab8abd0-openshift-default-6b77b76847-z87wp"]
Jul 08 19:12:04.224196 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:04.224163    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a75eb467-658c-476b-bc51-41801fd71b23" path="/var/lib/kubelet/pods/a75eb467-658c-476b-bc51-41801fd71b23/volumes"
Jul 08 19:12:06.261620 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:06.261585    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:06.319203 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:06.319179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:06.956672 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:06.956640    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:12.726492 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:12.726458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:12.792021 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:12.791979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:12.858158 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:12.858130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:12.959051 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:12.959016    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:20.780254 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:20.780216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:23.463860 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:23.463831    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:23.840459 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:23.840434    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:44.870207 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:44.870172    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:50.645694 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:50.645662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:50.705421 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:50.705395    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:51.036039 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.035972    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:51.354097 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.354067    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"]
Jul 08 19:12:51.354343 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.354331    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a75eb467-658c-476b-bc51-41801fd71b23" containerName="istio-proxy"
Jul 08 19:12:51.354394 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.354344    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a75eb467-658c-476b-bc51-41801fd71b23" containerName="istio-proxy"
Jul 08 19:12:51.354394 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.354356    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a75eb467-658c-476b-bc51-41801fd71b23" containerName="istio-proxy"
Jul 08 19:12:51.354394 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.354361    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a75eb467-658c-476b-bc51-41801fd71b23" containerName="istio-proxy"
Jul 08 19:12:51.354394 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.354376    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e638b6ee-c6d0-4d83-9025-e2f90a1b9605" containerName="main"
Jul 08 19:12:51.354394 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.354382    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e638b6ee-c6d0-4d83-9025-e2f90a1b9605" containerName="main"
Jul 08 19:12:51.354549 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.354424    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a75eb467-658c-476b-bc51-41801fd71b23" containerName="istio-proxy"
Jul 08 19:12:51.354549 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.354434    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a75eb467-658c-476b-bc51-41801fd71b23" containerName="istio-proxy"
Jul 08 19:12:51.354549 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.354440    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e638b6ee-c6d0-4d83-9025-e2f90a1b9605" containerName="main"
Jul 08 19:12:51.357218 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.357202    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.359846 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.359828    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 19:12:51.359952 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.359885    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-abcbfa-openshift-default-dockercfg-jngkr\""
Jul 08 19:12:51.369639 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.369605    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"]
Jul 08 19:12:51.378798 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.378780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:51.428126 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.428103    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4786479-2874-441b-86b8-28b0796ccd04-istio-token\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.428222 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.428132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph4lj\" (UniqueName: \"kubernetes.io/projected/a4786479-2874-441b-86b8-28b0796ccd04-kube-api-access-ph4lj\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.428222 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.428156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-istio-data\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.428299 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.428237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-workload-certs\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.428299 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.428274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4786479-2874-441b-86b8-28b0796ccd04-istio-podinfo\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.428366 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.428299    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-credential-socket\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.428366 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.428320    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-workload-socket\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.428432 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.428386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-istio-envoy\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.428432 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.428413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4786479-2874-441b-86b8-28b0796ccd04-istiod-ca-cert\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.528955 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.528926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-workload-certs\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.529086 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.528970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4786479-2874-441b-86b8-28b0796ccd04-istio-podinfo\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.529153 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.529085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-credential-socket\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.529153 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.529116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-workload-socket\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.529264 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.529163    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-istio-envoy\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.529264 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.529192    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4786479-2874-441b-86b8-28b0796ccd04-istiod-ca-cert\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.529264 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.529219    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4786479-2874-441b-86b8-28b0796ccd04-istio-token\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.529264 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.529235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph4lj\" (UniqueName: \"kubernetes.io/projected/a4786479-2874-441b-86b8-28b0796ccd04-kube-api-access-ph4lj\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.529473 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.529272    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-istio-data\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.529473 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.529323    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-workload-certs\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.529473 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.529391    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-credential-socket\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.529619 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.529582    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-istio-data\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.529755 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.529740    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-workload-socket\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.529984 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.529964    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4786479-2874-441b-86b8-28b0796ccd04-istiod-ca-cert\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.531343 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.531316    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-istio-envoy\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.531539 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.531521    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4786479-2874-441b-86b8-28b0796ccd04-istio-podinfo\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.538278 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.538248    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4786479-2874-441b-86b8-28b0796ccd04-istio-token\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.538440 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.538416    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph4lj\" (UniqueName: \"kubernetes.io/projected/a4786479-2874-441b-86b8-28b0796ccd04-kube-api-access-ph4lj\") pod \"e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") " pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.667221 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.667167    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:51.796052 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.796028    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"]
Jul 08 19:12:51.797987 ip-10-0-129-111 kubenswrapper[2563]: W0708 19:12:51.797961    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4786479_2874_441b_86b8_28b0796ccd04.slice/crio-8d8f558259905c6f64159493f5ed9b4711b793b9d5f03858e99cfed2d10d1a0b WatchSource:0}: Error finding container 8d8f558259905c6f64159493f5ed9b4711b793b9d5f03858e99cfed2d10d1a0b: Status 404 returned error can't find the container with id 8d8f558259905c6f64159493f5ed9b4711b793b9d5f03858e99cfed2d10d1a0b
Jul 08 19:12:51.800063 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.800031    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:12:51.800154 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.800094    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:12:51.800154 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.800126    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:12:51.936985 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:51.936911    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:52.514867 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:52.514828    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n" event={"ID":"a4786479-2874-441b-86b8-28b0796ccd04","Type":"ContainerStarted","Data":"21146d678394ee87aed9faf785209360df73c4187252851fda894b0eddffe4d4"}
Jul 08 19:12:52.515035 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:52.514893    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n" event={"ID":"a4786479-2874-441b-86b8-28b0796ccd04","Type":"ContainerStarted","Data":"8d8f558259905c6f64159493f5ed9b4711b793b9d5f03858e99cfed2d10d1a0b"}
Jul 08 19:12:52.540196 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:52.540151    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n" podStartSLOduration=1.540137796 podStartE2EDuration="1.540137796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:12:52.537489062 +0000 UTC m=+2000.779980183" watchObservedRunningTime="2026-07-08 19:12:52.540137796 +0000 UTC m=+2000.782628916"
Jul 08 19:12:52.667681 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:52.667652    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:52.672272 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:52.672251    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:53.518420 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:53.518382    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:53.519199 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:53.519180    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:12:54.521497 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:54.521462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:54.611737 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:54.611713    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:54.738843 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:54.738818    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:54.967640 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:54.967598    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:55.180776 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:55.180746    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:55.280817 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:55.280745    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:59.092176 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:59.092143    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:59.450490 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:59.450425    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:12:59.789358 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:12:59.789292    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:00.022399 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:00.022364    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:00.686093 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:00.686062    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:13:03.138853 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:03.138814    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:03.229298 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:03.229250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:03.305465 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:03.305437    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:03.692375 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:03.692350    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:03.841128 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:03.841101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:03.945982 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:03.945910    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:07.681963 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:07.681901    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:08.520375 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:08.520309    2563 patch_prober.go:28] interesting pod/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 08 19:13:08.520517 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:08.520369    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n" podUID="a4786479-2874-441b-86b8-28b0796ccd04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 08 19:13:08.577395 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:08.577370    2563 generic.go:356] "Generic (PLEG): container finished" podID="a4786479-2874-441b-86b8-28b0796ccd04" containerID="21146d678394ee87aed9faf785209360df73c4187252851fda894b0eddffe4d4" exitCode=0
Jul 08 19:13:08.577498 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:08.577410    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n" event={"ID":"a4786479-2874-441b-86b8-28b0796ccd04","Type":"ContainerDied","Data":"21146d678394ee87aed9faf785209360df73c4187252851fda894b0eddffe4d4"}
Jul 08 19:13:08.577822 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:08.577802    2563 scope.go:117] "RemoveContainer" containerID="21146d678394ee87aed9faf785209360df73c4187252851fda894b0eddffe4d4"
Jul 08 19:13:08.578829 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:08.578794    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:13:08.578941 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:08.578863    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:13:08.578941 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:08.578895    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:13:09.583869 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:09.583837    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n" event={"ID":"a4786479-2874-441b-86b8-28b0796ccd04","Type":"ContainerStarted","Data":"9fcf4e6c5f5e956719e98f6386addbf0af167bd7abc12b77a5a29a33f5ab1f35"}
Jul 08 19:13:09.667611 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:09.667574    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:13:09.667882 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:09.667858    2563 patch_prober.go:28] interesting pod/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 08 19:13:09.667934 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:09.667905    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n" podUID="a4786479-2874-441b-86b8-28b0796ccd04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 08 19:13:10.667478 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:10.667448    2563 patch_prober.go:28] interesting pod/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 08 19:13:10.667891 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:10.667495    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n" podUID="a4786479-2874-441b-86b8-28b0796ccd04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 08 19:13:11.667839 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:11.667804    2563 patch_prober.go:28] interesting pod/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 08 19:13:11.668211 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:11.667855    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n" podUID="a4786479-2874-441b-86b8-28b0796ccd04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 08 19:13:12.667985 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:12.667949    2563 patch_prober.go:28] interesting pod/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 08 19:13:12.668438 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:12.668017    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n" podUID="a4786479-2874-441b-86b8-28b0796ccd04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 08 19:13:13.384090 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:13.384057    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:13:13.672075 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:13.671997    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:13:13.672412 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:13.672338    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:13:13.672954 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:13.672938    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:13:16.024262 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:16.024218    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:16.125844 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:16.125791    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:18.888070 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:18.888036    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"]
Jul 08 19:13:18.891544 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:18.891526    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:18.894310 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:18.894289    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-abcbfa\"/\"openshift-service-ca.crt\""
Jul 08 19:13:18.894413 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:18.894363    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-abcbfa\"/\"test-model-abcbfa-kserve-self-signed-certs\""
Jul 08 19:13:18.895455 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:18.895441    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-abcbfa\"/\"kube-root-ca.crt\""
Jul 08 19:13:18.895818 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:18.895788    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-abcbfa\"/\"default-dockercfg-qk4ml\""
Jul 08 19:13:18.909758 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:18.909734    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"]
Jul 08 19:13:18.915559 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:18.915512    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:19.059965 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.059938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-model-cache\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.060081 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.059978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-tmp-dir\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.060081 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.060043    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6039923b-8021-4c92-8d08-a2e43d5a5199-tls-certs\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.060081 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.060076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-home\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.060189 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.060100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-dshm\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.060189 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.060121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln56q\" (UniqueName: \"kubernetes.io/projected/6039923b-8021-4c92-8d08-a2e43d5a5199-kube-api-access-ln56q\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.160981 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.160914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6039923b-8021-4c92-8d08-a2e43d5a5199-tls-certs\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.160981 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.160948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-home\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.160981 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.160969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-dshm\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.161155 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.161080    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln56q\" (UniqueName: \"kubernetes.io/projected/6039923b-8021-4c92-8d08-a2e43d5a5199-kube-api-access-ln56q\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.161155 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.161133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-model-cache\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.161243 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.161180    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-tmp-dir\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.161333 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.161314    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-home\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.161517 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.161499    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-tmp-dir\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.161598 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.161546    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-model-cache\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.163269 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.163247    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-dshm\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.163444 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.163427    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6039923b-8021-4c92-8d08-a2e43d5a5199-tls-certs\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.168990 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.168967    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln56q\" (UniqueName: \"kubernetes.io/projected/6039923b-8021-4c92-8d08-a2e43d5a5199-kube-api-access-ln56q\") pod \"test-model-abcbfa-kserve-67d7f744ff-v7pnd\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") " pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.200752 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.200731    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:19.329236 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.329206    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"]
Jul 08 19:13:19.331950 ip-10-0-129-111 kubenswrapper[2563]: W0708 19:13:19.331925    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6039923b_8021_4c92_8d08_a2e43d5a5199.slice/crio-0a9ef454209bc715ba0ad76fd7fb4559ec46290d4621db12d701e5e6e4062e73 WatchSource:0}: Error finding container 0a9ef454209bc715ba0ad76fd7fb4559ec46290d4621db12d701e5e6e4062e73: Status 404 returned error can't find the container with id 0a9ef454209bc715ba0ad76fd7fb4559ec46290d4621db12d701e5e6e4062e73
Jul 08 19:13:19.630042 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.630007    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd" event={"ID":"6039923b-8021-4c92-8d08-a2e43d5a5199","Type":"ContainerStarted","Data":"32a3399d6204b935b346378b6f4f144fa025e9bdf268c2bec4b89d08bd0f0142"}
Jul 08 19:13:19.630205 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.630054    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd" event={"ID":"6039923b-8021-4c92-8d08-a2e43d5a5199","Type":"ContainerStarted","Data":"0a9ef454209bc715ba0ad76fd7fb4559ec46290d4621db12d701e5e6e4062e73"}
Jul 08 19:13:19.650424 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:19.650362    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd" podStartSLOduration=1.6503453750000001 podStartE2EDuration="1.650345375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:13:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:13:19.650084456 +0000 UTC m=+2027.892575577" watchObservedRunningTime="2026-07-08 19:13:19.650345375 +0000 UTC m=+2027.892836474"
Jul 08 19:13:22.883475 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:22.883437    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:13:25.688050 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:25.688014    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:25.788107 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:25.788077    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:29.201705 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:29.201672    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:29.202066 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:29.201899    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:29.213813 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:29.213788    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:29.679350 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:29.679316    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:13:34.780031 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:34.779997    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:13:39.117484 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:39.117455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:45.027176 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:45.027141    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:45.128726 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:45.128694    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:47.684750 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.684716    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"]
Jul 08 19:13:47.687921 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.687900    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.690867 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.690850    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-521fd5\"/\"default-dockercfg-m95dx\""
Jul 08 19:13:47.692022 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.692002    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-521fd5\"/\"kube-root-ca.crt\""
Jul 08 19:13:47.692100 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.692055    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-521fd5\"/\"openshift-service-ca.crt\""
Jul 08 19:13:47.692100 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.692004    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-521fd5\"/\"test-model-521fd5-kserve-self-signed-certs\""
Jul 08 19:13:47.701104 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.701083    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"]
Jul 08 19:13:47.714759 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.714737    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:13:47.768772 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.768750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-home\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.768856 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.768775    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-dshm\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.768856 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.768795    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kljht\" (UniqueName: \"kubernetes.io/projected/e4125a37-5095-40a0-96fa-fc69384917d5-kube-api-access-kljht\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.768856 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.768812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-tmp-dir\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.768856 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.768827    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4125a37-5095-40a0-96fa-fc69384917d5-tls-certs\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.769031 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.768897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-model-cache\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.869372 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.869342    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-model-cache\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.869470 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.869410    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-home\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.869470 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.869426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-dshm\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.869470 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.869443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kljht\" (UniqueName: \"kubernetes.io/projected/e4125a37-5095-40a0-96fa-fc69384917d5-kube-api-access-kljht\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.869470 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.869460    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-tmp-dir\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.869724 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.869475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4125a37-5095-40a0-96fa-fc69384917d5-tls-certs\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.869781 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.869760    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-model-cache\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.869842 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.869804    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-tmp-dir\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.869891 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.869853    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-home\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.871783 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.871757    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-dshm\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.871978 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.871962    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4125a37-5095-40a0-96fa-fc69384917d5-tls-certs\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.877825 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.877803    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kljht\" (UniqueName: \"kubernetes.io/projected/e4125a37-5095-40a0-96fa-fc69384917d5-kube-api-access-kljht\") pod \"test-model-521fd5-kserve-db78c998c-hpx9n\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") " pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:47.996987 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:47.996936    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:48.126094 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:48.126066    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"]
Jul 08 19:13:48.128218 ip-10-0-129-111 kubenswrapper[2563]: W0708 19:13:48.128182    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4125a37_5095_40a0_96fa_fc69384917d5.slice/crio-44f9114a151573551b856a78f1763deb2841c5f4bf7baa52dce491498a9d4a58 WatchSource:0}: Error finding container 44f9114a151573551b856a78f1763deb2841c5f4bf7baa52dce491498a9d4a58: Status 404 returned error can't find the container with id 44f9114a151573551b856a78f1763deb2841c5f4bf7baa52dce491498a9d4a58
Jul 08 19:13:48.743301 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:48.743269    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n" event={"ID":"e4125a37-5095-40a0-96fa-fc69384917d5","Type":"ContainerStarted","Data":"fafd8ff73d51178c3c9daf5f49afa2244cfeaf1dd54245cfd25aff62107b7f83"}
Jul 08 19:13:48.743301 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:48.743305    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n" event={"ID":"e4125a37-5095-40a0-96fa-fc69384917d5","Type":"ContainerStarted","Data":"44f9114a151573551b856a78f1763deb2841c5f4bf7baa52dce491498a9d4a58"}
Jul 08 19:13:48.762084 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:48.762036    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n" podStartSLOduration=1.762022634 podStartE2EDuration="1.762022634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:13:48.761279888 +0000 UTC m=+2057.003771010" watchObservedRunningTime="2026-07-08 19:13:48.762022634 +0000 UTC m=+2057.004513755"
Jul 08 19:13:53.382485 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:53.382455    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:13:57.997593 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:57.997515    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:57.997593 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:57.997558    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:58.009804 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:58.009785    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:13:58.794409 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:13:58.794384    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:14:06.466103 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:06.466066    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"]
Jul 08 19:14:06.487444 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:06.487415    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:07.467474 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:07.467439    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"]
Jul 08 19:14:07.486372 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:07.486348    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:07.662172 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:07.662147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:08.102265 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:08.102238    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:08.201088 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:08.201062    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:08.353276 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:08.353187    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:13.176902 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:13.176856    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:13.283864 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:13.283836    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:14:16.381988 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:16.381961    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:21.485704 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.485669    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd" podUID="6039923b-8021-4c92-8d08-a2e43d5a5199" containerName="main" containerID="cri-o://32a3399d6204b935b346378b6f4f144fa025e9bdf268c2bec4b89d08bd0f0142" gracePeriod=45
Jul 08 19:14:21.731346 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.731321    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:14:21.825924 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.825868    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-tmp-dir\") pod \"6039923b-8021-4c92-8d08-a2e43d5a5199\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") "
Jul 08 19:14:21.825924 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.825906    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ln56q\" (UniqueName: \"kubernetes.io/projected/6039923b-8021-4c92-8d08-a2e43d5a5199-kube-api-access-ln56q\") pod \"6039923b-8021-4c92-8d08-a2e43d5a5199\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") "
Jul 08 19:14:21.826094 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.825945    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6039923b-8021-4c92-8d08-a2e43d5a5199-tls-certs\") pod \"6039923b-8021-4c92-8d08-a2e43d5a5199\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") "
Jul 08 19:14:21.826094 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.825974    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-model-cache\") pod \"6039923b-8021-4c92-8d08-a2e43d5a5199\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") "
Jul 08 19:14:21.826094 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.825996    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-home\") pod \"6039923b-8021-4c92-8d08-a2e43d5a5199\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") "
Jul 08 19:14:21.826094 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.826014    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-dshm\") pod \"6039923b-8021-4c92-8d08-a2e43d5a5199\" (UID: \"6039923b-8021-4c92-8d08-a2e43d5a5199\") "
Jul 08 19:14:21.826303 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.826103    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6039923b-8021-4c92-8d08-a2e43d5a5199" (UID: "6039923b-8021-4c92-8d08-a2e43d5a5199"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:14:21.826303 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.826205    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-model-cache" (OuterVolumeSpecName: "model-cache") pod "6039923b-8021-4c92-8d08-a2e43d5a5199" (UID: "6039923b-8021-4c92-8d08-a2e43d5a5199"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:14:21.826303 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.826263    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-home" (OuterVolumeSpecName: "home") pod "6039923b-8021-4c92-8d08-a2e43d5a5199" (UID: "6039923b-8021-4c92-8d08-a2e43d5a5199"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:14:21.826303 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.826286    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-tmp-dir\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:21.826431 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.826318    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-model-cache\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:21.828077 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.828054    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-dshm" (OuterVolumeSpecName: "dshm") pod "6039923b-8021-4c92-8d08-a2e43d5a5199" (UID: "6039923b-8021-4c92-8d08-a2e43d5a5199"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:14:21.828177 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.828092    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6039923b-8021-4c92-8d08-a2e43d5a5199-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6039923b-8021-4c92-8d08-a2e43d5a5199" (UID: "6039923b-8021-4c92-8d08-a2e43d5a5199"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 19:14:21.828177 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.828118    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6039923b-8021-4c92-8d08-a2e43d5a5199-kube-api-access-ln56q" (OuterVolumeSpecName: "kube-api-access-ln56q") pod "6039923b-8021-4c92-8d08-a2e43d5a5199" (UID: "6039923b-8021-4c92-8d08-a2e43d5a5199"). InnerVolumeSpecName "kube-api-access-ln56q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:14:21.877044 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.877019    2563 generic.go:356] "Generic (PLEG): container finished" podID="6039923b-8021-4c92-8d08-a2e43d5a5199" containerID="32a3399d6204b935b346378b6f4f144fa025e9bdf268c2bec4b89d08bd0f0142" exitCode=0
Jul 08 19:14:21.877142 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.877063    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"
Jul 08 19:14:21.877142 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.877084    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd" event={"ID":"6039923b-8021-4c92-8d08-a2e43d5a5199","Type":"ContainerDied","Data":"32a3399d6204b935b346378b6f4f144fa025e9bdf268c2bec4b89d08bd0f0142"}
Jul 08 19:14:21.877142 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.877113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd" event={"ID":"6039923b-8021-4c92-8d08-a2e43d5a5199","Type":"ContainerDied","Data":"0a9ef454209bc715ba0ad76fd7fb4559ec46290d4621db12d701e5e6e4062e73"}
Jul 08 19:14:21.877142 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.877129    2563 scope.go:117] "RemoveContainer" containerID="32a3399d6204b935b346378b6f4f144fa025e9bdf268c2bec4b89d08bd0f0142"
Jul 08 19:14:21.884916 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.884904    2563 scope.go:117] "RemoveContainer" containerID="32a3399d6204b935b346378b6f4f144fa025e9bdf268c2bec4b89d08bd0f0142"
Jul 08 19:14:21.885199 ip-10-0-129-111 kubenswrapper[2563]: E0708 19:14:21.885178    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32a3399d6204b935b346378b6f4f144fa025e9bdf268c2bec4b89d08bd0f0142\": container with ID starting with 32a3399d6204b935b346378b6f4f144fa025e9bdf268c2bec4b89d08bd0f0142 not found: ID does not exist" containerID="32a3399d6204b935b346378b6f4f144fa025e9bdf268c2bec4b89d08bd0f0142"
Jul 08 19:14:21.885302 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.885206    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32a3399d6204b935b346378b6f4f144fa025e9bdf268c2bec4b89d08bd0f0142"} err="failed to get container status \"32a3399d6204b935b346378b6f4f144fa025e9bdf268c2bec4b89d08bd0f0142\": rpc error: code = NotFound desc = could not find container \"32a3399d6204b935b346378b6f4f144fa025e9bdf268c2bec4b89d08bd0f0142\": container with ID starting with 32a3399d6204b935b346378b6f4f144fa025e9bdf268c2bec4b89d08bd0f0142 not found: ID does not exist"
Jul 08 19:14:21.897735 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.897711    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"]
Jul 08 19:14:21.903087 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.903067    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-abcbfa/test-model-abcbfa-kserve-67d7f744ff-v7pnd"]
Jul 08 19:14:21.927577 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.927559    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ln56q\" (UniqueName: \"kubernetes.io/projected/6039923b-8021-4c92-8d08-a2e43d5a5199-kube-api-access-ln56q\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:21.927577 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.927576    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6039923b-8021-4c92-8d08-a2e43d5a5199-tls-certs\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:21.927689 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.927586    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-home\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:21.927689 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:21.927594    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6039923b-8021-4c92-8d08-a2e43d5a5199-dshm\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:22.223518 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.223488    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6039923b-8021-4c92-8d08-a2e43d5a5199" path="/var/lib/kubelet/pods/6039923b-8021-4c92-8d08-a2e43d5a5199/volumes"
Jul 08 19:14:22.487107 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.487023    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n" podUID="e4125a37-5095-40a0-96fa-fc69384917d5" containerName="main" containerID="cri-o://fafd8ff73d51178c3c9daf5f49afa2244cfeaf1dd54245cfd25aff62107b7f83" gracePeriod=45
Jul 08 19:14:22.728698 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.728677    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:14:22.835941 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.835882    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4125a37-5095-40a0-96fa-fc69384917d5-tls-certs\") pod \"e4125a37-5095-40a0-96fa-fc69384917d5\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") "
Jul 08 19:14:22.835941 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.835910    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-model-cache\") pod \"e4125a37-5095-40a0-96fa-fc69384917d5\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") "
Jul 08 19:14:22.835941 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.835937    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-dshm\") pod \"e4125a37-5095-40a0-96fa-fc69384917d5\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") "
Jul 08 19:14:22.836181 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.835959    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kljht\" (UniqueName: \"kubernetes.io/projected/e4125a37-5095-40a0-96fa-fc69384917d5-kube-api-access-kljht\") pod \"e4125a37-5095-40a0-96fa-fc69384917d5\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") "
Jul 08 19:14:22.836181 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.836008    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-home\") pod \"e4125a37-5095-40a0-96fa-fc69384917d5\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") "
Jul 08 19:14:22.836181 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.836047    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-tmp-dir\") pod \"e4125a37-5095-40a0-96fa-fc69384917d5\" (UID: \"e4125a37-5095-40a0-96fa-fc69384917d5\") "
Jul 08 19:14:22.836331 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.836185    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-model-cache" (OuterVolumeSpecName: "model-cache") pod "e4125a37-5095-40a0-96fa-fc69384917d5" (UID: "e4125a37-5095-40a0-96fa-fc69384917d5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:14:22.836331 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.836293    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-home" (OuterVolumeSpecName: "home") pod "e4125a37-5095-40a0-96fa-fc69384917d5" (UID: "e4125a37-5095-40a0-96fa-fc69384917d5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:14:22.836331 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.836311    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-model-cache\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:22.836503 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.836344    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e4125a37-5095-40a0-96fa-fc69384917d5" (UID: "e4125a37-5095-40a0-96fa-fc69384917d5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:14:22.838161 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.838129    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4125a37-5095-40a0-96fa-fc69384917d5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e4125a37-5095-40a0-96fa-fc69384917d5" (UID: "e4125a37-5095-40a0-96fa-fc69384917d5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 19:14:22.838161 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.838133    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4125a37-5095-40a0-96fa-fc69384917d5-kube-api-access-kljht" (OuterVolumeSpecName: "kube-api-access-kljht") pod "e4125a37-5095-40a0-96fa-fc69384917d5" (UID: "e4125a37-5095-40a0-96fa-fc69384917d5"). InnerVolumeSpecName "kube-api-access-kljht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:14:22.838304 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.838214    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-dshm" (OuterVolumeSpecName: "dshm") pod "e4125a37-5095-40a0-96fa-fc69384917d5" (UID: "e4125a37-5095-40a0-96fa-fc69384917d5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:14:22.883010 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.882987    2563 generic.go:356] "Generic (PLEG): container finished" podID="e4125a37-5095-40a0-96fa-fc69384917d5" containerID="fafd8ff73d51178c3c9daf5f49afa2244cfeaf1dd54245cfd25aff62107b7f83" exitCode=0
Jul 08 19:14:22.883100 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.883035    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"
Jul 08 19:14:22.883100 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.883057    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n" event={"ID":"e4125a37-5095-40a0-96fa-fc69384917d5","Type":"ContainerDied","Data":"fafd8ff73d51178c3c9daf5f49afa2244cfeaf1dd54245cfd25aff62107b7f83"}
Jul 08 19:14:22.883100 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.883086    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n" event={"ID":"e4125a37-5095-40a0-96fa-fc69384917d5","Type":"ContainerDied","Data":"44f9114a151573551b856a78f1763deb2841c5f4bf7baa52dce491498a9d4a58"}
Jul 08 19:14:22.883210 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.883102    2563 scope.go:117] "RemoveContainer" containerID="fafd8ff73d51178c3c9daf5f49afa2244cfeaf1dd54245cfd25aff62107b7f83"
Jul 08 19:14:22.890734 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.890717    2563 scope.go:117] "RemoveContainer" containerID="fafd8ff73d51178c3c9daf5f49afa2244cfeaf1dd54245cfd25aff62107b7f83"
Jul 08 19:14:22.890950 ip-10-0-129-111 kubenswrapper[2563]: E0708 19:14:22.890931    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fafd8ff73d51178c3c9daf5f49afa2244cfeaf1dd54245cfd25aff62107b7f83\": container with ID starting with fafd8ff73d51178c3c9daf5f49afa2244cfeaf1dd54245cfd25aff62107b7f83 not found: ID does not exist" containerID="fafd8ff73d51178c3c9daf5f49afa2244cfeaf1dd54245cfd25aff62107b7f83"
Jul 08 19:14:22.891010 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.890962    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafd8ff73d51178c3c9daf5f49afa2244cfeaf1dd54245cfd25aff62107b7f83"} err="failed to get container status \"fafd8ff73d51178c3c9daf5f49afa2244cfeaf1dd54245cfd25aff62107b7f83\": rpc error: code = NotFound desc = could not find container \"fafd8ff73d51178c3c9daf5f49afa2244cfeaf1dd54245cfd25aff62107b7f83\": container with ID starting with fafd8ff73d51178c3c9daf5f49afa2244cfeaf1dd54245cfd25aff62107b7f83 not found: ID does not exist"
Jul 08 19:14:22.903410 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.903386    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"]
Jul 08 19:14:22.906300 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.906280    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-521fd5/test-model-521fd5-kserve-db78c998c-hpx9n"]
Jul 08 19:14:22.936797 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.936778    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4125a37-5095-40a0-96fa-fc69384917d5-tls-certs\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:22.936797 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.936794    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-dshm\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:22.936900 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.936803    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kljht\" (UniqueName: \"kubernetes.io/projected/e4125a37-5095-40a0-96fa-fc69384917d5-kube-api-access-kljht\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:22.936900 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.936812    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-home\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:22.936900 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:22.936820    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4125a37-5095-40a0-96fa-fc69384917d5-tmp-dir\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:24.223988 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:24.223955    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4125a37-5095-40a0-96fa-fc69384917d5" path="/var/lib/kubelet/pods/e4125a37-5095-40a0-96fa-fc69384917d5/volumes"
Jul 08 19:14:32.265676 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:32.265648    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 19:14:32.268275 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:32.268256    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 19:14:49.990813 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:49.990784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:50.308597 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:50.308516    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"]
Jul 08 19:14:50.308845 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:50.308732    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n" podUID="a4786479-2874-441b-86b8-28b0796ccd04" containerName="istio-proxy" containerID="cri-o://9fcf4e6c5f5e956719e98f6386addbf0af167bd7abc12b77a5a29a33f5ab1f35" gracePeriod=30
Jul 08 19:14:50.327962 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:50.327937    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:50.890484 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:50.890453    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:51.306860 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:51.306781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:51.408009 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:51.407981    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:51.507168 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:51.507140    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:51.608093 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:51.608068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:54.583278 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:54.583247    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:14:55.551273 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.551246    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:14:55.662527 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.662499    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-credential-socket\") pod \"a4786479-2874-441b-86b8-28b0796ccd04\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") "
Jul 08 19:14:55.662949 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.662546    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-istio-envoy\") pod \"a4786479-2874-441b-86b8-28b0796ccd04\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") "
Jul 08 19:14:55.662949 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.662578    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-workload-certs\") pod \"a4786479-2874-441b-86b8-28b0796ccd04\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") "
Jul 08 19:14:55.662949 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.662662    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-istio-data\") pod \"a4786479-2874-441b-86b8-28b0796ccd04\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") "
Jul 08 19:14:55.662949 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.662721    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4786479-2874-441b-86b8-28b0796ccd04-istio-token\") pod \"a4786479-2874-441b-86b8-28b0796ccd04\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") "
Jul 08 19:14:55.662949 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.662735    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a4786479-2874-441b-86b8-28b0796ccd04" (UID: "a4786479-2874-441b-86b8-28b0796ccd04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:14:55.662949 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.662760    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4786479-2874-441b-86b8-28b0796ccd04-istiod-ca-cert\") pod \"a4786479-2874-441b-86b8-28b0796ccd04\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") "
Jul 08 19:14:55.662949 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.662789    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph4lj\" (UniqueName: \"kubernetes.io/projected/a4786479-2874-441b-86b8-28b0796ccd04-kube-api-access-ph4lj\") pod \"a4786479-2874-441b-86b8-28b0796ccd04\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") "
Jul 08 19:14:55.662949 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.662827    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-workload-socket\") pod \"a4786479-2874-441b-86b8-28b0796ccd04\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") "
Jul 08 19:14:55.662949 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.662893    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a4786479-2874-441b-86b8-28b0796ccd04" (UID: "a4786479-2874-441b-86b8-28b0796ccd04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:14:55.663385 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.662979    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4786479-2874-441b-86b8-28b0796ccd04-istio-podinfo\") pod \"a4786479-2874-441b-86b8-28b0796ccd04\" (UID: \"a4786479-2874-441b-86b8-28b0796ccd04\") "
Jul 08 19:14:55.663385 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.663072    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a4786479-2874-441b-86b8-28b0796ccd04" (UID: "a4786479-2874-441b-86b8-28b0796ccd04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:14:55.663385 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.663151    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4786479-2874-441b-86b8-28b0796ccd04-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a4786479-2874-441b-86b8-28b0796ccd04" (UID: "a4786479-2874-441b-86b8-28b0796ccd04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:14:55.663385 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.663259    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4786479-2874-441b-86b8-28b0796ccd04-istiod-ca-cert\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:55.663385 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.663276    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-workload-socket\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:55.663385 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.663289    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-credential-socket\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:55.663385 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.663302    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-workload-certs\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:55.663769 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.663464    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-istio-data" (OuterVolumeSpecName: "istio-data") pod "a4786479-2874-441b-86b8-28b0796ccd04" (UID: "a4786479-2874-441b-86b8-28b0796ccd04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:14:55.664884 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.664851    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4786479-2874-441b-86b8-28b0796ccd04-istio-token" (OuterVolumeSpecName: "istio-token") pod "a4786479-2874-441b-86b8-28b0796ccd04" (UID: "a4786479-2874-441b-86b8-28b0796ccd04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:14:55.665025 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.665008    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a4786479-2874-441b-86b8-28b0796ccd04-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a4786479-2874-441b-86b8-28b0796ccd04" (UID: "a4786479-2874-441b-86b8-28b0796ccd04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 19:14:55.665202 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.665175    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a4786479-2874-441b-86b8-28b0796ccd04" (UID: "a4786479-2874-441b-86b8-28b0796ccd04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:14:55.665317 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.665182    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4786479-2874-441b-86b8-28b0796ccd04-kube-api-access-ph4lj" (OuterVolumeSpecName: "kube-api-access-ph4lj") pod "a4786479-2874-441b-86b8-28b0796ccd04" (UID: "a4786479-2874-441b-86b8-28b0796ccd04"). InnerVolumeSpecName "kube-api-access-ph4lj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:14:55.763584 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.763562    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-istio-envoy\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:55.763584 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.763582    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4786479-2874-441b-86b8-28b0796ccd04-istio-data\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:55.763727 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.763590    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4786479-2874-441b-86b8-28b0796ccd04-istio-token\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:55.763727 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.763599    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph4lj\" (UniqueName: \"kubernetes.io/projected/a4786479-2874-441b-86b8-28b0796ccd04-kube-api-access-ph4lj\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:55.763727 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:55.763608    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4786479-2874-441b-86b8-28b0796ccd04-istio-podinfo\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:14:56.018643 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:56.018570    2563 generic.go:356] "Generic (PLEG): container finished" podID="a4786479-2874-441b-86b8-28b0796ccd04" containerID="9fcf4e6c5f5e956719e98f6386addbf0af167bd7abc12b77a5a29a33f5ab1f35" exitCode=0
Jul 08 19:14:56.018643 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:56.018614    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"
Jul 08 19:14:56.018765 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:56.018663    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n" event={"ID":"a4786479-2874-441b-86b8-28b0796ccd04","Type":"ContainerDied","Data":"9fcf4e6c5f5e956719e98f6386addbf0af167bd7abc12b77a5a29a33f5ab1f35"}
Jul 08 19:14:56.018765 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:56.018728    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n" event={"ID":"a4786479-2874-441b-86b8-28b0796ccd04","Type":"ContainerDied","Data":"8d8f558259905c6f64159493f5ed9b4711b793b9d5f03858e99cfed2d10d1a0b"}
Jul 08 19:14:56.018765 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:56.018750    2563 scope.go:117] "RemoveContainer" containerID="9fcf4e6c5f5e956719e98f6386addbf0af167bd7abc12b77a5a29a33f5ab1f35"
Jul 08 19:14:56.027037 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:56.027014    2563 scope.go:117] "RemoveContainer" containerID="21146d678394ee87aed9faf785209360df73c4187252851fda894b0eddffe4d4"
Jul 08 19:14:56.034004 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:56.033987    2563 scope.go:117] "RemoveContainer" containerID="9fcf4e6c5f5e956719e98f6386addbf0af167bd7abc12b77a5a29a33f5ab1f35"
Jul 08 19:14:56.034266 ip-10-0-129-111 kubenswrapper[2563]: E0708 19:14:56.034244    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fcf4e6c5f5e956719e98f6386addbf0af167bd7abc12b77a5a29a33f5ab1f35\": container with ID starting with 9fcf4e6c5f5e956719e98f6386addbf0af167bd7abc12b77a5a29a33f5ab1f35 not found: ID does not exist" containerID="9fcf4e6c5f5e956719e98f6386addbf0af167bd7abc12b77a5a29a33f5ab1f35"
Jul 08 19:14:56.034341 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:56.034277    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fcf4e6c5f5e956719e98f6386addbf0af167bd7abc12b77a5a29a33f5ab1f35"} err="failed to get container status \"9fcf4e6c5f5e956719e98f6386addbf0af167bd7abc12b77a5a29a33f5ab1f35\": rpc error: code = NotFound desc = could not find container \"9fcf4e6c5f5e956719e98f6386addbf0af167bd7abc12b77a5a29a33f5ab1f35\": container with ID starting with 9fcf4e6c5f5e956719e98f6386addbf0af167bd7abc12b77a5a29a33f5ab1f35 not found: ID does not exist"
Jul 08 19:14:56.034341 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:56.034301    2563 scope.go:117] "RemoveContainer" containerID="21146d678394ee87aed9faf785209360df73c4187252851fda894b0eddffe4d4"
Jul 08 19:14:56.034543 ip-10-0-129-111 kubenswrapper[2563]: E0708 19:14:56.034527    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21146d678394ee87aed9faf785209360df73c4187252851fda894b0eddffe4d4\": container with ID starting with 21146d678394ee87aed9faf785209360df73c4187252851fda894b0eddffe4d4 not found: ID does not exist" containerID="21146d678394ee87aed9faf785209360df73c4187252851fda894b0eddffe4d4"
Jul 08 19:14:56.034586 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:56.034550    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21146d678394ee87aed9faf785209360df73c4187252851fda894b0eddffe4d4"} err="failed to get container status \"21146d678394ee87aed9faf785209360df73c4187252851fda894b0eddffe4d4\": rpc error: code = NotFound desc = could not find container \"21146d678394ee87aed9faf785209360df73c4187252851fda894b0eddffe4d4\": container with ID starting with 21146d678394ee87aed9faf785209360df73c4187252851fda894b0eddffe4d4 not found: ID does not exist"
Jul 08 19:14:56.043944 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:56.043920    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"]
Jul 08 19:14:56.048176 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:56.048157    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-abcbfa-openshift-default-75d8d79d5f-rvr2n"]
Jul 08 19:14:56.223512 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:56.223490    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4786479-2874-441b-86b8-28b0796ccd04" path="/var/lib/kubelet/pods/a4786479-2874-441b-86b8-28b0796ccd04/volumes"
Jul 08 19:14:57.568838 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:57.568808    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:57.628636 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:57.628580    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:57.915975 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:57.915943    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:58.514069 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.514042    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:58.844595 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.844568    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"]
Jul 08 19:14:58.844962 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.844849    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4786479-2874-441b-86b8-28b0796ccd04" containerName="istio-proxy"
Jul 08 19:14:58.844962 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.844861    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4786479-2874-441b-86b8-28b0796ccd04" containerName="istio-proxy"
Jul 08 19:14:58.844962 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.844872    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4125a37-5095-40a0-96fa-fc69384917d5" containerName="main"
Jul 08 19:14:58.844962 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.844878    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4125a37-5095-40a0-96fa-fc69384917d5" containerName="main"
Jul 08 19:14:58.844962 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.844892    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6039923b-8021-4c92-8d08-a2e43d5a5199" containerName="main"
Jul 08 19:14:58.844962 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.844898    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6039923b-8021-4c92-8d08-a2e43d5a5199" containerName="main"
Jul 08 19:14:58.844962 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.844946    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4786479-2874-441b-86b8-28b0796ccd04" containerName="istio-proxy"
Jul 08 19:14:58.844962 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.844952    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6039923b-8021-4c92-8d08-a2e43d5a5199" containerName="main"
Jul 08 19:14:58.844962 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.844958    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4125a37-5095-40a0-96fa-fc69384917d5" containerName="main"
Jul 08 19:14:58.844962 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.844964    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4786479-2874-441b-86b8-28b0796ccd04" containerName="istio-proxy"
Jul 08 19:14:58.849064 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.849046    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:58.854287 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.854264    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 19:14:58.854411 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.854329    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-30f36b-openshift-default-dockercfg-752xr\""
Jul 08 19:14:58.862992 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.862969    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"]
Jul 08 19:14:58.885772 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.885753    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:58.986799 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.986775    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-workload-socket\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:58.986894 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.986811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-data\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:58.986894 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.986837    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-envoy\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:58.986894 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.986888    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-podinfo\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:58.987005 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.986904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4094731-7aa6-44b1-b456-64a3464c2f46-istiod-ca-cert\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:58.987005 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.986946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-workload-certs\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:58.987005 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.986991    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g796\" (UniqueName: \"kubernetes.io/projected/e4094731-7aa6-44b1-b456-64a3464c2f46-kube-api-access-7g796\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:58.987107 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.987014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-credential-socket\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:58.987107 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:58.987035    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-token\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.088059 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.088039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g796\" (UniqueName: \"kubernetes.io/projected/e4094731-7aa6-44b1-b456-64a3464c2f46-kube-api-access-7g796\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.088164 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.088077    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-credential-socket\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.088164 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.088102    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-token\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.088164 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.088133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-workload-socket\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.088345 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.088169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-data\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.088345 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.088208    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-envoy\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.088345 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.088260    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-podinfo\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.088345 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.088290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4094731-7aa6-44b1-b456-64a3464c2f46-istiod-ca-cert\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.088345 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.088323    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-workload-certs\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.088593 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.088441    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-credential-socket\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.088593 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.088517    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-data\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.088727 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.088612    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-workload-socket\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.088727 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.088697    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-workload-certs\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.088924 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.088906    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4094731-7aa6-44b1-b456-64a3464c2f46-istiod-ca-cert\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.090439 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.090420    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-envoy\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.090769 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.090752    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-podinfo\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.096869 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.096805    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g796\" (UniqueName: \"kubernetes.io/projected/e4094731-7aa6-44b1-b456-64a3464c2f46-kube-api-access-7g796\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.097183 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.097164    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-token\") pod \"e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") " pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.158383 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.158359    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:14:59.195611 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.195580    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:14:59.287392 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.287230    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"]
Jul 08 19:14:59.289583 ip-10-0-129-111 kubenswrapper[2563]: W0708 19:14:59.289555    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4094731_7aa6_44b1_b456_64a3464c2f46.slice/crio-774560f3568cef064dca22b07fdecef46902cd64280371f89933e13037d6da45 WatchSource:0}: Error finding container 774560f3568cef064dca22b07fdecef46902cd64280371f89933e13037d6da45: Status 404 returned error can't find the container with id 774560f3568cef064dca22b07fdecef46902cd64280371f89933e13037d6da45
Jul 08 19:14:59.291757 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.291724    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:14:59.291836 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.291790    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:14:59.291836 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:14:59.291818    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:15:00.036792 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:00.036754    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22" event={"ID":"e4094731-7aa6-44b1-b456-64a3464c2f46","Type":"ContainerStarted","Data":"f6144d3743762fc32c6eaadfa6e52a5ea1f601014c50aa2d8a52db25fc0a6823"}
Jul 08 19:15:00.037171 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:00.036814    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22" event={"ID":"e4094731-7aa6-44b1-b456-64a3464c2f46","Type":"ContainerStarted","Data":"774560f3568cef064dca22b07fdecef46902cd64280371f89933e13037d6da45"}
Jul 08 19:15:00.067077 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:00.067017    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22" podStartSLOduration=2.067002319 podStartE2EDuration="2.067002319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:14:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:15:00.064114524 +0000 UTC m=+2128.306605668" watchObservedRunningTime="2026-07-08 19:15:00.067002319 +0000 UTC m=+2128.309493440"
Jul 08 19:15:00.159211 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:00.159190    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:15:00.163845 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:00.163825    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:15:01.042061 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:01.042030    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:15:01.042817 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:01.042797    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:15:02.090242 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:02.090212    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:02.190818 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:02.190788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:02.475746 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:02.475672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:02.576488 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:02.576465    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:02.891648 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:02.891603    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:03.128582 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:03.128552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:03.372785 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:03.372759    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:03.473179 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:03.473156    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:05.676612 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:05.676579    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:15:06.664147 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:06.664118    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:07.241184 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:07.241143    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:07.565354 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:07.565234    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:07.664705 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:07.664673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:10.909072 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:10.909037    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:11.020747 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:11.020710    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:11.111220 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:11.111185    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:11.209219 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:11.209141    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:11.575430 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:11.575352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:11.677366 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:11.677340    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:13.096840 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:13.096810    2563 generic.go:356] "Generic (PLEG): container finished" podID="e4094731-7aa6-44b1-b456-64a3464c2f46" containerID="f6144d3743762fc32c6eaadfa6e52a5ea1f601014c50aa2d8a52db25fc0a6823" exitCode=0
Jul 08 19:15:13.097192 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:13.096852    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22" event={"ID":"e4094731-7aa6-44b1-b456-64a3464c2f46","Type":"ContainerDied","Data":"f6144d3743762fc32c6eaadfa6e52a5ea1f601014c50aa2d8a52db25fc0a6823"}
Jul 08 19:15:13.097192 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:13.097160    2563 scope.go:117] "RemoveContainer" containerID="f6144d3743762fc32c6eaadfa6e52a5ea1f601014c50aa2d8a52db25fc0a6823"
Jul 08 19:15:13.098126 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:13.098098    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:15:13.098184 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:13.098167    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:15:13.098220 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:13.098198    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:15:14.102163 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:14.102135    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22" event={"ID":"e4094731-7aa6-44b1-b456-64a3464c2f46","Type":"ContainerStarted","Data":"271c8f4f270794ea82b11473acb4855bb40d49a736cac003b0fca9b93dab4a96"}
Jul 08 19:15:14.158689 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:14.158660    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:15:14.159565 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:14.159544    2563 patch_prober.go:28] interesting pod/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 08 19:15:14.159690 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:14.159587    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22" podUID="e4094731-7aa6-44b1-b456-64a3464c2f46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 08 19:15:15.159406 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:15.159371    2563 patch_prober.go:28] interesting pod/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 08 19:15:15.159829 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:15.159426    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22" podUID="e4094731-7aa6-44b1-b456-64a3464c2f46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 08 19:15:15.431098 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:15.430948    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:16.042724 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:16.042683    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:15:16.159662 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:16.159617    2563 patch_prober.go:28] interesting pod/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 08 19:15:16.160002 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:16.159692    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22" podUID="e4094731-7aa6-44b1-b456-64a3464c2f46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 08 19:15:17.159712 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:17.159676    2563 patch_prober.go:28] interesting pod/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 08 19:15:17.160094 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:17.159735    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22" podUID="e4094731-7aa6-44b1-b456-64a3464c2f46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 08 19:15:18.159383 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:18.159353    2563 patch_prober.go:28] interesting pod/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 08 19:15:18.159553 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:18.159407    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22" podUID="e4094731-7aa6-44b1-b456-64a3464c2f46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 08 19:15:18.383553 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:18.383522    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:15:19.162690 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:19.162660    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:15:19.163715 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:19.163699    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:15:23.837973 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:23.837949    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:24.263311 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:24.263222    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:24.364956 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:24.364927    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:24.464564 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:24.464541    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:24.637397 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:24.637368    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:30.287265 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:30.287225    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:30.349752 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:30.349729    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:30.584319 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:30.584238    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"]
Jul 08 19:15:30.584462 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:30.584426    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22" podUID="e4094731-7aa6-44b1-b456-64a3464c2f46" containerName="istio-proxy" containerID="cri-o://271c8f4f270794ea82b11473acb4855bb40d49a736cac003b0fca9b93dab4a96" gracePeriod=30
Jul 08 19:15:30.596549 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:30.596526    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:31.039996 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:31.039967    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:31.465347 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:31.465322    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:31.562436 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:31.562410    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:31.662669 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:31.662619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:31.793656 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:31.793562    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:15:31.838244 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:31.838222    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:34.165484 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:34.165443    2563 patch_prober.go:28] interesting pod/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 19:15:34.165881 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:34.165519    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22" podUID="e4094731-7aa6-44b1-b456-64a3464c2f46" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 19:15:35.841132 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.841108    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:15:35.975573 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.975515    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g796\" (UniqueName: \"kubernetes.io/projected/e4094731-7aa6-44b1-b456-64a3464c2f46-kube-api-access-7g796\") pod \"e4094731-7aa6-44b1-b456-64a3464c2f46\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") "
Jul 08 19:15:35.975573 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.975542    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-credential-socket\") pod \"e4094731-7aa6-44b1-b456-64a3464c2f46\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") "
Jul 08 19:15:35.975573 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.975562    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-workload-socket\") pod \"e4094731-7aa6-44b1-b456-64a3464c2f46\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") "
Jul 08 19:15:35.975825 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.975578    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-podinfo\") pod \"e4094731-7aa6-44b1-b456-64a3464c2f46\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") "
Jul 08 19:15:35.975825 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.975610    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-workload-certs\") pod \"e4094731-7aa6-44b1-b456-64a3464c2f46\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") "
Jul 08 19:15:35.975825 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.975667    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-envoy\") pod \"e4094731-7aa6-44b1-b456-64a3464c2f46\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") "
Jul 08 19:15:35.975825 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.975711    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-data\") pod \"e4094731-7aa6-44b1-b456-64a3464c2f46\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") "
Jul 08 19:15:35.975825 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.975762    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4094731-7aa6-44b1-b456-64a3464c2f46-istiod-ca-cert\") pod \"e4094731-7aa6-44b1-b456-64a3464c2f46\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") "
Jul 08 19:15:35.975825 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.975793    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e4094731-7aa6-44b1-b456-64a3464c2f46" (UID: "e4094731-7aa6-44b1-b456-64a3464c2f46"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:15:35.976152 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.975817    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-token\") pod \"e4094731-7aa6-44b1-b456-64a3464c2f46\" (UID: \"e4094731-7aa6-44b1-b456-64a3464c2f46\") "
Jul 08 19:15:35.976152 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.975862    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e4094731-7aa6-44b1-b456-64a3464c2f46" (UID: "e4094731-7aa6-44b1-b456-64a3464c2f46"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:15:35.976152 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.976067    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-credential-socket\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:15:35.976152 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.976090    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-workload-socket\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:15:35.976364 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.976278    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e4094731-7aa6-44b1-b456-64a3464c2f46" (UID: "e4094731-7aa6-44b1-b456-64a3464c2f46"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:15:35.976364 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.976209    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4094731-7aa6-44b1-b456-64a3464c2f46-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e4094731-7aa6-44b1-b456-64a3464c2f46" (UID: "e4094731-7aa6-44b1-b456-64a3464c2f46"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:15:35.976689 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.976659    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-data" (OuterVolumeSpecName: "istio-data") pod "e4094731-7aa6-44b1-b456-64a3464c2f46" (UID: "e4094731-7aa6-44b1-b456-64a3464c2f46"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:15:35.977801 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.977777    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4094731-7aa6-44b1-b456-64a3464c2f46-kube-api-access-7g796" (OuterVolumeSpecName: "kube-api-access-7g796") pod "e4094731-7aa6-44b1-b456-64a3464c2f46" (UID: "e4094731-7aa6-44b1-b456-64a3464c2f46"). InnerVolumeSpecName "kube-api-access-7g796". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:15:35.977895 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.977821    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-token" (OuterVolumeSpecName: "istio-token") pod "e4094731-7aa6-44b1-b456-64a3464c2f46" (UID: "e4094731-7aa6-44b1-b456-64a3464c2f46"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:15:35.977895 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.977879    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e4094731-7aa6-44b1-b456-64a3464c2f46" (UID: "e4094731-7aa6-44b1-b456-64a3464c2f46"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:15:35.977970 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:35.977931    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e4094731-7aa6-44b1-b456-64a3464c2f46" (UID: "e4094731-7aa6-44b1-b456-64a3464c2f46"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 19:15:36.076815 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.076791    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4094731-7aa6-44b1-b456-64a3464c2f46-istiod-ca-cert\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:15:36.076815 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.076812    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-token\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:15:36.076934 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.076822    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7g796\" (UniqueName: \"kubernetes.io/projected/e4094731-7aa6-44b1-b456-64a3464c2f46-kube-api-access-7g796\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:15:36.076934 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.076831    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-podinfo\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:15:36.076934 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.076839    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-workload-certs\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:15:36.076934 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.076847    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-envoy\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:15:36.076934 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.076854    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4094731-7aa6-44b1-b456-64a3464c2f46-istio-data\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:15:36.194925 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.194902    2563 generic.go:356] "Generic (PLEG): container finished" podID="e4094731-7aa6-44b1-b456-64a3464c2f46" containerID="271c8f4f270794ea82b11473acb4855bb40d49a736cac003b0fca9b93dab4a96" exitCode=0
Jul 08 19:15:36.195016 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.194955    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"
Jul 08 19:15:36.195067 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.194957    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22" event={"ID":"e4094731-7aa6-44b1-b456-64a3464c2f46","Type":"ContainerDied","Data":"271c8f4f270794ea82b11473acb4855bb40d49a736cac003b0fca9b93dab4a96"}
Jul 08 19:15:36.195109 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.195094    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22" event={"ID":"e4094731-7aa6-44b1-b456-64a3464c2f46","Type":"ContainerDied","Data":"774560f3568cef064dca22b07fdecef46902cd64280371f89933e13037d6da45"}
Jul 08 19:15:36.195140 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.195131    2563 scope.go:117] "RemoveContainer" containerID="271c8f4f270794ea82b11473acb4855bb40d49a736cac003b0fca9b93dab4a96"
Jul 08 19:15:36.203141 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.203123    2563 scope.go:117] "RemoveContainer" containerID="f6144d3743762fc32c6eaadfa6e52a5ea1f601014c50aa2d8a52db25fc0a6823"
Jul 08 19:15:36.209793 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.209775    2563 scope.go:117] "RemoveContainer" containerID="271c8f4f270794ea82b11473acb4855bb40d49a736cac003b0fca9b93dab4a96"
Jul 08 19:15:36.210045 ip-10-0-129-111 kubenswrapper[2563]: E0708 19:15:36.210028    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"271c8f4f270794ea82b11473acb4855bb40d49a736cac003b0fca9b93dab4a96\": container with ID starting with 271c8f4f270794ea82b11473acb4855bb40d49a736cac003b0fca9b93dab4a96 not found: ID does not exist" containerID="271c8f4f270794ea82b11473acb4855bb40d49a736cac003b0fca9b93dab4a96"
Jul 08 19:15:36.210099 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.210055    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271c8f4f270794ea82b11473acb4855bb40d49a736cac003b0fca9b93dab4a96"} err="failed to get container status \"271c8f4f270794ea82b11473acb4855bb40d49a736cac003b0fca9b93dab4a96\": rpc error: code = NotFound desc = could not find container \"271c8f4f270794ea82b11473acb4855bb40d49a736cac003b0fca9b93dab4a96\": container with ID starting with 271c8f4f270794ea82b11473acb4855bb40d49a736cac003b0fca9b93dab4a96 not found: ID does not exist"
Jul 08 19:15:36.210099 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.210071    2563 scope.go:117] "RemoveContainer" containerID="f6144d3743762fc32c6eaadfa6e52a5ea1f601014c50aa2d8a52db25fc0a6823"
Jul 08 19:15:36.210299 ip-10-0-129-111 kubenswrapper[2563]: E0708 19:15:36.210283    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6144d3743762fc32c6eaadfa6e52a5ea1f601014c50aa2d8a52db25fc0a6823\": container with ID starting with f6144d3743762fc32c6eaadfa6e52a5ea1f601014c50aa2d8a52db25fc0a6823 not found: ID does not exist" containerID="f6144d3743762fc32c6eaadfa6e52a5ea1f601014c50aa2d8a52db25fc0a6823"
Jul 08 19:15:36.210342 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.210304    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6144d3743762fc32c6eaadfa6e52a5ea1f601014c50aa2d8a52db25fc0a6823"} err="failed to get container status \"f6144d3743762fc32c6eaadfa6e52a5ea1f601014c50aa2d8a52db25fc0a6823\": rpc error: code = NotFound desc = could not find container \"f6144d3743762fc32c6eaadfa6e52a5ea1f601014c50aa2d8a52db25fc0a6823\": container with ID starting with f6144d3743762fc32c6eaadfa6e52a5ea1f601014c50aa2d8a52db25fc0a6823 not found: ID does not exist"
Jul 08 19:15:36.216719 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.216698    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"]
Jul 08 19:15:36.223225 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:36.223209    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-30f36b-openshift-default-7c9f86cd55-vfm22"]
Jul 08 19:15:37.266728 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:37.266697    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:37.435270 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:37.435238    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:37.595612 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:37.595588    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:38.219975 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.219945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:38.223781 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.223757    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4094731-7aa6-44b1-b456-64a3464c2f46" path="/var/lib/kubelet/pods/e4094731-7aa6-44b1-b456-64a3464c2f46/volumes"
Jul 08 19:15:38.531518 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.531454    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"]
Jul 08 19:15:38.531872 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.531746    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4786479-2874-441b-86b8-28b0796ccd04" containerName="istio-proxy"
Jul 08 19:15:38.531872 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.531758    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4786479-2874-441b-86b8-28b0796ccd04" containerName="istio-proxy"
Jul 08 19:15:38.531872 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.531767    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4094731-7aa6-44b1-b456-64a3464c2f46" containerName="istio-proxy"
Jul 08 19:15:38.531872 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.531773    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4094731-7aa6-44b1-b456-64a3464c2f46" containerName="istio-proxy"
Jul 08 19:15:38.531872 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.531831    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4094731-7aa6-44b1-b456-64a3464c2f46" containerName="istio-proxy"
Jul 08 19:15:38.531872 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.531839    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4094731-7aa6-44b1-b456-64a3464c2f46" containerName="istio-proxy"
Jul 08 19:15:38.534666 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.534650    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.537551 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.537532    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 19:15:38.537695 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.537674    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-1f446e-openshift-default-dockercfg-q99kv\""
Jul 08 19:15:38.546010 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.545990    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"]
Jul 08 19:15:38.553256 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.553236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:38.596567 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.596548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-credential-socket\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.596678 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.596576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-token\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.596678 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.596597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcb3e439-006e-447b-b46d-8082e9e6e668-istiod-ca-cert\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.596678 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.596616    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-podinfo\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.596678 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.596676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-envoy\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.596850 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.596713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-workload-socket\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.596850 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.596737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr8fw\" (UniqueName: \"kubernetes.io/projected/fcb3e439-006e-447b-b46d-8082e9e6e668-kube-api-access-kr8fw\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.596850 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.596770    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-data\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.596850 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.596811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-workload-certs\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.697290 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.697267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-workload-socket\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.697373 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.697294    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr8fw\" (UniqueName: \"kubernetes.io/projected/fcb3e439-006e-447b-b46d-8082e9e6e668-kube-api-access-kr8fw\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.697373 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.697318    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-data\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.697373 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.697344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-workload-certs\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.697513 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.697389    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-credential-socket\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.697513 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.697415    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-token\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.697513 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.697445    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcb3e439-006e-447b-b46d-8082e9e6e668-istiod-ca-cert\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.697513 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.697472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-podinfo\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.697513 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.697499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-envoy\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.697751 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.697729    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-workload-socket\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.697791 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.697778    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-data\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.697954 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.697925    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-workload-certs\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.698023 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.697999    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-credential-socket\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.698086 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.698053    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcb3e439-006e-447b-b46d-8082e9e6e668-istiod-ca-cert\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.699815 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.699792    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-envoy\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.699938 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.699923    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-podinfo\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.705290 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.705267    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr8fw\" (UniqueName: \"kubernetes.io/projected/fcb3e439-006e-447b-b46d-8082e9e6e668-kube-api-access-kr8fw\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.705789 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.705770    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-token\") pod \"e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") " pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.712127 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.712104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:38.843788 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.843769    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:38.971865 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.971843    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"]
Jul 08 19:15:38.973587 ip-10-0-129-111 kubenswrapper[2563]: W0708 19:15:38.973564    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb3e439_006e_447b_b46d_8082e9e6e668.slice/crio-db33950fbc0fb3b8618f1cda114c3f3fffa27bf58e9b1e8fb82ac60a2ebc8cb1 WatchSource:0}: Error finding container db33950fbc0fb3b8618f1cda114c3f3fffa27bf58e9b1e8fb82ac60a2ebc8cb1: Status 404 returned error can't find the container with id db33950fbc0fb3b8618f1cda114c3f3fffa27bf58e9b1e8fb82ac60a2ebc8cb1
Jul 08 19:15:38.975739 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.975700    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:15:38.981490 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.976231    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:15:38.981490 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:38.976361    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:15:39.209798 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:39.209719    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7" event={"ID":"fcb3e439-006e-447b-b46d-8082e9e6e668","Type":"ContainerStarted","Data":"8ca38afee0917928f226ecab8b2b512138622a293f813f7c0e69901d97309fb5"}
Jul 08 19:15:39.209950 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:39.209813    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7" event={"ID":"fcb3e439-006e-447b-b46d-8082e9e6e668","Type":"ContainerStarted","Data":"db33950fbc0fb3b8618f1cda114c3f3fffa27bf58e9b1e8fb82ac60a2ebc8cb1"}
Jul 08 19:15:39.235426 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:39.235378    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7" podStartSLOduration=1.235365775 podStartE2EDuration="1.235365775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:15:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:15:39.233680782 +0000 UTC m=+2167.476171904" watchObservedRunningTime="2026-07-08 19:15:39.235365775 +0000 UTC m=+2167.477856874"
Jul 08 19:15:39.844012 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:39.843974    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:40.848759 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:40.848731    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:41.216916 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:41.216829    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:41.217590 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:41.217573    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:41.320767 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:41.320717    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:41.395190 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:41.395164    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:41.470168 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:41.470085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:41.570841 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:41.570813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:41.995144 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:41.995098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:42.081990 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:42.081961    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:15:42.084272 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:42.084241    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:45.797288 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:45.797257    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:46.193492 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.193434    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:46.505045 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.504959    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"]
Jul 08 19:15:46.505609 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.505585    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4094731-7aa6-44b1-b456-64a3464c2f46" containerName="istio-proxy"
Jul 08 19:15:46.505741 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.505611    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4094731-7aa6-44b1-b456-64a3464c2f46" containerName="istio-proxy"
Jul 08 19:15:46.510726 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.510705    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.513429 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.513407    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-824e89-openshift-default-dockercfg-d6n8h\""
Jul 08 19:15:46.519066 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.519044    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"]
Jul 08 19:15:46.532016 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.531993    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:46.551792 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.551766    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-data\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.551903 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.551800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istiod-ca-cert\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.551903 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.551836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-workload-socket\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.551903 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.551859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-envoy\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.552035 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.551901    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-credential-socket\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.552035 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.551928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-token\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.552035 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.551998    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-workload-certs\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.552035 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.552031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-podinfo\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.552168 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.552051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpgwc\" (UniqueName: \"kubernetes.io/projected/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-kube-api-access-hpgwc\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.652365 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.652335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istiod-ca-cert\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.652491 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.652370    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-workload-socket\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.652491 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.652386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-envoy\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.652491 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.652411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-credential-socket\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.652652 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.652520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-token\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.652652 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.652582    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-workload-certs\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.652652 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.652617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-podinfo\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.652807 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.652669    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpgwc\" (UniqueName: \"kubernetes.io/projected/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-kube-api-access-hpgwc\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.652807 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.652743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-data\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.652914 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.652821    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-credential-socket\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.652914 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.652865    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-workload-socket\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.653110 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.653085    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istiod-ca-cert\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.653229 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.653211    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-data\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.653275 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.653248    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-workload-certs\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.654786 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.654762    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-envoy\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.655112 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.655091    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-podinfo\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.662585 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.662561    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-token\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.662736 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.662640    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpgwc\" (UniqueName: \"kubernetes.io/projected/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-kube-api-access-hpgwc\") pod \"e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") " pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.747005 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.746972    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:46.822656 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.822577    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:46.977641 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.977592    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"]
Jul 08 19:15:46.979922 ip-10-0-129-111 kubenswrapper[2563]: W0708 19:15:46.979898    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f4bf3bd_be53_4aa0_bcdd_ee0216f1672b.slice/crio-a823abd9a23ca24088697c674d91722a0f805c5b1c538030263075c06df7f43a WatchSource:0}: Error finding container a823abd9a23ca24088697c674d91722a0f805c5b1c538030263075c06df7f43a: Status 404 returned error can't find the container with id a823abd9a23ca24088697c674d91722a0f805c5b1c538030263075c06df7f43a
Jul 08 19:15:46.981886 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.981853    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:15:46.981985 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.981934    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:15:46.981985 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:46.981975    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:15:47.243103 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:47.243063    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np" event={"ID":"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b","Type":"ContainerStarted","Data":"f6d15fc9a2a24f36b681b30de0424d30edbe355c4e8564cc2b4a67fa07a0a09c"}
Jul 08 19:15:47.243247 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:47.243124    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np" event={"ID":"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b","Type":"ContainerStarted","Data":"a823abd9a23ca24088697c674d91722a0f805c5b1c538030263075c06df7f43a"}
Jul 08 19:15:47.268789 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:47.268745    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np" podStartSLOduration=1.26872985 podStartE2EDuration="1.26872985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:15:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:15:47.267049653 +0000 UTC m=+2175.509540763" watchObservedRunningTime="2026-07-08 19:15:47.26872985 +0000 UTC m=+2175.511220972"
Jul 08 19:15:47.823363 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:47.823337    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:48.827373 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:48.827348    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:49.229283 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:49.229252    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:49.250689 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:49.250668    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:49.251526 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:49.251509    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:15:49.323312 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:49.323274    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:49.448642 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:49.448592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:49.688186 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:49.688150    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:49.901599 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:49.901547    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:50.007266 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:50.007188    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:53.802774 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:53.802737    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:15:56.083238 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:56.083203    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:15:57.258812 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:57.258772    2563 patch_prober.go:28] interesting pod/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 19:15:57.261284 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:57.258852    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7" podUID="fcb3e439-006e-447b-b46d-8082e9e6e668" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 19:15:58.288454 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:58.288419    2563 generic.go:356] "Generic (PLEG): container finished" podID="fcb3e439-006e-447b-b46d-8082e9e6e668" containerID="8ca38afee0917928f226ecab8b2b512138622a293f813f7c0e69901d97309fb5" exitCode=0
Jul 08 19:15:58.288454 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:58.288455    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7" event={"ID":"fcb3e439-006e-447b-b46d-8082e9e6e668","Type":"ContainerDied","Data":"8ca38afee0917928f226ecab8b2b512138622a293f813f7c0e69901d97309fb5"}
Jul 08 19:15:58.288887 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:58.288799    2563 scope.go:117] "RemoveContainer" containerID="8ca38afee0917928f226ecab8b2b512138622a293f813f7c0e69901d97309fb5"
Jul 08 19:15:58.289734 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:58.289704    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:15:58.289800 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:58.289785    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:15:58.289839 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:58.289816    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:15:59.294736 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:59.294699    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7" event={"ID":"fcb3e439-006e-447b-b46d-8082e9e6e668","Type":"ContainerStarted","Data":"d20f63bae816e38ed103b06727ce0e57b77601b7fd77ae659181065e26eaca96"}
Jul 08 19:15:59.844943 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:59.844904    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:15:59.845147 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:59.845032    2563 patch_prober.go:28] interesting pod/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 08 19:15:59.845147 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:15:59.845076    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7" podUID="fcb3e439-006e-447b-b46d-8082e9e6e668" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 08 19:16:00.845041 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:00.844570    2563 patch_prober.go:28] interesting pod/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 08 19:16:00.845041 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:00.844651    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7" podUID="fcb3e439-006e-447b-b46d-8082e9e6e668" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 08 19:16:01.845250 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:01.845205    2563 patch_prober.go:28] interesting pod/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 08 19:16:01.845728 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:01.845272    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7" podUID="fcb3e439-006e-447b-b46d-8082e9e6e668" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 08 19:16:02.822112 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:02.822013    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:16:02.844936 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:02.844896    2563 patch_prober.go:28] interesting pod/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 08 19:16:02.845115 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:02.844959    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7" podUID="fcb3e439-006e-447b-b46d-8082e9e6e668" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 08 19:16:02.981357 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:02.981324    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:16:03.848556 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:03.848520    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:16:03.849030 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:03.849010    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:16:03.849550 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:03.849532    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:16:04.251915 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:04.251846    2563 patch_prober.go:28] interesting pod/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 08 19:16:04.251915 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:04.251898    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np" podUID="8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 08 19:16:04.316917 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:04.316892    2563 generic.go:356] "Generic (PLEG): container finished" podID="8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" containerID="f6d15fc9a2a24f36b681b30de0424d30edbe355c4e8564cc2b4a67fa07a0a09c" exitCode=0
Jul 08 19:16:04.317056 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:04.316973    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np" event={"ID":"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b","Type":"ContainerDied","Data":"f6d15fc9a2a24f36b681b30de0424d30edbe355c4e8564cc2b4a67fa07a0a09c"}
Jul 08 19:16:04.317454 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:04.317440    2563 scope.go:117] "RemoveContainer" containerID="f6d15fc9a2a24f36b681b30de0424d30edbe355c4e8564cc2b4a67fa07a0a09c"
Jul 08 19:16:04.318268 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:04.318244    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:16:04.318333 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:04.318308    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:16:04.318372 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:04.318339    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 19:16:05.327350 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:05.327308    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np" event={"ID":"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b","Type":"ContainerStarted","Data":"abdbeb8d13d5fefb2df0b32ef6cba5a32f39effa8d3229eb99225fcf516b480d"}
Jul 08 19:16:05.823916 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:05.823881    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:16:05.824306 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:05.824281    2563 patch_prober.go:28] interesting pod/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 08 19:16:05.824463 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:05.824437    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np" podUID="8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 08 19:16:06.823692 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:06.823650    2563 patch_prober.go:28] interesting pod/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 08 19:16:06.824171 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:06.823717    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np" podUID="8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 08 19:16:07.823310 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:07.823273    2563 patch_prober.go:28] interesting pod/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 08 19:16:07.823608 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:07.823577    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np" podUID="8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 08 19:16:08.823439 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:08.823395    2563 patch_prober.go:28] interesting pod/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 08 19:16:08.823954 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:08.823463    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np" podUID="8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 08 19:16:09.826675 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:09.826640    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:16:09.827079 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:09.827004    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:16:09.827646 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:09.827618    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:16:10.644603 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:10.644576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:16:10.742152 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:16:10.742097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:18:54.303925 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:18:54.303843    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:18:55.543426 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:18:55.543391    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:18:58.181358 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:18:58.181325    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:19:00.449838 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:00.449795    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:19:00.515051 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:00.515013    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:19:00.747235 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:00.747159    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"]
Jul 08 19:19:00.747485 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:00.747444    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7" podUID="fcb3e439-006e-447b-b46d-8082e9e6e668" containerName="istio-proxy" containerID="cri-o://d20f63bae816e38ed103b06727ce0e57b77601b7fd77ae659181065e26eaca96" gracePeriod=30
Jul 08 19:19:00.774524 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:00.774500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:19:01.196324 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:01.196300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:19:01.642739 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:01.642704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:19:01.746025 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:01.745992    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:19:01.847079 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:01.847048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:19:02.004007 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:02.003927    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:19:03.851375 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:03.851335    2563 patch_prober.go:28] interesting pod/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 19:19:03.851781 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:03.851405    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7" podUID="fcb3e439-006e-447b-b46d-8082e9e6e668" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 19:19:05.994196 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:05.994175    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:19:06.049580 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.049512    2563 generic.go:356] "Generic (PLEG): container finished" podID="fcb3e439-006e-447b-b46d-8082e9e6e668" containerID="d20f63bae816e38ed103b06727ce0e57b77601b7fd77ae659181065e26eaca96" exitCode=0
Jul 08 19:19:06.049580 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.049555    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"
Jul 08 19:19:06.049796 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.049601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7" event={"ID":"fcb3e439-006e-447b-b46d-8082e9e6e668","Type":"ContainerDied","Data":"d20f63bae816e38ed103b06727ce0e57b77601b7fd77ae659181065e26eaca96"}
Jul 08 19:19:06.049796 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.049682    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7" event={"ID":"fcb3e439-006e-447b-b46d-8082e9e6e668","Type":"ContainerDied","Data":"db33950fbc0fb3b8618f1cda114c3f3fffa27bf58e9b1e8fb82ac60a2ebc8cb1"}
Jul 08 19:19:06.049796 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.049714    2563 scope.go:117] "RemoveContainer" containerID="d20f63bae816e38ed103b06727ce0e57b77601b7fd77ae659181065e26eaca96"
Jul 08 19:19:06.057540 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.057522    2563 scope.go:117] "RemoveContainer" containerID="8ca38afee0917928f226ecab8b2b512138622a293f813f7c0e69901d97309fb5"
Jul 08 19:19:06.064399 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.064383    2563 scope.go:117] "RemoveContainer" containerID="d20f63bae816e38ed103b06727ce0e57b77601b7fd77ae659181065e26eaca96"
Jul 08 19:19:06.064668 ip-10-0-129-111 kubenswrapper[2563]: E0708 19:19:06.064651    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d20f63bae816e38ed103b06727ce0e57b77601b7fd77ae659181065e26eaca96\": container with ID starting with d20f63bae816e38ed103b06727ce0e57b77601b7fd77ae659181065e26eaca96 not found: ID does not exist" containerID="d20f63bae816e38ed103b06727ce0e57b77601b7fd77ae659181065e26eaca96"
Jul 08 19:19:06.064766 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.064678    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d20f63bae816e38ed103b06727ce0e57b77601b7fd77ae659181065e26eaca96"} err="failed to get container status \"d20f63bae816e38ed103b06727ce0e57b77601b7fd77ae659181065e26eaca96\": rpc error: code = NotFound desc = could not find container \"d20f63bae816e38ed103b06727ce0e57b77601b7fd77ae659181065e26eaca96\": container with ID starting with d20f63bae816e38ed103b06727ce0e57b77601b7fd77ae659181065e26eaca96 not found: ID does not exist"
Jul 08 19:19:06.064766 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.064699    2563 scope.go:117] "RemoveContainer" containerID="8ca38afee0917928f226ecab8b2b512138622a293f813f7c0e69901d97309fb5"
Jul 08 19:19:06.064954 ip-10-0-129-111 kubenswrapper[2563]: E0708 19:19:06.064937    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ca38afee0917928f226ecab8b2b512138622a293f813f7c0e69901d97309fb5\": container with ID starting with 8ca38afee0917928f226ecab8b2b512138622a293f813f7c0e69901d97309fb5 not found: ID does not exist" containerID="8ca38afee0917928f226ecab8b2b512138622a293f813f7c0e69901d97309fb5"
Jul 08 19:19:06.065000 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.064961    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ca38afee0917928f226ecab8b2b512138622a293f813f7c0e69901d97309fb5"} err="failed to get container status \"8ca38afee0917928f226ecab8b2b512138622a293f813f7c0e69901d97309fb5\": rpc error: code = NotFound desc = could not find container \"8ca38afee0917928f226ecab8b2b512138622a293f813f7c0e69901d97309fb5\": container with ID starting with 8ca38afee0917928f226ecab8b2b512138622a293f813f7c0e69901d97309fb5 not found: ID does not exist"
Jul 08 19:19:06.137736 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.137715    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-credential-socket\") pod \"fcb3e439-006e-447b-b46d-8082e9e6e668\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") "
Jul 08 19:19:06.137847 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.137742    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-data\") pod \"fcb3e439-006e-447b-b46d-8082e9e6e668\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") "
Jul 08 19:19:06.137847 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.137786    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-podinfo\") pod \"fcb3e439-006e-447b-b46d-8082e9e6e668\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") "
Jul 08 19:19:06.137847 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.137811    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr8fw\" (UniqueName: \"kubernetes.io/projected/fcb3e439-006e-447b-b46d-8082e9e6e668-kube-api-access-kr8fw\") pod \"fcb3e439-006e-447b-b46d-8082e9e6e668\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") "
Jul 08 19:19:06.138078 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.137865    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-workload-socket\") pod \"fcb3e439-006e-447b-b46d-8082e9e6e668\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") "
Jul 08 19:19:06.138078 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.137907    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-token\") pod \"fcb3e439-006e-447b-b46d-8082e9e6e668\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") "
Jul 08 19:19:06.138078 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.137934    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-envoy\") pod \"fcb3e439-006e-447b-b46d-8082e9e6e668\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") "
Jul 08 19:19:06.138078 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.137958    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcb3e439-006e-447b-b46d-8082e9e6e668-istiod-ca-cert\") pod \"fcb3e439-006e-447b-b46d-8082e9e6e668\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") "
Jul 08 19:19:06.138078 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.137978    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-workload-certs\") pod \"fcb3e439-006e-447b-b46d-8082e9e6e668\" (UID: \"fcb3e439-006e-447b-b46d-8082e9e6e668\") "
Jul 08 19:19:06.138078 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.137993    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fcb3e439-006e-447b-b46d-8082e9e6e668" (UID: "fcb3e439-006e-447b-b46d-8082e9e6e668"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:19:06.138361 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.138161    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fcb3e439-006e-447b-b46d-8082e9e6e668" (UID: "fcb3e439-006e-447b-b46d-8082e9e6e668"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:19:06.138361 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.138294    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-workload-socket\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:06.138361 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.138317    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-credential-socket\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:06.138504 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.138371    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fcb3e439-006e-447b-b46d-8082e9e6e668" (UID: "fcb3e439-006e-447b-b46d-8082e9e6e668"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:19:06.138613 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.138584    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcb3e439-006e-447b-b46d-8082e9e6e668-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fcb3e439-006e-447b-b46d-8082e9e6e668" (UID: "fcb3e439-006e-447b-b46d-8082e9e6e668"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:19:06.138752 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.138709    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-data" (OuterVolumeSpecName: "istio-data") pod "fcb3e439-006e-447b-b46d-8082e9e6e668" (UID: "fcb3e439-006e-447b-b46d-8082e9e6e668"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:19:06.139934 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.139915    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fcb3e439-006e-447b-b46d-8082e9e6e668" (UID: "fcb3e439-006e-447b-b46d-8082e9e6e668"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 19:19:06.140167 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.140144    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcb3e439-006e-447b-b46d-8082e9e6e668-kube-api-access-kr8fw" (OuterVolumeSpecName: "kube-api-access-kr8fw") pod "fcb3e439-006e-447b-b46d-8082e9e6e668" (UID: "fcb3e439-006e-447b-b46d-8082e9e6e668"). InnerVolumeSpecName "kube-api-access-kr8fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:19:06.140423 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.140405    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-token" (OuterVolumeSpecName: "istio-token") pod "fcb3e439-006e-447b-b46d-8082e9e6e668" (UID: "fcb3e439-006e-447b-b46d-8082e9e6e668"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:19:06.140479 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.140426    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fcb3e439-006e-447b-b46d-8082e9e6e668" (UID: "fcb3e439-006e-447b-b46d-8082e9e6e668"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:19:06.239067 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.239047    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcb3e439-006e-447b-b46d-8082e9e6e668-istiod-ca-cert\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:06.239067 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.239067    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-workload-certs\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:06.239190 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.239076    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-data\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:06.239190 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.239084    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-podinfo\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:06.239190 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.239092    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr8fw\" (UniqueName: \"kubernetes.io/projected/fcb3e439-006e-447b-b46d-8082e9e6e668-kube-api-access-kr8fw\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:06.239190 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.239101    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-token\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:06.239190 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.239108    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e439-006e-447b-b46d-8082e9e6e668-istio-envoy\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:06.370658 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.366203    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"]
Jul 08 19:19:06.371357 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:06.370868    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-1f446e-openshift-default-856c96554c-68hc7"]
Jul 08 19:19:07.499841 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:07.499806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:19:07.599680 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:07.599645    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:19:07.763764 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:07.763680    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"]
Jul 08 19:19:07.763985 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:07.763931    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np" podUID="8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" containerName="istio-proxy" containerID="cri-o://abdbeb8d13d5fefb2df0b32ef6cba5a32f39effa8d3229eb99225fcf516b480d" gracePeriod=30
Jul 08 19:19:07.793326 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:07.793303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:19:08.222907 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:08.222879    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcb3e439-006e-447b-b46d-8082e9e6e668" path="/var/lib/kubelet/pods/fcb3e439-006e-447b-b46d-8082e9e6e668/volumes"
Jul 08 19:19:09.790850 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:09.790818    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9dwk"]
Jul 08 19:19:09.828815 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:09.828785    2563 patch_prober.go:28] interesting pod/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 19:19:09.828975 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:09.828847    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np" podUID="8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 19:19:13.005666 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.005616    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:19:13.079231 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.079139    2563 generic.go:356] "Generic (PLEG): container finished" podID="8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" containerID="abdbeb8d13d5fefb2df0b32ef6cba5a32f39effa8d3229eb99225fcf516b480d" exitCode=0
Jul 08 19:19:13.079231 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.079198    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"
Jul 08 19:19:13.079231 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.079219    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np" event={"ID":"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b","Type":"ContainerDied","Data":"abdbeb8d13d5fefb2df0b32ef6cba5a32f39effa8d3229eb99225fcf516b480d"}
Jul 08 19:19:13.079447 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.079294    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np" event={"ID":"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b","Type":"ContainerDied","Data":"a823abd9a23ca24088697c674d91722a0f805c5b1c538030263075c06df7f43a"}
Jul 08 19:19:13.079447 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.079317    2563 scope.go:117] "RemoveContainer" containerID="abdbeb8d13d5fefb2df0b32ef6cba5a32f39effa8d3229eb99225fcf516b480d"
Jul 08 19:19:13.087167 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.087151    2563 scope.go:117] "RemoveContainer" containerID="f6d15fc9a2a24f36b681b30de0424d30edbe355c4e8564cc2b4a67fa07a0a09c"
Jul 08 19:19:13.093271 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.093247    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-workload-socket\") pod \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") "
Jul 08 19:19:13.093359 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.093285    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-data\") pod \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") "
Jul 08 19:19:13.093359 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.093311    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-podinfo\") pod \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") "
Jul 08 19:19:13.093359 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.093346    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-workload-certs\") pod \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") "
Jul 08 19:19:13.093525 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.093398    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-token\") pod \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") "
Jul 08 19:19:13.093525 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.093434    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-envoy\") pod \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") "
Jul 08 19:19:13.093525 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.093463    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istiod-ca-cert\") pod \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") "
Jul 08 19:19:13.093525 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.093491    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpgwc\" (UniqueName: \"kubernetes.io/projected/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-kube-api-access-hpgwc\") pod \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") "
Jul 08 19:19:13.093525 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.093504    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" (UID: "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:19:13.093525 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.093522    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-credential-socket\") pod \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\" (UID: \"8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b\") "
Jul 08 19:19:13.093882 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.093678    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" (UID: "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:19:13.093882 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.093794    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-workload-socket\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:13.093882 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.093813    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-workload-certs\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:13.093882 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.093856    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" (UID: "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:19:13.094091 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.094024    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" (UID: "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:19:13.094137 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.094096    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-data" (OuterVolumeSpecName: "istio-data") pod "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" (UID: "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:19:13.094664 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.094642    2563 scope.go:117] "RemoveContainer" containerID="abdbeb8d13d5fefb2df0b32ef6cba5a32f39effa8d3229eb99225fcf516b480d"
Jul 08 19:19:13.094994 ip-10-0-129-111 kubenswrapper[2563]: E0708 19:19:13.094968    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abdbeb8d13d5fefb2df0b32ef6cba5a32f39effa8d3229eb99225fcf516b480d\": container with ID starting with abdbeb8d13d5fefb2df0b32ef6cba5a32f39effa8d3229eb99225fcf516b480d not found: ID does not exist" containerID="abdbeb8d13d5fefb2df0b32ef6cba5a32f39effa8d3229eb99225fcf516b480d"
Jul 08 19:19:13.095099 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.095005    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abdbeb8d13d5fefb2df0b32ef6cba5a32f39effa8d3229eb99225fcf516b480d"} err="failed to get container status \"abdbeb8d13d5fefb2df0b32ef6cba5a32f39effa8d3229eb99225fcf516b480d\": rpc error: code = NotFound desc = could not find container \"abdbeb8d13d5fefb2df0b32ef6cba5a32f39effa8d3229eb99225fcf516b480d\": container with ID starting with abdbeb8d13d5fefb2df0b32ef6cba5a32f39effa8d3229eb99225fcf516b480d not found: ID does not exist"
Jul 08 19:19:13.095099 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.095036    2563 scope.go:117] "RemoveContainer" containerID="f6d15fc9a2a24f36b681b30de0424d30edbe355c4e8564cc2b4a67fa07a0a09c"
Jul 08 19:19:13.095353 ip-10-0-129-111 kubenswrapper[2563]: E0708 19:19:13.095332    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6d15fc9a2a24f36b681b30de0424d30edbe355c4e8564cc2b4a67fa07a0a09c\": container with ID starting with f6d15fc9a2a24f36b681b30de0424d30edbe355c4e8564cc2b4a67fa07a0a09c not found: ID does not exist" containerID="f6d15fc9a2a24f36b681b30de0424d30edbe355c4e8564cc2b4a67fa07a0a09c"
Jul 08 19:19:13.095421 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.095359    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6d15fc9a2a24f36b681b30de0424d30edbe355c4e8564cc2b4a67fa07a0a09c"} err="failed to get container status \"f6d15fc9a2a24f36b681b30de0424d30edbe355c4e8564cc2b4a67fa07a0a09c\": rpc error: code = NotFound desc = could not find container \"f6d15fc9a2a24f36b681b30de0424d30edbe355c4e8564cc2b4a67fa07a0a09c\": container with ID starting with f6d15fc9a2a24f36b681b30de0424d30edbe355c4e8564cc2b4a67fa07a0a09c not found: ID does not exist"
Jul 08 19:19:13.095756 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.095736    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" (UID: "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 19:19:13.095851 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.095832    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-token" (OuterVolumeSpecName: "istio-token") pod "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" (UID: "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:19:13.095948 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.095933    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-kube-api-access-hpgwc" (OuterVolumeSpecName: "kube-api-access-hpgwc") pod "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" (UID: "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b"). InnerVolumeSpecName "kube-api-access-hpgwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:19:13.095997 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.095942    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" (UID: "8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:19:13.194551 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.194525    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-data\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:13.194551 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.194547    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-podinfo\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:13.194551 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.194556    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-token\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:13.194755 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.194564    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istio-envoy\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:13.194755 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.194572    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-istiod-ca-cert\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:13.194755 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.194582    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpgwc\" (UniqueName: \"kubernetes.io/projected/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-kube-api-access-hpgwc\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:13.194755 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.194596    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b-credential-socket\") on node \"ip-10-0-129-111.ec2.internal\" DevicePath \"\""
Jul 08 19:19:13.400855 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.400830    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"]
Jul 08 19:19:13.406191 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:13.406168    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-824e89-openshift-default-8565f96fd7-sj9np"]
Jul 08 19:19:14.223896 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:14.223856    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" path="/var/lib/kubelet/pods/8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b/volumes"
Jul 08 19:19:14.254845 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:14.254819    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c5cf545b9-8flvw_36ecd5f9-267f-4a9a-86a4-a02c8c37b676/copy-manifests/0.log"
Jul 08 19:19:14.260287 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:14.260271    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c5cf545b9-8flvw_36ecd5f9-267f-4a9a-86a4-a02c8c37b676/manager/0.log"
Jul 08 19:19:16.427124 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:16.427096    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4bm9h_704ff380-f6af-47ef-a4a3-afac5b7c8c4a/kuadrant-console-plugin/0.log"
Jul 08 19:19:16.847460 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:16.847436    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-b9dwk_5e5e0039-167b-4f95-b00c-198c923caa42/limitador/0.log"
Jul 08 19:19:17.638873 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:17.638836    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b75dd56d-kszqs_e6d20a96-4f3c-4b7b-beb8-10d89f173758/kube-auth-proxy/0.log"
Jul 08 19:19:18.231015 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:18.230982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:19:18.290806 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:18.290775    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:19:18.292909 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:18.292890    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fdfb86787-4thnt_54c0a4db-2b2f-4365-ba8b-881be307780b/router/0.log"
Jul 08 19:19:19.336712 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:19.336683    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-n8nf2_c2388dc9-839c-46e6-9015-2c9693f3b302/main/0.log"
Jul 08 19:19:23.453191 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.453159    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-prwc8/must-gather-d96hm"]
Jul 08 19:19:23.453588 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.453440    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcb3e439-006e-447b-b46d-8082e9e6e668" containerName="istio-proxy"
Jul 08 19:19:23.453588 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.453452    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcb3e439-006e-447b-b46d-8082e9e6e668" containerName="istio-proxy"
Jul 08 19:19:23.453588 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.453468    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcb3e439-006e-447b-b46d-8082e9e6e668" containerName="istio-proxy"
Jul 08 19:19:23.453588 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.453473    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcb3e439-006e-447b-b46d-8082e9e6e668" containerName="istio-proxy"
Jul 08 19:19:23.453588 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.453482    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" containerName="istio-proxy"
Jul 08 19:19:23.453588 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.453488    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" containerName="istio-proxy"
Jul 08 19:19:23.453588 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.453497    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" containerName="istio-proxy"
Jul 08 19:19:23.453588 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.453505    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" containerName="istio-proxy"
Jul 08 19:19:23.453588 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.453553    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcb3e439-006e-447b-b46d-8082e9e6e668" containerName="istio-proxy"
Jul 08 19:19:23.453588 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.453562    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcb3e439-006e-447b-b46d-8082e9e6e668" containerName="istio-proxy"
Jul 08 19:19:23.453588 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.453569    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" containerName="istio-proxy"
Jul 08 19:19:23.453588 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.453577    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f4bf3bd-be53-4aa0-bcdd-ee0216f1672b" containerName="istio-proxy"
Jul 08 19:19:23.458078 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.458061    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-prwc8/must-gather-d96hm"
Jul 08 19:19:23.461428 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.461404    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-prwc8\"/\"openshift-service-ca.crt\""
Jul 08 19:19:23.461539 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.461444    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-prwc8\"/\"kube-root-ca.crt\""
Jul 08 19:19:23.463002 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.462967    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-prwc8\"/\"default-dockercfg-q5xj4\""
Jul 08 19:19:23.465148 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.465123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-prwc8/must-gather-d96hm"]
Jul 08 19:19:23.468125 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.468104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:19:23.477253 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.477220    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4hpr\" (UniqueName: \"kubernetes.io/projected/c3796772-c952-4647-95bf-87d42a380fe7-kube-api-access-k4hpr\") pod \"must-gather-d96hm\" (UID: \"c3796772-c952-4647-95bf-87d42a380fe7\") " pod="openshift-must-gather-prwc8/must-gather-d96hm"
Jul 08 19:19:23.477349 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.477319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c3796772-c952-4647-95bf-87d42a380fe7-must-gather-output\") pod \"must-gather-d96hm\" (UID: \"c3796772-c952-4647-95bf-87d42a380fe7\") " pod="openshift-must-gather-prwc8/must-gather-d96hm"
Jul 08 19:19:23.566715 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.566687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:19:23.578082 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.578055    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4hpr\" (UniqueName: \"kubernetes.io/projected/c3796772-c952-4647-95bf-87d42a380fe7-kube-api-access-k4hpr\") pod \"must-gather-d96hm\" (UID: \"c3796772-c952-4647-95bf-87d42a380fe7\") " pod="openshift-must-gather-prwc8/must-gather-d96hm"
Jul 08 19:19:23.578232 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.578114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c3796772-c952-4647-95bf-87d42a380fe7-must-gather-output\") pod \"must-gather-d96hm\" (UID: \"c3796772-c952-4647-95bf-87d42a380fe7\") " pod="openshift-must-gather-prwc8/must-gather-d96hm"
Jul 08 19:19:23.578380 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.578365    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c3796772-c952-4647-95bf-87d42a380fe7-must-gather-output\") pod \"must-gather-d96hm\" (UID: \"c3796772-c952-4647-95bf-87d42a380fe7\") " pod="openshift-must-gather-prwc8/must-gather-d96hm"
Jul 08 19:19:23.590494 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.590470    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4hpr\" (UniqueName: \"kubernetes.io/projected/c3796772-c952-4647-95bf-87d42a380fe7-kube-api-access-k4hpr\") pod \"must-gather-d96hm\" (UID: \"c3796772-c952-4647-95bf-87d42a380fe7\") " pod="openshift-must-gather-prwc8/must-gather-d96hm"
Jul 08 19:19:23.767750 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.767663    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-prwc8/must-gather-d96hm"
Jul 08 19:19:23.896727 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.896704    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-prwc8/must-gather-d96hm"]
Jul 08 19:19:23.899292 ip-10-0-129-111 kubenswrapper[2563]: W0708 19:19:23.899265    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3796772_c952_4647_95bf_87d42a380fe7.slice/crio-f59ce660c17de8f51b164efd5ccbaa4a827354618d800ef35f377f6c760e4d68 WatchSource:0}: Error finding container f59ce660c17de8f51b164efd5ccbaa4a827354618d800ef35f377f6c760e4d68: Status 404 returned error can't find the container with id f59ce660c17de8f51b164efd5ccbaa4a827354618d800ef35f377f6c760e4d68
Jul 08 19:19:23.901059 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:23.901043    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 19:19:24.126083 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:24.126047    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-prwc8/must-gather-d96hm" event={"ID":"c3796772-c952-4647-95bf-87d42a380fe7","Type":"ContainerStarted","Data":"f59ce660c17de8f51b164efd5ccbaa4a827354618d800ef35f377f6c760e4d68"}
Jul 08 19:19:25.134971 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:25.134938    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-prwc8/must-gather-d96hm" event={"ID":"c3796772-c952-4647-95bf-87d42a380fe7","Type":"ContainerStarted","Data":"cf477bc10084f9ca9a79bea583ffc58a7f0f22039e94375b9365ec689b7f3cd9"}
Jul 08 19:19:25.135462 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:25.134985    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-prwc8/must-gather-d96hm" event={"ID":"c3796772-c952-4647-95bf-87d42a380fe7","Type":"ContainerStarted","Data":"fbba9ef4497527f87cac3eac1b79c0d2cf75ef5574d92f620809b05481e5e4d2"}
Jul 08 19:19:25.165954 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:25.165894    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-prwc8/must-gather-d96hm" podStartSLOduration=1.277244568 podStartE2EDuration="2.165870876s" totalImagesPullingTime="888.626308ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:19:25.165280479 +0000 UTC m=+2393.407771602" watchObservedRunningTime="2026-07-08 19:19:25.165870876 +0000 UTC m=+2393.408362003"
Jul 08 19:19:26.501929 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:26.501898    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rqbw5_69e11bcd-c40d-467f-8c92-464f63a8d067/global-pull-secret-syncer/0.log"
Jul 08 19:19:26.587291 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:26.587265    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log"
Jul 08 19:19:26.666025 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:26.665991    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-111.ec2.internal_3cf8f78dfede9ae7cc414ed8fcb3e4e9/haproxy/0.log"
Jul 08 19:19:31.389609 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:31.389580    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4bm9h_704ff380-f6af-47ef-a4a3-afac5b7c8c4a/kuadrant-console-plugin/0.log"
Jul 08 19:19:31.555841 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:31.555814    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-b9dwk_5e5e0039-167b-4f95-b00c-198c923caa42/limitador/0.log"
Jul 08 19:19:32.318060 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:32.317775    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 19:19:32.320030 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:32.318388    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fsjbh_3c721aa6-174c-479f-a347-2b96c9378ab5/ovn-acl-logging/0.log"
Jul 08 19:19:33.788013 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:33.787939    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mncmb_0b516475-1994-4ecc-a564-d98a967ca8ee/node-exporter/0.log"
Jul 08 19:19:33.817533 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:33.817499    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mncmb_0b516475-1994-4ecc-a564-d98a967ca8ee/kube-rbac-proxy/0.log"
Jul 08 19:19:33.841099 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:33.841067    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mncmb_0b516475-1994-4ecc-a564-d98a967ca8ee/init-textfile/0.log"
Jul 08 19:19:34.036801 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:34.036770    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd/prometheus/0.log"
Jul 08 19:19:34.082750 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:34.082665    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd/config-reloader/0.log"
Jul 08 19:19:34.108707 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:34.108680    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd/thanos-sidecar/0.log"
Jul 08 19:19:34.148725 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:34.148697    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd/kube-rbac-proxy-web/0.log"
Jul 08 19:19:34.173500 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:34.173439    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd/kube-rbac-proxy/0.log"
Jul 08 19:19:34.198014 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:34.197984    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd/kube-rbac-proxy-thanos/0.log"
Jul 08 19:19:34.227327 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:34.227301    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed3bfcb2-7dac-4951-a18f-2a8caeed9fdd/init-config-reloader/0.log"
Jul 08 19:19:36.706677 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.706617    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"]
Jul 08 19:19:36.712090 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.712069    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:36.720606 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.720130    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"]
Jul 08 19:19:36.817116 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.817080    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd6mt\" (UniqueName: \"kubernetes.io/projected/18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc-kube-api-access-cd6mt\") pod \"perf-node-gather-daemonset-d89c9\" (UID: \"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc\") " pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:36.817301 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.817141    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc-sys\") pod \"perf-node-gather-daemonset-d89c9\" (UID: \"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc\") " pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:36.817301 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.817181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc-podres\") pod \"perf-node-gather-daemonset-d89c9\" (UID: \"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc\") " pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:36.817301 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.817225    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc-lib-modules\") pod \"perf-node-gather-daemonset-d89c9\" (UID: \"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc\") " pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:36.817464 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.817300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc-proc\") pod \"perf-node-gather-daemonset-d89c9\" (UID: \"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc\") " pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:36.918364 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.918322    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc-podres\") pod \"perf-node-gather-daemonset-d89c9\" (UID: \"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc\") " pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:36.918558 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.918382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc-lib-modules\") pod \"perf-node-gather-daemonset-d89c9\" (UID: \"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc\") " pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:36.918558 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.918416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc-proc\") pod \"perf-node-gather-daemonset-d89c9\" (UID: \"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc\") " pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:36.918558 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.918486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd6mt\" (UniqueName: \"kubernetes.io/projected/18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc-kube-api-access-cd6mt\") pod \"perf-node-gather-daemonset-d89c9\" (UID: \"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc\") " pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:36.918558 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.918531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc-sys\") pod \"perf-node-gather-daemonset-d89c9\" (UID: \"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc\") " pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:36.918852 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.918653    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc-sys\") pod \"perf-node-gather-daemonset-d89c9\" (UID: \"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc\") " pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:36.918852 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.918770    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc-podres\") pod \"perf-node-gather-daemonset-d89c9\" (UID: \"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc\") " pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:36.918967 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.918858    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc-lib-modules\") pod \"perf-node-gather-daemonset-d89c9\" (UID: \"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc\") " pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:36.918967 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.918910    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc-proc\") pod \"perf-node-gather-daemonset-d89c9\" (UID: \"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc\") " pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:36.927950 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:36.927918    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd6mt\" (UniqueName: \"kubernetes.io/projected/18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc-kube-api-access-cd6mt\") pod \"perf-node-gather-daemonset-d89c9\" (UID: \"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc\") " pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:37.025872 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:37.025549    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:37.195262 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:37.195204    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"]
Jul 08 19:19:37.215040 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:37.214954    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9" event={"ID":"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc","Type":"ContainerStarted","Data":"80f081ac8afee45028b2b023584303d2dd4c3a91bed55ab8011c96c3bfb7e02e"}
Jul 08 19:19:38.226644 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:38.226602    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:38.227126 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:38.226673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9" event={"ID":"18c6f1e6-b403-4fef-a9bd-6b5ec64d12cc","Type":"ContainerStarted","Data":"58ada2184e857f2e93186bbb997efb0e3caecaa84bc008b1e93127919e7d2e8d"}
Jul 08 19:19:38.784815 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:38.784790    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4l5d5_256c7e40-4220-4c0e-bf44-7dffcc1fb5c3/dns/0.log"
Jul 08 19:19:38.803488 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:38.803466    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4l5d5_256c7e40-4220-4c0e-bf44-7dffcc1fb5c3/kube-rbac-proxy/0.log"
Jul 08 19:19:38.932890 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:38.932859    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxmt9_ce9db15f-8b7d-4a0f-b5bf-5a50be4bf682/dns-node-resolver/0.log"
Jul 08 19:19:39.540430 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:39.540402    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-62l88_d149a818-b8bc-4e1c-bba0-9de3c65ff3b4/node-ca/0.log"
Jul 08 19:19:40.663174 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:40.663149    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b75dd56d-kszqs_e6d20a96-4f3c-4b7b-beb8-10d89f173758/kube-auth-proxy/0.log"
Jul 08 19:19:40.847717 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:40.847691    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fdfb86787-4thnt_54c0a4db-2b2f-4365-ba8b-881be307780b/router/0.log"
Jul 08 19:19:41.528274 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:41.528245    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7hh8k_e6d6e5de-b05e-4e3d-8c97-7619bf059136/serve-healthcheck-canary/0.log"
Jul 08 19:19:42.131317 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:42.131259    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6s4s7_d8e3cb9b-b149-443a-af33-487e6f08be18/kube-rbac-proxy/0.log"
Jul 08 19:19:42.150581 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:42.150559    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6s4s7_d8e3cb9b-b149-443a-af33-487e6f08be18/exporter/0.log"
Jul 08 19:19:42.174972 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:42.174950    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6s4s7_d8e3cb9b-b149-443a-af33-487e6f08be18/extractor/0.log"
Jul 08 19:19:44.235407 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:44.235365    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9"
Jul 08 19:19:44.257274 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:44.257215    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-prwc8/perf-node-gather-daemonset-d89c9" podStartSLOduration=8.257194592 podStartE2EDuration="8.257194592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:19:38.24093168 +0000 UTC m=+2406.483422808" watchObservedRunningTime="2026-07-08 19:19:44.257194592 +0000 UTC m=+2412.499685719"
Jul 08 19:19:44.609051 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:44.609020    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c5cf545b9-8flvw_36ecd5f9-267f-4a9a-86a4-a02c8c37b676/manager/0.log"
Jul 08 19:19:44.629667 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:44.629614    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c5cf545b9-8flvw_36ecd5f9-267f-4a9a-86a4-a02c8c37b676/copy-manifests/0.log"
Jul 08 19:19:46.100530 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:46.100502    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58c5974cc6-c69fc_e15e8731-6ffa-4e3e-a228-e65949aa64a5/manager/0.log"
Jul 08 19:19:46.880268 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:46.880237    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b75dd56d-kszqs_e6d20a96-4f3c-4b7b-beb8-10d89f173758/kube-auth-proxy/0.log"
Jul 08 19:19:47.017678 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:47.017649    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fdfb86787-4thnt_54c0a4db-2b2f-4365-ba8b-881be307780b/router/0.log"
Jul 08 19:19:48.390992 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:48.390950    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b75dd56d-kszqs_e6d20a96-4f3c-4b7b-beb8-10d89f173758/kube-auth-proxy/0.log"
Jul 08 19:19:48.540194 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:48.540166    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fdfb86787-4thnt_54c0a4db-2b2f-4365-ba8b-881be307780b/router/0.log"
Jul 08 19:19:48.811223 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:48.811144    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktl4c_fc40634d-9589-4123-b582-ac94ba9b3cb6/konnectivity-agent/0.log" limit=1024
Jul 08 19:19:52.817799 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:52.817767    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4qch9_7319177e-ad79-4ffc-a4ab-3c04ba7106d4/kube-multus/0.log"
Jul 08 19:19:52.990604 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:52.990580    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nhg22_eddf9339-cff1-490c-94bd-45eca0498564/kube-multus-additional-cni-plugins/0.log"
Jul 08 19:19:53.011309 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:53.011288    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nhg22_eddf9339-cff1-490c-94bd-45eca0498564/egress-router-binary-copy/0.log"
Jul 08 19:19:53.033853 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:53.033827    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nhg22_eddf9339-cff1-490c-94bd-45eca0498564/cni-plugins/0.log"
Jul 08 19:19:53.056007 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:53.055984    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nhg22_eddf9339-cff1-490c-94bd-45eca0498564/bond-cni-plugin/0.log"
Jul 08 19:19:53.076555 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:53.076493    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nhg22_eddf9339-cff1-490c-94bd-45eca0498564/routeoverride-cni/0.log"
Jul 08 19:19:53.098090 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:53.098070    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nhg22_eddf9339-cff1-490c-94bd-45eca0498564/whereabouts-cni-bincopy/0.log"
Jul 08 19:19:53.119800 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:53.119769    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nhg22_eddf9339-cff1-490c-94bd-45eca0498564/whereabouts-cni/0.log"
Jul 08 19:19:53.474276 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:53.474242    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r4p8h_d580cb38-0201-47b0-9d32-6a24141ad0ce/network-metrics-daemon/0.log"
Jul 08 19:19:53.492956 ip-10-0-129-111 kubenswrapper[2563]: I0708 19:19:53.492935    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r4p8h_d580cb38-0201-47b0-9d32-6a24141ad0ce/kube-rbac-proxy/0.log"