Jul 15 15:35:21.063504 ip-10-0-135-178 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 15:35:21.572863 ip-10-0-135-178 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 15:35:21.572863 ip-10-0-135-178 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 15:35:21.572863 ip-10-0-135-178 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 15:35:21.572863 ip-10-0-135-178 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 15:35:21.572863 ip-10-0-135-178 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 15:35:21.572863 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.494288    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 15:35:21.572863 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501324    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:35:21.572863 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501336    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:35:21.572863 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501340    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:35:21.572863 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501343    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:35:21.572863 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501348    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:35:21.572863 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501351    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:35:21.572863 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501353    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:35:21.572863 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501357    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:35:21.568275 ip-10-0-135-178 systemd[1]: Started Kubernetes Kubelet.
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501361    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501364    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501367    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501384    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501388    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501391    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501400    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501403    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501406    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501409    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501411    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501414    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501416    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501419    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501422    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501425    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501427    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501430    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501433    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:35:21.574300 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501436    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501439    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501441    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501444    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501447    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501449    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501452    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501454    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501457    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501460    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501463    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501466    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501469    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501471    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501474    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501476    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501479    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501481    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501486    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501491    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:35:21.575429 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501494    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501497    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501500    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501503    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501506    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501509    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501512    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501514    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501517    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501520    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501523    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501525    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501528    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501531    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501533    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501536    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501539    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501542    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501545    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501548    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:35:21.576217 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501551    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501553    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501556    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501558    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501561    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501564    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501568    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501573    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501576    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501578    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501581    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501583    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501586    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501589    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501592    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501595    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501597    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501600    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501603    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:35:21.576936 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501605    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501608    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501610    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501613    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501616    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501618    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501621    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501624    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501627    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501630    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501632    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501635    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.501639    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502401    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502409    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502412    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502415    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502418    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502421    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502424    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:35:21.577615 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502427    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502430    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502432    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502436    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502456    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502461    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502469    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502473    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502476    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502479    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502482    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502485    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502488    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502491    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502494    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502496    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502499    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502501    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502504    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502507    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:35:21.578673 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502509    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502512    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502515    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502517    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502520    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502523    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502526    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502528    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502531    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502534    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502537    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502540    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502542    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502545    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502547    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502550    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502553    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502557    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502561    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:35:21.579808 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502570    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502574    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502578    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502581    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502584    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502587    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502590    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502598    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502600    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502603    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502606    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502608    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502611    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502614    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502616    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502618    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502621    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502624    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502627    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502629    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:35:21.580914 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502632    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502635    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502638    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502640    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502643    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502646    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502648    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502651    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502653    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502656    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502659    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502661    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502663    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502672    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502674    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502677    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502679    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502683    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502685    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502688    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:35:21.581961 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502690    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502693    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502696    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502699    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502701    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502704    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502708    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502712    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502715    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502718    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502721    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502723    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.502726    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503127    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503133    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503137    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503141    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503144    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503146    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:35:21.582985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503149    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503152    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503157    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503159    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503162    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503165    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503171    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503174    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503176    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503179    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503181    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503184    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503187    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503189    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503192    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503195    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503197    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503200    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503202    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503205    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:35:21.584270 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503207    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503210    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503212    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503215    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503217    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503220    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503222    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503225    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503228    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503230    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503249    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503253    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503257    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503261    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503265    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503268    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503271    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503275    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503277    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503281    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:35:21.585307 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503284    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503287    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503290    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503293    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503295    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503298    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503301    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503304    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503307    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503309    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503312    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503315    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503317    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503320    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503323    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503325    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503329    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503331    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503334    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:35:21.586395 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503337    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503341    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503343    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503346    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503349    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503351    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503353    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503357    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503360    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503363    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503365    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503367    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503370    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503373    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503375    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503378    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503383    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503386    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503389    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:35:22.988334 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503392    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503394    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503397    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503400    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503402    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503405    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503407    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503410    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503412    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503414    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503417    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503419    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503422    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503425    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.503428    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503497    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503504    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503510    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503515    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503519    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503524    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 15:35:22.989465 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503529    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503533    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503537    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503540    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503543    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503547    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503550    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503553    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503556    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503559    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503562    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503565    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503570    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503573    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503576    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503579    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503583    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503586    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503589    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503592    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503595    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503599    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503601    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503604    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 15:35:22.990376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503608    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503612    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503617    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503620    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503622    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503625    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503628    2583 flags.go:64] FLAG: --enable-server="true"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503633    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503643    2583 flags.go:64] FLAG: --event-burst="100"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503646    2583 flags.go:64] FLAG: --event-qps="50"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503649    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503652    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503655    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503659    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503662    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503665    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503668    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503671    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503674    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503677    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503680    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503683    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503686    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503689    2583 flags.go:64] FLAG: --feature-gates=""
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503693    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 15:35:22.991548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503696    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503699    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503702    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503705    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503708    2583 flags.go:64] FLAG: --help="false"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503711    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-135-178.ec2.internal"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503714    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503717    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503722    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503725    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503729    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503732    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503734    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503737    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503742    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503745    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503748    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503751    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503754    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503757    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503761    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503764    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503766    2583 flags.go:64] FLAG: --lock-file=""
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503770    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 15:35:22.992731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503773    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503776    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503781    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503784    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503787    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503790    2583 flags.go:64] FLAG: --logging-format="text"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503793    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503796    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503799    2583 flags.go:64] FLAG: --manifest-url=""
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503801    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503806    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503809    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503813    2583 flags.go:64] FLAG: --max-pods="110"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503816    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503818    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503821    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503827    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503830    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503833    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503836    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503843    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503846    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503850    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 15:35:22.994237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503853    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503856    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503862    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503865    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503869    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503871    2583 flags.go:64] FLAG: --port="10250"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503874    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503877    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bbd04855218dfc24"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503881    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503887    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503890    2583 flags.go:64] FLAG: --register-node="true"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503893    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503897    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503899    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503902    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503905    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503909    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503912    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503914    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503917    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503920    2583 flags.go:64] FLAG: --runonce="false"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503923    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503926    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503929    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503932    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 15:35:22.997634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503935    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503940    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503943    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503946    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503951    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503954    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503958    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503961    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503964    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503967    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503970    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503976    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503979    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503982    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503986    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503989    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503992    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503995    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.503998    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.504001    2583 flags.go:64] FLAG: --v="2"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.504005    2583 flags.go:64] FLAG: --version="false"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.504010    2583 flags.go:64] FLAG: --vmodule=""
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.504013    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.504016    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 15:35:22.998612 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504141    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504145    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504148    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504151    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504154    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504157    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504160    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504163    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504166    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504170    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504172    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504175    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504178    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504180    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504184    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504186    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504189    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504191    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504194    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504197    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:35:23.102861 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504199    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504202    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504205    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504207    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504209    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504212    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504215    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504217    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504220    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504223    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504225    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504228    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504230    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504247    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504251    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504254    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504256    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504259    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504261    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504264    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:35:23.103574 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504267    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504270    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504273    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504276    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504278    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504281    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504285    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504287    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504290    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504292    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504295    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504297    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504300    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504303    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504305    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504308    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504311    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504313    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504317    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504320    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:35:23.104280 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504330    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504332    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504336    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504340    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504345    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504348    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504351    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504354    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504357    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504359    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504362    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504364    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504367    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504373    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504376    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504378    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504381    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504384    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504388    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:35:23.105006 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504391    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504393    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504396    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504399    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504403    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504406    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504409    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504411    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504414    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504417    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504419    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504422    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504425    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504428    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504431    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504434    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504436    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504440    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504442    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:35:23.105695 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.504445    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:35:23.106421 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.505114    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 15:35:23.106421 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.513535    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 15:35:23.106421 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.513553    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 15:35:23.106421 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.513571    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 15:35:23.106421 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.513580    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 15:35:23.106421 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513640    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:35:23.106421 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513646    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:35:23.106421 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513650    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:35:23.106421 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513653    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:35:23.106421 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513656    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:35:23.106421 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513661    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:35:23.106421 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513665    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:35:23.106421 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513668    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:35:23.106421 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513671    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513674    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513676    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513679    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513682    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513684    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513687    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513689    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513692    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513695    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513701    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513704    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513707    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513714    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513717    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513720    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513723    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513725    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513728    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513736    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:35:23.107156 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513738    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513742    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513744    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513747    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513750    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513752    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513755    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513758    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513761    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513763    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513766    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513768    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513771    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513775    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513778    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513781    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513784    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513786    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513789    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:35:23.107854 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513792    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513794    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513797    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513801    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513804    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513806    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513809    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513811    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513814    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513817    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513820    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513822    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513826    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513829    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513832    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513834    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513837    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513839    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513842    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513845    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:35:23.108588 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513848    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513850    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513853    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513855    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513859    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513861    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513864    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513867    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513869    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513872    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513876    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513879    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513888    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513891    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513894    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513898    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513901    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513903    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513906    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:35:23.109304 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513908    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:35:23.110026 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513911    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:35:23.110026 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513913    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:35:23.110026 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513916    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:35:23.110026 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513918    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:35:23.110026 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513923    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:35:23.110026 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513925    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:35:23.110026 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513928    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:35:23.110026 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513931    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:35:23.110026 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513933    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:35:23.110026 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513936    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:35:23.110026 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513938    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:35:23.110026 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.513941    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:35:23.110026 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.513946    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 15:35:23.110026 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514068    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:35:23.110026 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514074    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514077    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514080    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514083    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514086    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514089    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514092    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514094    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514097    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514100    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514102    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514106    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514109    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514111    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514116    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514119    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514122    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514124    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514127    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:35:23.110711 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514130    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514132    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514135    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514139    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514142    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514144    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514147    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514150    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514152    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514155    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514157    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514160    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514163    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514165    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514168    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514170    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514173    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514175    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514178    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514180    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:35:23.111431 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514183    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514186    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514188    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514191    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514193    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514196    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514199    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514203    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514206    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514209    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514211    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514214    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514216    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514219    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514223    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514228    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514230    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514233    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514256    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:35:23.112149 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514259    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514262    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514265    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514267    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514270    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514273    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514275    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514278    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514280    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514283    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514286    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514288    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514291    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514295    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514298    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514302    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514304    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514307    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514310    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514314    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:35:23.112882 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514318    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514321    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514323    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514326    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514328    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514331    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514333    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514336    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514340    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514342    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514345    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514348    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514350    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514353    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514356    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514360    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514363    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514366    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514369    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:35:23.113601 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:21.514371    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:35:23.114335 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.514376    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 15:35:23.114335 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.514545    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 15:35:23.114335 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.516689    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 15:35:23.114335 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.518178    2583 server.go:1019] "Starting client certificate rotation"
Jul 15 15:35:23.114335 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.518286    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 15:35:23.114335 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.518327    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 15:35:23.114335 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.522049    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 15:35:23.114335 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.523417    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 15:35:23.114335 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.530613    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 15 15:35:23.114335 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.534280    2583 log.go:25] "Validated CRI v1 image API"
Jul 15 15:35:23.114335 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.535205    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 15:35:23.114335 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.538569    2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ae6a059e-a0d7-49c8-af23-f354d24c3316:/dev/nvme0n1p3 c6ac0aba-c044-414d-8dfe-53d6dd1bb09d:/dev/nvme0n1p4]
Jul 15 15:35:23.114699 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.538583    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 15:35:23.115076 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.545382    2583 manager.go:216] Machine: {Timestamp:2026-07-15 15:35:21.543673083 +0000 UTC m=+0.353155229 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106062 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25cc5b80573a9f572b21ba9c20df04 SystemUUID:ec25cc5b-8057-3a9f-572b-21ba9c20df04 BootID:d08c90b7-80d4-4461-9a74-4cb1ced0e72b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:55:e1:1e:1f:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:55:e1:1e:1f:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:64:ee:c9:f4:4c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 15:35:23.115076 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.545482    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 15:35:23.115076 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.545567    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 15:35:23.115076 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.545999    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 15:35:23.115076 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.548902    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 15:35:23.115076 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.548934    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-178.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 15:35:23.115076 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.549709    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.549718    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.549726    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.551257    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.552566    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.555491    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.555617    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.555647    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.555657    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.555672    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.555681    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.555691    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.556037    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.556053    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.558678    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.560773    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.560812    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.561017    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.561035    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.561044    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.561052    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.561065    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.561072    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.561487    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.561496    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.561506    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.561514    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.561526    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.561538    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.563323    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.563334    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.565548    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-178.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:21.565560    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:21.565601    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.567265    2583 server.go:1268] "Started kubelet"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.567328    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.567422    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.567485    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.569962    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.572346    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 15:35:23.115424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.574617    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d7clw"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:21.576185    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.577447    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.577456    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:21.577593    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.578057    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.578071    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.579032    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.579048    2583 factory.go:55] Registering systemd factory
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.579059    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.579172    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.579267    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.579275    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.579349    2583 factory.go:153] Registering CRI-O factory
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.579362    2583 factory.go:223] Registration of the crio container factory successfully
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.579383    2583 factory.go:103] Registering Raw factory
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.579399    2583 manager.go:1196] Started watching for new ooms in manager
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.579825    2583 manager.go:349] Starting recovery of all containers
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:21.581106    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:21.583796    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d7clw"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:22.994062    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:22.998134    2583 manager.go:354] Recovery completed
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.002402    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.004392    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.004424    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.004436    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.004981    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.005001    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.005009    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.005026    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.005659    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.005684    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.005696    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.006292    2583 policy_none.go:49] "None policy: Start"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.006303    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.006314    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.007612    2583 policy_none.go:47] "Start"
Jul 15 15:35:23.119724 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:23.079329    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.141821    2583 manager.go:337] "Starting Device Plugin manager"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:23.142021    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.142037    2583 server.go:87] "Starting device plugin registration server"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.142335    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.142349    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.142440    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.142512    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.142518    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:23.143054    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:23.143095    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:23.189288    2583 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-178.ec2.internal\" not found" node="ip-10-0-135-178.ec2.internal"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.243370    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.244507    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.244551    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.244566    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.244600    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-178.ec2.internal"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.254290    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-178.ec2.internal"
Jul 15 15:35:23.259208 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:23.254311    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-178.ec2.internal\": node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 15 15:35:23.356468 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:23.285239    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 15 15:35:23.456072 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:23.385940    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 15 15:35:23.567638 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:23.486274    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.577194    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.578435    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.578483    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.578512    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:23.578560    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.581762    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:23.587323    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.680793    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal"]
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.680865    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.682459    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.682488    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.682499    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.684001    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.684111    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.684136    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.684640    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.684660    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.684669    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.684671    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.684690    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.684698    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.685999    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.686019    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.686608    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.686633    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.686645    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:35:23.730860 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:23.687545    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 15 15:35:23.837238 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:23.788011    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 15 15:35:23.837238 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.828049    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/102fbd48ff7ff0cfcd397c73fd966f70-config\") pod \"kube-apiserver-proxy-ip-10-0-135-178.ec2.internal\" (UID: \"102fbd48ff7ff0cfcd397c73fd966f70\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal"
Jul 15 15:35:23.837238 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.828074    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2e193e431239fbdd2a5f918e7173fd13-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal\" (UID: \"2e193e431239fbdd2a5f918e7173fd13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 15 15:35:23.837238 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:23.828092    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e193e431239fbdd2a5f918e7173fd13-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal\" (UID: \"2e193e431239fbdd2a5f918e7173fd13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 15 15:35:24.161869 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:24.075793    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-178.ec2.internal\" not found" node="ip-10-0-135-178.ec2.internal"
Jul 15 15:35:24.161869 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:24.080167    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 15 15:35:24.161869 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.080337    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 15:30:22 +0000 UTC" deadline="2028-02-25 09:35:50.642217817 +0000 UTC"
Jul 15 15:35:24.161869 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.080354    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14154h0m26.561866153s"
Jul 15 15:35:24.161869 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.080437    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e193e431239fbdd2a5f918e7173fd13-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal\" (UID: \"2e193e431239fbdd2a5f918e7173fd13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 15 15:35:24.161869 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.080458    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/102fbd48ff7ff0cfcd397c73fd966f70-config\") pod \"kube-apiserver-proxy-ip-10-0-135-178.ec2.internal\" (UID: \"102fbd48ff7ff0cfcd397c73fd966f70\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal"
Jul 15 15:35:24.161869 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.080476    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2e193e431239fbdd2a5f918e7173fd13-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal\" (UID: \"2e193e431239fbdd2a5f918e7173fd13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 15 15:35:24.161869 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.080498    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2e193e431239fbdd2a5f918e7173fd13-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal\" (UID: \"2e193e431239fbdd2a5f918e7173fd13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 15 15:35:24.161869 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.080535    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e193e431239fbdd2a5f918e7173fd13-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal\" (UID: \"2e193e431239fbdd2a5f918e7173fd13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 15 15:35:24.161869 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.080553    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/102fbd48ff7ff0cfcd397c73fd966f70-config\") pod \"kube-apiserver-proxy-ip-10-0-135-178.ec2.internal\" (UID: \"102fbd48ff7ff0cfcd397c73fd966f70\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal"
Jul 15 15:35:24.161869 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:24.081421    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-178.ec2.internal\" not found" node="ip-10-0-135-178.ec2.internal"
Jul 15 15:35:24.161869 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.084460    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal"
Jul 15 15:35:24.161869 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.087497    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 15:35:24.161869 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.087707    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 15:35:24.161869 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.087837    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 15:35:24.368857 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.284754    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 15 15:35:24.368857 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.326653    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 15:35:24.368857 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.328629    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal"
Jul 15 15:35:24.368857 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.346764    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 15:35:24.377973 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.377939    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 15 15:35:24.476595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.476508    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 15:35:24.960542 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:24.960459    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 15:35:25.080521 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.080489    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 15:35:25.080973 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.080933    2583 apiserver.go:52] "Watching apiserver"
Jul 15 15:35:25.089704 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.089683    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 15:35:25.093575 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.093543    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-mwrjx","openshift-image-registry/node-ca-h7fgx","openshift-network-diagnostics/network-check-target-m5gdn","openshift-network-operator/iptables-alerter-4vwc6","openshift-ovn-kubernetes/ovnkube-node-hqdzr","kube-system/global-pull-secret-syncer-tts5k","kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal","openshift-multus/multus-additional-cni-plugins-x95gs","openshift-multus/multus-l4xb7","openshift-multus/network-metrics-daemon-5jk56","kube-system/konnectivity-agent-m9ggg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp","openshift-cluster-node-tuning-operator/tuned-m5qk2"]
Jul 15 15:35:25.096071 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.095993    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 15:35:25.096275 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.096257    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.097697 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.097675    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.098234 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:25.098212    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e193e431239fbdd2a5f918e7173fd13.slice/crio-4b75b532357d455667f7ed5156352541dd20055d6f57d73488a0d5773fcef5d8 WatchSource:0}: Error finding container 4b75b532357d455667f7ed5156352541dd20055d6f57d73488a0d5773fcef5d8: Status 404 returned error can't find the container with id 4b75b532357d455667f7ed5156352541dd20055d6f57d73488a0d5773fcef5d8
Jul 15 15:35:25.098826 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.098813    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:25.098888 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.098872    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:25.099958 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.099935    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4vwc6"
Jul 15 15:35:25.101487 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.101469    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.102342 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.102328    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:35:25.103012 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.102794    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 15:35:25.103012 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.102841    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 15:35:25.103012 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.102898    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 15:35:25.103012 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.102841    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 15:35:25.103012 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.102962    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:25.103290 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.103018    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:25.103290 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.103122    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q82vz\""
Jul 15 15:35:25.103290 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.103176    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dvc7d\""
Jul 15 15:35:25.103290 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.103205    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 15:35:25.103290 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.103222    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 15:35:25.104274 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.104067    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 15:35:25.104274 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.104100    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 15:35:25.104274 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.104101    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-crbn5\""
Jul 15 15:35:25.104274 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.104161    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 15:35:25.104274 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.104105    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 15:35:25.104537 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.104521    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.105374 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.105357    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 15:35:25.105804 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.105788    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 15:35:25.105885 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.105796    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.106464 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.106445    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 15:35:25.107276 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.107212    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 15:35:25.107369 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.107275    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 15:35:25.107430 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.107414    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h7fgx"
Jul 15 15:35:25.107756 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.107735    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fj8dk\""
Jul 15 15:35:25.107833 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.107815    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 15:35:25.107975 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.107930    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hgtrw\""
Jul 15 15:35:25.108071 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.107995    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 15:35:25.108071 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.108017    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 15:35:25.108973 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.108939    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mwrjx"
Jul 15 15:35:25.110406 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.110392    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:25.110484 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.110446    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:25.111669 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.111653    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m9ggg"
Jul 15 15:35:25.114816 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.114602    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 15:35:25.114816 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.114624    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 15:35:25.114816 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.114645    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 15:35:25.114816 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.114669    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 15:35:25.115018 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.114802    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gz9fs\""
Jul 15 15:35:25.115190 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.115174    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7j9bx\""
Jul 15 15:35:25.115391 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.115374    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 15:35:25.115460 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.115407    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lmcwq\""
Jul 15 15:35:25.115460 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.115433    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 15:35:25.115561 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.115464    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 15:35:25.115561 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.115406    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 15:35:25.115649 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.115568    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rkldf\""
Jul 15 15:35:25.115712 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.115701    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 15:35:25.137365 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.137349    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-l8tp2"
Jul 15 15:35:25.148327 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.148309    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l8tp2"
Jul 15 15:35:25.180832 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.180809    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 15:35:25.188369 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188352    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-systemd-units\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.188427 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f980a640-3a85-4ec8-a905-20a33aca6a40-host\") pod \"node-ca-h7fgx\" (UID: \"f980a640-3a85-4ec8-a905-20a33aca6a40\") " pod="openshift-image-registry/node-ca-h7fgx"
Jul 15 15:35:25.188427 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188401    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs\") pod \"network-metrics-daemon-5jk56\" (UID: \"1c2e9a13-471e-478c-b38e-6748dc7ede63\") " pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:25.188427 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-run\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.188512 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188437    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9d9x\" (UniqueName: \"kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x\") pod \"network-check-target-m5gdn\" (UID: \"be1ab9a0-8cba-4834-a20c-a36d2117c38c\") " pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:25.188512 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188470    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-os-release\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.188512 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188488    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-var-lib-cni-bin\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.188595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188522    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-run-netns\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.188595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188544    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-run-ovn-kubernetes\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.188595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188560    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06751222-5566-4053-8cfb-faffda2016fc-system-cni-dir\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.188595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k8q6\" (UniqueName: \"kubernetes.io/projected/dcd4d915-d684-4aee-9a48-0e00aad98d39-kube-api-access-4k8q6\") pod \"iptables-alerter-4vwc6\" (UID: \"dcd4d915-d684-4aee-9a48-0e00aad98d39\") " pod="openshift-network-operator/iptables-alerter-4vwc6"
Jul 15 15:35:25.188743 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188598    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-cnibin\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.188743 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188612    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-sys-fs\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.188743 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188625    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-cni-bin\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.188743 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188640    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db3635c9-5545-49e5-9004-500eff2f48da-ovnkube-script-lib\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.188743 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188674    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pf6l\" (UniqueName: \"kubernetes.io/projected/f980a640-3a85-4ec8-a905-20a33aca6a40-kube-api-access-6pf6l\") pod \"node-ca-h7fgx\" (UID: \"f980a640-3a85-4ec8-a905-20a33aca6a40\") " pod="openshift-image-registry/node-ca-h7fgx"
Jul 15 15:35:25.188743 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188700    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06751222-5566-4053-8cfb-faffda2016fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.188743 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188735    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06751222-5566-4053-8cfb-faffda2016fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.188939 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188756    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-var-lib-openvswitch\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.188939 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188770    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db3635c9-5545-49e5-9004-500eff2f48da-ovn-node-metrics-cert\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.188939 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188784    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dcd4d915-d684-4aee-9a48-0e00aad98d39-iptables-alerter-script\") pod \"iptables-alerter-4vwc6\" (UID: \"dcd4d915-d684-4aee-9a48-0e00aad98d39\") " pod="openshift-network-operator/iptables-alerter-4vwc6"
Jul 15 15:35:25.188939 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188798    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06751222-5566-4053-8cfb-faffda2016fc-cnibin\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.188939 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188812    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06751222-5566-4053-8cfb-faffda2016fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.188939 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188825    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-sys\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.188939 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188838    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c2120c-175e-49b8-9a9d-25fbfcdd6481-tmp-dir\") pod \"node-resolver-mwrjx\" (UID: \"43c2120c-175e-49b8-9a9d-25fbfcdd6481\") " pod="openshift-dns/node-resolver-mwrjx"
Jul 15 15:35:25.188939 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188851    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-device-dir\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.188939 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188866    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6p6m\" (UniqueName: \"kubernetes.io/projected/bef954d7-6fce-4c27-9f26-1a72529aa895-kube-api-access-m6p6m\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.188939 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188880    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-socket-dir\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.188939 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188899    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-node-log\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.188939 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188919    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7v2v\" (UniqueName: \"kubernetes.io/projected/06751222-5566-4053-8cfb-faffda2016fc-kube-api-access-t7v2v\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.188939 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188932    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-sysconfig\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.189356 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188964    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-tmp\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.189356 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.188987    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0f387fbf-3210-4c20-8ee2-803e27f4f75b-agent-certs\") pod \"konnectivity-agent-m9ggg\" (UID: \"0f387fbf-3210-4c20-8ee2-803e27f4f75b\") " pod="kube-system/konnectivity-agent-m9ggg"
Jul 15 15:35:25.189356 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189004    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-run-multus-certs\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.189356 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189017    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-slash\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.189356 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189042    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db3635c9-5545-49e5-9004-500eff2f48da-env-overrides\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.189356 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189065    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx68s\" (UniqueName: \"kubernetes.io/projected/43c2120c-175e-49b8-9a9d-25fbfcdd6481-kube-api-access-cx68s\") pod \"node-resolver-mwrjx\" (UID: \"43c2120c-175e-49b8-9a9d-25fbfcdd6481\") " pod="openshift-dns/node-resolver-mwrjx"
Jul 15 15:35:25.189356 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189101    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06751222-5566-4053-8cfb-faffda2016fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.189356 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189117    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-registration-dir\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.189356 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189141    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b0b6ce0e-c412-48dd-a538-19e92a2910ed-dbus\") pod \"global-pull-secret-syncer-tts5k\" (UID: \"b0b6ce0e-c412-48dd-a538-19e92a2910ed\") " pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:25.189356 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189160    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-sysctl-conf\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.189356 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189174    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0f387fbf-3210-4c20-8ee2-803e27f4f75b-konnectivity-ca\") pod \"konnectivity-agent-m9ggg\" (UID: \"0f387fbf-3210-4c20-8ee2-803e27f4f75b\") " pod="kube-system/konnectivity-agent-m9ggg"
Jul 15 15:35:25.189356 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189187    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-etc-selinux\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.189356 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189210    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-system-cni-dir\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.189356 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189237    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bef954d7-6fce-4c27-9f26-1a72529aa895-cni-binary-copy\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.189936 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189259    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-var-lib-cni-multus\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.189936 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189276    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-log-socket\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.189936 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189311    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db3635c9-5545-49e5-9004-500eff2f48da-ovnkube-config\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.189936 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189333    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-var-lib-kubelet\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.189936 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189348    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-run-k8s-cni-cncf-io\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.189936 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189368    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-cni-netd\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.189936 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189394    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bmg8\" (UniqueName: \"kubernetes.io/projected/db3635c9-5545-49e5-9004-500eff2f48da-kube-api-access-7bmg8\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.189936 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189409    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcd4d915-d684-4aee-9a48-0e00aad98d39-host-slash\") pod \"iptables-alerter-4vwc6\" (UID: \"dcd4d915-d684-4aee-9a48-0e00aad98d39\") " pod="openshift-network-operator/iptables-alerter-4vwc6"
Jul 15 15:35:25.189936 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189435    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-etc-kubernetes\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.189936 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189456    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh8x2\" (UniqueName: \"kubernetes.io/projected/1c2e9a13-471e-478c-b38e-6748dc7ede63-kube-api-access-dh8x2\") pod \"network-metrics-daemon-5jk56\" (UID: \"1c2e9a13-471e-478c-b38e-6748dc7ede63\") " pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:25.189936 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189483    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06751222-5566-4053-8cfb-faffda2016fc-os-release\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.189936 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189520    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/43c2120c-175e-49b8-9a9d-25fbfcdd6481-hosts-file\") pod \"node-resolver-mwrjx\" (UID: \"43c2120c-175e-49b8-9a9d-25fbfcdd6481\") " pod="openshift-dns/node-resolver-mwrjx"
Jul 15 15:35:25.189936 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189543    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-multus-cni-dir\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.189936 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189567    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-multus-conf-dir\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.190398 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189596    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-run-openvswitch\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.190398 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189632    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret\") pod \"global-pull-secret-syncer-tts5k\" (UID: \"b0b6ce0e-c412-48dd-a538-19e92a2910ed\") " pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:25.190398 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189666    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-lib-modules\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.190398 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189695    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-tuned\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.190398 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189710    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jcg9\" (UniqueName: \"kubernetes.io/projected/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-kube-api-access-2jcg9\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.190398 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189735    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-hostroot\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.190398 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189757    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-run-systemd\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.190398 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189774    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b0b6ce0e-c412-48dd-a538-19e92a2910ed-kubelet-config\") pod \"global-pull-secret-syncer-tts5k\" (UID: \"b0b6ce0e-c412-48dd-a538-19e92a2910ed\") " pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:25.190398 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189789    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-modprobe-d\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.190398 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189803    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f980a640-3a85-4ec8-a905-20a33aca6a40-serviceca\") pod \"node-ca-h7fgx\" (UID: \"f980a640-3a85-4ec8-a905-20a33aca6a40\") " pod="openshift-image-registry/node-ca-h7fgx"
Jul 15 15:35:25.190398 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189816    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5blk\" (UniqueName: \"kubernetes.io/projected/a073395d-6ca8-44f6-adea-8d02e13973ae-kube-api-access-d5blk\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.190398 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189831    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-run-netns\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.190398 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189844    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-var-lib-kubelet\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.190398 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189883    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-etc-openvswitch\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.190822 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189908    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-kubernetes\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.190822 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189924    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bef954d7-6fce-4c27-9f26-1a72529aa895-multus-daemon-config\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.190822 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189939    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.190822 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.189991    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-kubelet\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.190822 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.190009    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-run-ovn\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.190822 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.190039    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-sysctl-d\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.190822 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.190058    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-systemd\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.190822 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.190072    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-host\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.190822 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.190086    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-multus-socket-dir-parent\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.190822 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.190114    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.290748 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.290641    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db3635c9-5545-49e5-9004-500eff2f48da-ovnkube-script-lib\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.290748 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.290696    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pf6l\" (UniqueName: \"kubernetes.io/projected/f980a640-3a85-4ec8-a905-20a33aca6a40-kube-api-access-6pf6l\") pod \"node-ca-h7fgx\" (UID: \"f980a640-3a85-4ec8-a905-20a33aca6a40\") " pod="openshift-image-registry/node-ca-h7fgx"
Jul 15 15:35:25.291131 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06751222-5566-4053-8cfb-faffda2016fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.291212 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291154    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06751222-5566-4053-8cfb-faffda2016fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.291212 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291186    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-var-lib-openvswitch\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.291212 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291209    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db3635c9-5545-49e5-9004-500eff2f48da-ovn-node-metrics-cert\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.291354 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291237    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dcd4d915-d684-4aee-9a48-0e00aad98d39-iptables-alerter-script\") pod \"iptables-alerter-4vwc6\" (UID: \"dcd4d915-d684-4aee-9a48-0e00aad98d39\") " pod="openshift-network-operator/iptables-alerter-4vwc6"
Jul 15 15:35:25.291354 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291266    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06751222-5566-4053-8cfb-faffda2016fc-cnibin\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.291354 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291296    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06751222-5566-4053-8cfb-faffda2016fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.291354 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291322    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-sys\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.291354 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c2120c-175e-49b8-9a9d-25fbfcdd6481-tmp-dir\") pod \"node-resolver-mwrjx\" (UID: \"43c2120c-175e-49b8-9a9d-25fbfcdd6481\") " pod="openshift-dns/node-resolver-mwrjx"
Jul 15 15:35:25.291564 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291376    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-device-dir\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.291564 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291409    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6p6m\" (UniqueName: \"kubernetes.io/projected/bef954d7-6fce-4c27-9f26-1a72529aa895-kube-api-access-m6p6m\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.291564 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291440    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-socket-dir\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.291564 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291467    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-node-log\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.291564 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291492    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7v2v\" (UniqueName: \"kubernetes.io/projected/06751222-5566-4053-8cfb-faffda2016fc-kube-api-access-t7v2v\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.291564 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291520    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-sysconfig\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.291564 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291550    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-tmp\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.291850 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291576    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0f387fbf-3210-4c20-8ee2-803e27f4f75b-agent-certs\") pod \"konnectivity-agent-m9ggg\" (UID: \"0f387fbf-3210-4c20-8ee2-803e27f4f75b\") " pod="kube-system/konnectivity-agent-m9ggg"
Jul 15 15:35:25.291850 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291604    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-run-multus-certs\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.291850 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291627    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-slash\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.291850 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291656    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db3635c9-5545-49e5-9004-500eff2f48da-env-overrides\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.291850 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291655    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db3635c9-5545-49e5-9004-500eff2f48da-ovnkube-script-lib\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.291850 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291754    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx68s\" (UniqueName: \"kubernetes.io/projected/43c2120c-175e-49b8-9a9d-25fbfcdd6481-kube-api-access-cx68s\") pod \"node-resolver-mwrjx\" (UID: \"43c2120c-175e-49b8-9a9d-25fbfcdd6481\") " pod="openshift-dns/node-resolver-mwrjx"
Jul 15 15:35:25.291850 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291794    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06751222-5566-4053-8cfb-faffda2016fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.291850 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291824    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-registration-dir\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.291850 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b0b6ce0e-c412-48dd-a538-19e92a2910ed-dbus\") pod \"global-pull-secret-syncer-tts5k\" (UID: \"b0b6ce0e-c412-48dd-a538-19e92a2910ed\") " pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:25.292337 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291877    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-sysctl-conf\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.292337 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291904    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0f387fbf-3210-4c20-8ee2-803e27f4f75b-konnectivity-ca\") pod \"konnectivity-agent-m9ggg\" (UID: \"0f387fbf-3210-4c20-8ee2-803e27f4f75b\") " pod="kube-system/konnectivity-agent-m9ggg"
Jul 15 15:35:25.292337 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291932    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-etc-selinux\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.292337 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.291978    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-system-cni-dir\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.292337 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292003    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bef954d7-6fce-4c27-9f26-1a72529aa895-cni-binary-copy\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.292337 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292032    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-var-lib-cni-multus\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.292337 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292060    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-log-socket\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.292337 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292088    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db3635c9-5545-49e5-9004-500eff2f48da-ovnkube-config\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.292337 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-var-lib-kubelet\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.292337 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292152    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-run-k8s-cni-cncf-io\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.292337 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292175    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-cni-netd\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.292337 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292204    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bmg8\" (UniqueName: \"kubernetes.io/projected/db3635c9-5545-49e5-9004-500eff2f48da-kube-api-access-7bmg8\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.292337 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292231    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcd4d915-d684-4aee-9a48-0e00aad98d39-host-slash\") pod \"iptables-alerter-4vwc6\" (UID: \"dcd4d915-d684-4aee-9a48-0e00aad98d39\") " pod="openshift-network-operator/iptables-alerter-4vwc6"
Jul 15 15:35:25.292337 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292262    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-etc-kubernetes\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.292913 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292290    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh8x2\" (UniqueName: \"kubernetes.io/projected/1c2e9a13-471e-478c-b38e-6748dc7ede63-kube-api-access-dh8x2\") pod \"network-metrics-daemon-5jk56\" (UID: \"1c2e9a13-471e-478c-b38e-6748dc7ede63\") " pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:25.292913 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06751222-5566-4053-8cfb-faffda2016fc-os-release\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.292913 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/43c2120c-175e-49b8-9a9d-25fbfcdd6481-hosts-file\") pod \"node-resolver-mwrjx\" (UID: \"43c2120c-175e-49b8-9a9d-25fbfcdd6481\") " pod="openshift-dns/node-resolver-mwrjx"
Jul 15 15:35:25.292913 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292372    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-multus-cni-dir\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.292913 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-multus-conf-dir\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.292913 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292431    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-run-openvswitch\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.292913 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292457    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret\") pod \"global-pull-secret-syncer-tts5k\" (UID: \"b0b6ce0e-c412-48dd-a538-19e92a2910ed\") " pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:25.292913 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-lib-modules\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.292913 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292512    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-tuned\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.292913 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292527    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06751222-5566-4053-8cfb-faffda2016fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.292913 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jcg9\" (UniqueName: \"kubernetes.io/projected/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-kube-api-access-2jcg9\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.292913 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292569    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-hostroot\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.292913 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292598    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-run-systemd\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.292913 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292627    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b0b6ce0e-c412-48dd-a538-19e92a2910ed-kubelet-config\") pod \"global-pull-secret-syncer-tts5k\" (UID: \"b0b6ce0e-c412-48dd-a538-19e92a2910ed\") " pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:25.293567 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292659    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-modprobe-d\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.293567 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292687    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f980a640-3a85-4ec8-a905-20a33aca6a40-serviceca\") pod \"node-ca-h7fgx\" (UID: \"f980a640-3a85-4ec8-a905-20a33aca6a40\") " pod="openshift-image-registry/node-ca-h7fgx"
Jul 15 15:35:25.293567 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292711    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5blk\" (UniqueName: \"kubernetes.io/projected/a073395d-6ca8-44f6-adea-8d02e13973ae-kube-api-access-d5blk\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.293567 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292743    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-run-netns\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.293567 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292772    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-var-lib-kubelet\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.293567 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292801    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-etc-openvswitch\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.293567 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292829    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-kubernetes\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.293567 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292854    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bef954d7-6fce-4c27-9f26-1a72529aa895-multus-daemon-config\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.293567 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292884    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.293567 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292915    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-kubelet\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.293567 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292963    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-run-ovn\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.293567 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292977    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06751222-5566-4053-8cfb-faffda2016fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.293567 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292990    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-sysctl-d\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.293567 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293047    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-systemd\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.294220 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293096    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-host\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.294220 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-multus-socket-dir-parent\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.294220 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293156    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.294220 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293163    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-sysctl-d\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.294220 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293220    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.294220 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293263    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-var-lib-openvswitch\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.294220 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293413    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-node-log\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.294220 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293439    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-log-socket\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.294220 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293442    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-sys\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.294220 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293514    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06751222-5566-4053-8cfb-faffda2016fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.294220 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293584    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-sysconfig\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.294220 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293588    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-registration-dir\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.294220 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293661    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-multus-cni-dir\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.294220 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293520    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 15:35:25.294220 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293796    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-etc-selinux\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.295036 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293710    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-sysctl-conf\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.295036 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293856    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db3635c9-5545-49e5-9004-500eff2f48da-ovnkube-config\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.295036 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.292079    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db3635c9-5545-49e5-9004-500eff2f48da-env-overrides\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.295036 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.293957    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b0b6ce0e-c412-48dd-a538-19e92a2910ed-dbus\") pod \"global-pull-secret-syncer-tts5k\" (UID: \"b0b6ce0e-c412-48dd-a538-19e92a2910ed\") " pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:25.295036 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294129    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dcd4d915-d684-4aee-9a48-0e00aad98d39-iptables-alerter-script\") pod \"iptables-alerter-4vwc6\" (UID: \"dcd4d915-d684-4aee-9a48-0e00aad98d39\") " pod="openshift-network-operator/iptables-alerter-4vwc6"
Jul 15 15:35:25.295036 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294224    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c2120c-175e-49b8-9a9d-25fbfcdd6481-tmp-dir\") pod \"node-resolver-mwrjx\" (UID: \"43c2120c-175e-49b8-9a9d-25fbfcdd6481\") " pod="openshift-dns/node-resolver-mwrjx"
Jul 15 15:35:25.295036 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294317    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-device-dir\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.295036 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294336    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bef954d7-6fce-4c27-9f26-1a72529aa895-cni-binary-copy\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.295036 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.294427    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:25.295036 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294471    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-run-k8s-cni-cncf-io\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.295036 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294521    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-slash\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.295036 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.294562    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret podName:b0b6ce0e-c412-48dd-a538-19e92a2910ed nodeName:}" failed. No retries permitted until 2026-07-15 15:35:25.794502425 +0000 UTC m=+3.203275651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret") pod "global-pull-secret-syncer-tts5k" (UID: "b0b6ce0e-c412-48dd-a538-19e92a2910ed") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:25.295036 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294591    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-lib-modules\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.295036 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294624    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-run-netns\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.295036 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294675    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-var-lib-kubelet\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.296287 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294737    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-etc-openvswitch\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.296287 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294810    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-kubernetes\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.296287 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294393    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-var-lib-cni-multus\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.296287 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294919    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-var-lib-kubelet\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.296287 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294932    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-hostroot\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.296287 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294967    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.296287 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294994    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-run-systemd\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.296287 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295008    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-systemd-units\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.296287 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295039    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-etc-kubernetes\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.296287 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295045    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f980a640-3a85-4ec8-a905-20a33aca6a40-host\") pod \"node-ca-h7fgx\" (UID: \"f980a640-3a85-4ec8-a905-20a33aca6a40\") " pod="openshift-image-registry/node-ca-h7fgx"
Jul 15 15:35:25.296287 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295102    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06751222-5566-4053-8cfb-faffda2016fc-os-release\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.296287 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295135    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-multus-socket-dir-parent\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.296287 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295179    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs\") pod \"network-metrics-daemon-5jk56\" (UID: \"1c2e9a13-471e-478c-b38e-6748dc7ede63\") " pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:25.296287 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295210    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-run\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.296287 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295243    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9d9x\" (UniqueName: \"kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x\") pod \"network-check-target-m5gdn\" (UID: \"be1ab9a0-8cba-4834-a20c-a36d2117c38c\") " pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:25.296968 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295277    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-os-release\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.296968 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295301    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-var-lib-cni-bin\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.296968 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-run-netns\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.296968 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295360    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-run-ovn-kubernetes\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.296968 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295374    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b0b6ce0e-c412-48dd-a538-19e92a2910ed-kubelet-config\") pod \"global-pull-secret-syncer-tts5k\" (UID: \"b0b6ce0e-c412-48dd-a538-19e92a2910ed\") " pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:25.296968 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295390    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06751222-5566-4053-8cfb-faffda2016fc-system-cni-dir\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.296968 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295435    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bef954d7-6fce-4c27-9f26-1a72529aa895-multus-daemon-config\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.296968 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295438    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06751222-5566-4053-8cfb-faffda2016fc-system-cni-dir\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.296968 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295462    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k8q6\" (UniqueName: \"kubernetes.io/projected/dcd4d915-d684-4aee-9a48-0e00aad98d39-kube-api-access-4k8q6\") pod \"iptables-alerter-4vwc6\" (UID: \"dcd4d915-d684-4aee-9a48-0e00aad98d39\") " pod="openshift-network-operator/iptables-alerter-4vwc6"
Jul 15 15:35:25.296968 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.294434    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-socket-dir\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.296968 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295483    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-modprobe-d\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.296968 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295506    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-cnibin\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.296968 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-sys-fs\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.296968 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295537    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-cni-netd\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.297595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295562    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-cni-bin\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.297595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295660    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-cni-bin\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.297595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295721    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/43c2120c-175e-49b8-9a9d-25fbfcdd6481-hosts-file\") pod \"node-resolver-mwrjx\" (UID: \"43c2120c-175e-49b8-9a9d-25fbfcdd6481\") " pod="openshift-dns/node-resolver-mwrjx"
Jul 15 15:35:25.297595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295834    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f980a640-3a85-4ec8-a905-20a33aca6a40-serviceca\") pod \"node-ca-h7fgx\" (UID: \"f980a640-3a85-4ec8-a905-20a33aca6a40\") " pod="openshift-image-registry/node-ca-h7fgx"
Jul 15 15:35:25.297595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295907    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-run-openvswitch\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.297595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295932    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-run\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.297595 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.296001    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:25.297595 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.296062    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs podName:1c2e9a13-471e-478c-b38e-6748dc7ede63 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:25.796047524 +0000 UTC m=+3.204820702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs") pod "network-metrics-daemon-5jk56" (UID: "1c2e9a13-471e-478c-b38e-6748dc7ede63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:25.297595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.296123    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f980a640-3a85-4ec8-a905-20a33aca6a40-host\") pod \"node-ca-h7fgx\" (UID: \"f980a640-3a85-4ec8-a905-20a33aca6a40\") " pod="openshift-image-registry/node-ca-h7fgx"
Jul 15 15:35:25.297595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.296179    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-systemd-units\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.297595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.296303    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-os-release\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.297595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.296355    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-run-multus-certs\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.297595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.296365    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-host-var-lib-cni-bin\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.297595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.295102    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-kubelet\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.297595 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.296391    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-run-ovn\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.298096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.296429    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-host\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.298096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.296452    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-cnibin\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.298096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.296462    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a073395d-6ca8-44f6-adea-8d02e13973ae-sys-fs\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.298096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.296480    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-run-ovn-kubernetes\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.298096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.296503    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-multus-conf-dir\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.298096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.296533    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bef954d7-6fce-4c27-9f26-1a72529aa895-system-cni-dir\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.298096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.296506    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-systemd\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.298096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.296550    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcd4d915-d684-4aee-9a48-0e00aad98d39-host-slash\") pod \"iptables-alerter-4vwc6\" (UID: \"dcd4d915-d684-4aee-9a48-0e00aad98d39\") " pod="openshift-network-operator/iptables-alerter-4vwc6"
Jul 15 15:35:25.298096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.296574    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db3635c9-5545-49e5-9004-500eff2f48da-host-run-netns\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.298096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.296684    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06751222-5566-4053-8cfb-faffda2016fc-cnibin\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.298096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.297360    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06751222-5566-4053-8cfb-faffda2016fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.298096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.297471    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0f387fbf-3210-4c20-8ee2-803e27f4f75b-konnectivity-ca\") pod \"konnectivity-agent-m9ggg\" (UID: \"0f387fbf-3210-4c20-8ee2-803e27f4f75b\") " pod="kube-system/konnectivity-agent-m9ggg"
Jul 15 15:35:25.298096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.297580    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-tmp\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.298096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.297638    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-etc-tuned\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.298096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.297750    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db3635c9-5545-49e5-9004-500eff2f48da-ovn-node-metrics-cert\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.298612 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.297773    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0f387fbf-3210-4c20-8ee2-803e27f4f75b-agent-certs\") pod \"konnectivity-agent-m9ggg\" (UID: \"0f387fbf-3210-4c20-8ee2-803e27f4f75b\") " pod="kube-system/konnectivity-agent-m9ggg"
Jul 15 15:35:25.309172 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.309149    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pf6l\" (UniqueName: \"kubernetes.io/projected/f980a640-3a85-4ec8-a905-20a33aca6a40-kube-api-access-6pf6l\") pod \"node-ca-h7fgx\" (UID: \"f980a640-3a85-4ec8-a905-20a33aca6a40\") " pod="openshift-image-registry/node-ca-h7fgx"
Jul 15 15:35:25.309396 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.309380    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7v2v\" (UniqueName: \"kubernetes.io/projected/06751222-5566-4053-8cfb-faffda2016fc-kube-api-access-t7v2v\") pod \"multus-additional-cni-plugins-x95gs\" (UID: \"06751222-5566-4053-8cfb-faffda2016fc\") " pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.312887 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.312844    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx68s\" (UniqueName: \"kubernetes.io/projected/43c2120c-175e-49b8-9a9d-25fbfcdd6481-kube-api-access-cx68s\") pod \"node-resolver-mwrjx\" (UID: \"43c2120c-175e-49b8-9a9d-25fbfcdd6481\") " pod="openshift-dns/node-resolver-mwrjx"
Jul 15 15:35:25.313108 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.312971    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5blk\" (UniqueName: \"kubernetes.io/projected/a073395d-6ca8-44f6-adea-8d02e13973ae-kube-api-access-d5blk\") pod \"aws-ebs-csi-driver-node-bdxrp\" (UID: \"a073395d-6ca8-44f6-adea-8d02e13973ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.313337 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.313306    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k8q6\" (UniqueName: \"kubernetes.io/projected/dcd4d915-d684-4aee-9a48-0e00aad98d39-kube-api-access-4k8q6\") pod \"iptables-alerter-4vwc6\" (UID: \"dcd4d915-d684-4aee-9a48-0e00aad98d39\") " pod="openshift-network-operator/iptables-alerter-4vwc6"
Jul 15 15:35:25.313645 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.313627    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh8x2\" (UniqueName: \"kubernetes.io/projected/1c2e9a13-471e-478c-b38e-6748dc7ede63-kube-api-access-dh8x2\") pod \"network-metrics-daemon-5jk56\" (UID: \"1c2e9a13-471e-478c-b38e-6748dc7ede63\") " pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:25.313721 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.313653    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bmg8\" (UniqueName: \"kubernetes.io/projected/db3635c9-5545-49e5-9004-500eff2f48da-kube-api-access-7bmg8\") pod \"ovnkube-node-hqdzr\" (UID: \"db3635c9-5545-49e5-9004-500eff2f48da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.314239 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.314223    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jcg9\" (UniqueName: \"kubernetes.io/projected/0ba4dc08-5506-4b1d-a8cf-c97b4ca925da-kube-api-access-2jcg9\") pod \"tuned-m5qk2\" (UID: \"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da\") " pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.314881 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.314867    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6p6m\" (UniqueName: \"kubernetes.io/projected/bef954d7-6fce-4c27-9f26-1a72529aa895-kube-api-access-m6p6m\") pod \"multus-l4xb7\" (UID: \"bef954d7-6fce-4c27-9f26-1a72529aa895\") " pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.315652 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.315634    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:35:25.315734 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.315655    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:35:25.315734 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.315668    2583 projected.go:196] Error preparing data for projected volume kube-api-access-l9d9x for pod openshift-network-diagnostics/network-check-target-m5gdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:25.315830 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.315743    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x podName:be1ab9a0-8cba-4834-a20c-a36d2117c38c nodeName:}" failed. No retries permitted until 2026-07-15 15:35:25.815724678 +0000 UTC m=+3.224497851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l9d9x" (UniqueName: "kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x") pod "network-check-target-m5gdn" (UID: "be1ab9a0-8cba-4834-a20c-a36d2117c38c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:25.407787 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.407762    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l4xb7"
Jul 15 15:35:25.415571 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.415549    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp"
Jul 15 15:35:25.417867 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:25.417846    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef954d7_6fce_4c27_9f26_1a72529aa895.slice/crio-ab9fa4b73215addbf2c63221a9887eff33e22da8b6d8b81f562892ed039fae6e WatchSource:0}: Error finding container ab9fa4b73215addbf2c63221a9887eff33e22da8b6d8b81f562892ed039fae6e: Status 404 returned error can't find the container with id ab9fa4b73215addbf2c63221a9887eff33e22da8b6d8b81f562892ed039fae6e
Jul 15 15:35:25.422020 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.421998    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4vwc6"
Jul 15 15:35:25.422666 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:25.422644    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda073395d_6ca8_44f6_adea_8d02e13973ae.slice/crio-7221c6034700861a18de13f541b24cf6becaabfdbfe53359e95b4df0a7fceb0c WatchSource:0}: Error finding container 7221c6034700861a18de13f541b24cf6becaabfdbfe53359e95b4df0a7fceb0c: Status 404 returned error can't find the container with id 7221c6034700861a18de13f541b24cf6becaabfdbfe53359e95b4df0a7fceb0c
Jul 15 15:35:25.426836 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.426818    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:25.430001 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:25.429976    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd4d915_d684_4aee_9a48_0e00aad98d39.slice/crio-5a4ede697ee66039a037ef399351f7751d0fd534c1bcc6dc55ddc5683409d9e9 WatchSource:0}: Error finding container 5a4ede697ee66039a037ef399351f7751d0fd534c1bcc6dc55ddc5683409d9e9: Status 404 returned error can't find the container with id 5a4ede697ee66039a037ef399351f7751d0fd534c1bcc6dc55ddc5683409d9e9
Jul 15 15:35:25.430966 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.430927    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x95gs"
Jul 15 15:35:25.434458 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:25.434437    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3635c9_5545_49e5_9004_500eff2f48da.slice/crio-88ac542d1176b6206c709b71a2657601561aa1affc95fcedbabd3444697ffafe WatchSource:0}: Error finding container 88ac542d1176b6206c709b71a2657601561aa1affc95fcedbabd3444697ffafe: Status 404 returned error can't find the container with id 88ac542d1176b6206c709b71a2657601561aa1affc95fcedbabd3444697ffafe
Jul 15 15:35:25.437177 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.437114    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m5qk2"
Jul 15 15:35:25.438724 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:25.438702    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06751222_5566_4053_8cfb_faffda2016fc.slice/crio-c7c3bb7ba93187eddf1627a5d8e7967716e691f4db1db0bcd1b0e3eecfdfb8ce WatchSource:0}: Error finding container c7c3bb7ba93187eddf1627a5d8e7967716e691f4db1db0bcd1b0e3eecfdfb8ce: Status 404 returned error can't find the container with id c7c3bb7ba93187eddf1627a5d8e7967716e691f4db1db0bcd1b0e3eecfdfb8ce
Jul 15 15:35:25.442816 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.442802    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h7fgx"
Jul 15 15:35:25.445122 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:25.444953    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba4dc08_5506_4b1d_a8cf_c97b4ca925da.slice/crio-651b9cbe0849e97e4677f760e1db825569600e3758c215091414107418a32b8d WatchSource:0}: Error finding container 651b9cbe0849e97e4677f760e1db825569600e3758c215091414107418a32b8d: Status 404 returned error can't find the container with id 651b9cbe0849e97e4677f760e1db825569600e3758c215091414107418a32b8d
Jul 15 15:35:25.447902 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.447881    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mwrjx"
Jul 15 15:35:25.451590 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.451574    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m9ggg"
Jul 15 15:35:25.455269 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:25.455241    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c2120c_175e_49b8_9a9d_25fbfcdd6481.slice/crio-0488fb96baa2a17e0549b1d7387a4b50bba5a0460ebb68341fdd2b98297c10f2 WatchSource:0}: Error finding container 0488fb96baa2a17e0549b1d7387a4b50bba5a0460ebb68341fdd2b98297c10f2: Status 404 returned error can't find the container with id 0488fb96baa2a17e0549b1d7387a4b50bba5a0460ebb68341fdd2b98297c10f2
Jul 15 15:35:25.460389 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:25.460370    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f387fbf_3210_4c20_8ee2_803e27f4f75b.slice/crio-8082967843daa64231c90cd2daaa6e8a02e4458a68f7c8f428650879afa5e8fa WatchSource:0}: Error finding container 8082967843daa64231c90cd2daaa6e8a02e4458a68f7c8f428650879afa5e8fa: Status 404 returned error can't find the container with id 8082967843daa64231c90cd2daaa6e8a02e4458a68f7c8f428650879afa5e8fa
Jul 15 15:35:25.502840 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:35:25.502812    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod102fbd48ff7ff0cfcd397c73fd966f70.slice/crio-13320d4bf422a1ae200c3bb72c12aa5546616a041b6afdd2603e17c59fbea536 WatchSource:0}: Error finding container 13320d4bf422a1ae200c3bb72c12aa5546616a041b6afdd2603e17c59fbea536: Status 404 returned error can't find the container with id 13320d4bf422a1ae200c3bb72c12aa5546616a041b6afdd2603e17c59fbea536
Jul 15 15:35:25.583491 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.583388    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mwrjx" event={"ID":"43c2120c-175e-49b8-9a9d-25fbfcdd6481","Type":"ContainerStarted","Data":"0488fb96baa2a17e0549b1d7387a4b50bba5a0460ebb68341fdd2b98297c10f2"}
Jul 15 15:35:25.584504 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.584479    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h7fgx" event={"ID":"f980a640-3a85-4ec8-a905-20a33aca6a40","Type":"ContainerStarted","Data":"a8bf93163dd85bffdad2eb2156f968a95ec9ba33cfc0e2b14bb99833663eb7a1"}
Jul 15 15:35:25.585733 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.585712    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m5qk2" event={"ID":"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da","Type":"ContainerStarted","Data":"651b9cbe0849e97e4677f760e1db825569600e3758c215091414107418a32b8d"}
Jul 15 15:35:25.586915 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.586896    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x95gs" event={"ID":"06751222-5566-4053-8cfb-faffda2016fc","Type":"ContainerStarted","Data":"c7c3bb7ba93187eddf1627a5d8e7967716e691f4db1db0bcd1b0e3eecfdfb8ce"}
Jul 15 15:35:25.588079 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.588047    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr" event={"ID":"db3635c9-5545-49e5-9004-500eff2f48da","Type":"ContainerStarted","Data":"88ac542d1176b6206c709b71a2657601561aa1affc95fcedbabd3444697ffafe"}
Jul 15 15:35:25.589231 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.589210    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4vwc6" event={"ID":"dcd4d915-d684-4aee-9a48-0e00aad98d39","Type":"ContainerStarted","Data":"5a4ede697ee66039a037ef399351f7751d0fd534c1bcc6dc55ddc5683409d9e9"}
Jul 15 15:35:25.590365 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.590338    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp" event={"ID":"a073395d-6ca8-44f6-adea-8d02e13973ae","Type":"ContainerStarted","Data":"7221c6034700861a18de13f541b24cf6becaabfdbfe53359e95b4df0a7fceb0c"}
Jul 15 15:35:25.591446 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.591423    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l4xb7" event={"ID":"bef954d7-6fce-4c27-9f26-1a72529aa895","Type":"ContainerStarted","Data":"ab9fa4b73215addbf2c63221a9887eff33e22da8b6d8b81f562892ed039fae6e"}
Jul 15 15:35:25.592366 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.592340    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal" event={"ID":"102fbd48ff7ff0cfcd397c73fd966f70","Type":"ContainerStarted","Data":"13320d4bf422a1ae200c3bb72c12aa5546616a041b6afdd2603e17c59fbea536"}
Jul 15 15:35:25.593498 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.593474    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m9ggg" event={"ID":"0f387fbf-3210-4c20-8ee2-803e27f4f75b","Type":"ContainerStarted","Data":"8082967843daa64231c90cd2daaa6e8a02e4458a68f7c8f428650879afa5e8fa"}
Jul 15 15:35:25.594621 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.594602    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal" event={"ID":"2e193e431239fbdd2a5f918e7173fd13","Type":"ContainerStarted","Data":"4b75b532357d455667f7ed5156352541dd20055d6f57d73488a0d5773fcef5d8"}
Jul 15 15:35:25.799643 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.799608    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs\") pod \"network-metrics-daemon-5jk56\" (UID: \"1c2e9a13-471e-478c-b38e-6748dc7ede63\") " pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:25.799820 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.799686    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret\") pod \"global-pull-secret-syncer-tts5k\" (UID: \"b0b6ce0e-c412-48dd-a538-19e92a2910ed\") " pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:25.799820 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.799781    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:25.799927 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.799857    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs podName:1c2e9a13-471e-478c-b38e-6748dc7ede63 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:26.799837004 +0000 UTC m=+4.208610195 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs") pod "network-metrics-daemon-5jk56" (UID: "1c2e9a13-471e-478c-b38e-6748dc7ede63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:25.799927 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.799789    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:25.799927 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.799901    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret podName:b0b6ce0e-c412-48dd-a538-19e92a2910ed nodeName:}" failed. No retries permitted until 2026-07-15 15:35:26.799891527 +0000 UTC m=+4.208664696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret") pod "global-pull-secret-syncer-tts5k" (UID: "b0b6ce0e-c412-48dd-a538-19e92a2910ed") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:25.900456 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:25.900376    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9d9x\" (UniqueName: \"kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x\") pod \"network-check-target-m5gdn\" (UID: \"be1ab9a0-8cba-4834-a20c-a36d2117c38c\") " pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:25.900660 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.900529    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:35:25.900660 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.900546    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:35:25.900660 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.900560    2583 projected.go:196] Error preparing data for projected volume kube-api-access-l9d9x for pod openshift-network-diagnostics/network-check-target-m5gdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:25.900660 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:25.900620    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x podName:be1ab9a0-8cba-4834-a20c-a36d2117c38c nodeName:}" failed. No retries permitted until 2026-07-15 15:35:26.900603352 +0000 UTC m=+4.309376535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9d9x" (UniqueName: "kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x") pod "network-check-target-m5gdn" (UID: "be1ab9a0-8cba-4834-a20c-a36d2117c38c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:26.150741 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:26.150576    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 15:30:25 +0000 UTC" deadline="2028-04-29 01:04:49.212907644 +0000 UTC"
Jul 15 15:35:26.150741 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:26.150616    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15681h29m23.062295914s"
Jul 15 15:35:26.579915 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:26.579838    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:26.580603 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:26.579982    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:26.580603 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:26.580364    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:26.580603 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:26.580439    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:26.580603 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:26.580499    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:26.580603 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:26.580570    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:26.809559 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:26.809316    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs\") pod \"network-metrics-daemon-5jk56\" (UID: \"1c2e9a13-471e-478c-b38e-6748dc7ede63\") " pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:26.809714 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:26.809482    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:26.809714 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:26.809629    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret\") pod \"global-pull-secret-syncer-tts5k\" (UID: \"b0b6ce0e-c412-48dd-a538-19e92a2910ed\") " pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:26.809714 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:26.809699    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs podName:1c2e9a13-471e-478c-b38e-6748dc7ede63 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:28.809676837 +0000 UTC m=+6.218450008 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs") pod "network-metrics-daemon-5jk56" (UID: "1c2e9a13-471e-478c-b38e-6748dc7ede63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:26.809879 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:26.809740    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:26.809879 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:26.809791    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret podName:b0b6ce0e-c412-48dd-a538-19e92a2910ed nodeName:}" failed. No retries permitted until 2026-07-15 15:35:28.809775986 +0000 UTC m=+6.218549157 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret") pod "global-pull-secret-syncer-tts5k" (UID: "b0b6ce0e-c412-48dd-a538-19e92a2910ed") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:26.910350 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:26.910313    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9d9x\" (UniqueName: \"kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x\") pod \"network-check-target-m5gdn\" (UID: \"be1ab9a0-8cba-4834-a20c-a36d2117c38c\") " pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:26.910535 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:26.910484    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:35:26.910535 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:26.910503    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:35:26.910535 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:26.910515    2583 projected.go:196] Error preparing data for projected volume kube-api-access-l9d9x for pod openshift-network-diagnostics/network-check-target-m5gdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:26.910695 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:26.910580    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x podName:be1ab9a0-8cba-4834-a20c-a36d2117c38c nodeName:}" failed. No retries permitted until 2026-07-15 15:35:28.910562226 +0000 UTC m=+6.319335413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9d9x" (UniqueName: "kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x") pod "network-check-target-m5gdn" (UID: "be1ab9a0-8cba-4834-a20c-a36d2117c38c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:27.151126 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:27.150962    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 15:30:25 +0000 UTC" deadline="2028-02-11 23:54:15.35883355 +0000 UTC"
Jul 15 15:35:27.151126 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:27.151020    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13832h18m48.207818574s"
Jul 15 15:35:27.605213 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:27.605090    2583 generic.go:356] "Generic (PLEG): container finished" podID="2e193e431239fbdd2a5f918e7173fd13" containerID="89cf960dff1923371d036cadaa8e8ff3e7c553f6fa54dd6d81b7e3f39a8e9d4b" exitCode=0
Jul 15 15:35:27.605213 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:27.605148    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal" event={"ID":"2e193e431239fbdd2a5f918e7173fd13","Type":"ContainerDied","Data":"89cf960dff1923371d036cadaa8e8ff3e7c553f6fa54dd6d81b7e3f39a8e9d4b"}
Jul 15 15:35:28.579708 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:28.579671    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:28.579894 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:28.579820    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:28.580031 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:28.580016    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:28.580349 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:28.580112    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:28.580349 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:28.580143    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:28.580349 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:28.580234    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:28.614458 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:28.614424    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal" event={"ID":"2e193e431239fbdd2a5f918e7173fd13","Type":"ContainerStarted","Data":"7321c633734bc15a6703452e2037231effb6bbe1ca6b48d5b1d929427577a138"}
Jul 15 15:35:28.827574 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:28.827539    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs\") pod \"network-metrics-daemon-5jk56\" (UID: \"1c2e9a13-471e-478c-b38e-6748dc7ede63\") " pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:28.827757 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:28.827631    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret\") pod \"global-pull-secret-syncer-tts5k\" (UID: \"b0b6ce0e-c412-48dd-a538-19e92a2910ed\") " pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:28.827757 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:28.827704    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:28.827757 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:28.827741    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:28.827906 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:28.827777    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs podName:1c2e9a13-471e-478c-b38e-6748dc7ede63 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:32.827757812 +0000 UTC m=+10.236530993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs") pod "network-metrics-daemon-5jk56" (UID: "1c2e9a13-471e-478c-b38e-6748dc7ede63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:28.827906 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:28.827798    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret podName:b0b6ce0e-c412-48dd-a538-19e92a2910ed nodeName:}" failed. No retries permitted until 2026-07-15 15:35:32.827788122 +0000 UTC m=+10.236561301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret") pod "global-pull-secret-syncer-tts5k" (UID: "b0b6ce0e-c412-48dd-a538-19e92a2910ed") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:28.928771 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:28.928685    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9d9x\" (UniqueName: \"kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x\") pod \"network-check-target-m5gdn\" (UID: \"be1ab9a0-8cba-4834-a20c-a36d2117c38c\") " pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:28.928936 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:28.928893    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:35:28.928936 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:28.928916    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:35:28.928936 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:28.928930    2583 projected.go:196] Error preparing data for projected volume kube-api-access-l9d9x for pod openshift-network-diagnostics/network-check-target-m5gdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:28.929171 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:28.929011    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x podName:be1ab9a0-8cba-4834-a20c-a36d2117c38c nodeName:}" failed. No retries permitted until 2026-07-15 15:35:32.928993123 +0000 UTC m=+10.337766305 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9d9x" (UniqueName: "kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x") pod "network-check-target-m5gdn" (UID: "be1ab9a0-8cba-4834-a20c-a36d2117c38c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:30.580526 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:30.579731    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:30.580526 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:30.579859    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:30.580526 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:30.580259    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:30.580526 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:30.580342    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:30.580526 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:30.580405    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:30.580526 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:30.580487    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:32.579720 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:32.579676    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:32.579720 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:32.579692    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:32.579720 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:32.579695    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:32.580306 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:32.579803    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:32.580306 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:32.579886    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:32.580306 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:32.580019    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:32.862468 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:32.861761    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret\") pod \"global-pull-secret-syncer-tts5k\" (UID: \"b0b6ce0e-c412-48dd-a538-19e92a2910ed\") " pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:32.862468 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:32.861827    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs\") pod \"network-metrics-daemon-5jk56\" (UID: \"1c2e9a13-471e-478c-b38e-6748dc7ede63\") " pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:32.862468 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:32.861997    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:32.862468 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:32.862061    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs podName:1c2e9a13-471e-478c-b38e-6748dc7ede63 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:40.862041309 +0000 UTC m=+18.270814483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs") pod "network-metrics-daemon-5jk56" (UID: "1c2e9a13-471e-478c-b38e-6748dc7ede63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:32.862468 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:32.862461    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:32.862850 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:32.862515    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret podName:b0b6ce0e-c412-48dd-a538-19e92a2910ed nodeName:}" failed. No retries permitted until 2026-07-15 15:35:40.862501494 +0000 UTC m=+18.271274667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret") pod "global-pull-secret-syncer-tts5k" (UID: "b0b6ce0e-c412-48dd-a538-19e92a2910ed") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:32.962898 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:32.962297    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9d9x\" (UniqueName: \"kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x\") pod \"network-check-target-m5gdn\" (UID: \"be1ab9a0-8cba-4834-a20c-a36d2117c38c\") " pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:32.962898 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:32.962500    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:35:32.962898 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:32.962518    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:35:32.962898 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:32.962530    2583 projected.go:196] Error preparing data for projected volume kube-api-access-l9d9x for pod openshift-network-diagnostics/network-check-target-m5gdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:32.962898 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:32.962585    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x podName:be1ab9a0-8cba-4834-a20c-a36d2117c38c nodeName:}" failed. No retries permitted until 2026-07-15 15:35:40.962567029 +0000 UTC m=+18.371340201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9d9x" (UniqueName: "kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x") pod "network-check-target-m5gdn" (UID: "be1ab9a0-8cba-4834-a20c-a36d2117c38c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:34.578971 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:34.578926    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:34.579418 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:34.578980    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:34.579418 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:34.578923    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:34.579418 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:34.579064    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:34.579418 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:34.579161    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:34.579418 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:34.579319    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:36.579317 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:36.579283    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:36.579777 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:36.579283    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:36.579777 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:36.579397    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:36.579777 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:36.579283    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:36.579777 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:36.579537    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:36.579777 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:36.579606    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:38.579219 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:38.579180    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:38.579219 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:38.579204    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:38.579761 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:38.579180    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:38.579761 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:38.579323    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:38.579761 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:38.579387    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:38.579761 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:38.579469    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:40.579799 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:40.579760    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:40.580327 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:40.579895    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:40.580327 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:40.580002    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:40.580327 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:40.579900    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:40.580327 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:40.579895    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:40.580327 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:40.580101    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:40.921137 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:40.921019    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret\") pod \"global-pull-secret-syncer-tts5k\" (UID: \"b0b6ce0e-c412-48dd-a538-19e92a2910ed\") " pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:40.921137 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:40.921111    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs\") pod \"network-metrics-daemon-5jk56\" (UID: \"1c2e9a13-471e-478c-b38e-6748dc7ede63\") " pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:40.921401 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:40.921204    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:40.921401 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:40.921283    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret podName:b0b6ce0e-c412-48dd-a538-19e92a2910ed nodeName:}" failed. No retries permitted until 2026-07-15 15:35:56.921262382 +0000 UTC m=+34.330035552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret") pod "global-pull-secret-syncer-tts5k" (UID: "b0b6ce0e-c412-48dd-a538-19e92a2910ed") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:40.921401 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:40.921206    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:40.921401 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:40.921380    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs podName:1c2e9a13-471e-478c-b38e-6748dc7ede63 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:56.921358957 +0000 UTC m=+34.330132136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs") pod "network-metrics-daemon-5jk56" (UID: "1c2e9a13-471e-478c-b38e-6748dc7ede63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:41.021857 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:41.021814    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9d9x\" (UniqueName: \"kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x\") pod \"network-check-target-m5gdn\" (UID: \"be1ab9a0-8cba-4834-a20c-a36d2117c38c\") " pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:41.022041 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:41.022003    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:35:41.022041 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:41.022031    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:35:41.022041 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:41.022044    2583 projected.go:196] Error preparing data for projected volume kube-api-access-l9d9x for pod openshift-network-diagnostics/network-check-target-m5gdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:41.022165 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:41.022109    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x podName:be1ab9a0-8cba-4834-a20c-a36d2117c38c nodeName:}" failed. No retries permitted until 2026-07-15 15:35:57.022091472 +0000 UTC m=+34.430864644 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9d9x" (UniqueName: "kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x") pod "network-check-target-m5gdn" (UID: "be1ab9a0-8cba-4834-a20c-a36d2117c38c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:42.579108 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:42.579067    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:42.579108 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:42.579106    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:42.579622 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:42.579106    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:42.579622 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:42.579189    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:42.579622 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:42.579295    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:42.579622 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:42.579366    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:44.579230 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:44.579195    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:44.579648 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:44.579202    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:44.579648 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:44.579328    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:44.579648 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:44.579202    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:44.579648 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:44.579410    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:44.579648 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:44.579521    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:46.579998 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.579558    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:46.580676 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.579593    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:46.580676 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:46.580114    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:46.580676 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.579593    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:46.580676 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:46.580168    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:46.580676 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:46.580317    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:46.652623 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.652548    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m9ggg" event={"ID":"0f387fbf-3210-4c20-8ee2-803e27f4f75b","Type":"ContainerStarted","Data":"418294dd6590244799b91ee67047a4b09f5be9dd1340a55b43c17f78d5fb06ff"}
Jul 15 15:35:46.653856 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.653831    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mwrjx" event={"ID":"43c2120c-175e-49b8-9a9d-25fbfcdd6481","Type":"ContainerStarted","Data":"7f14cc3f1195b44b1e80e552441083a9f62632e71d11302c548c7583c098fc8d"}
Jul 15 15:35:46.655203 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.655175    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h7fgx" event={"ID":"f980a640-3a85-4ec8-a905-20a33aca6a40","Type":"ContainerStarted","Data":"ad6721a49bd7acd1e645142db4919b4b56bf0f164320ea8b594359dfe5589ce7"}
Jul 15 15:35:46.656503 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.656479    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m5qk2" event={"ID":"0ba4dc08-5506-4b1d-a8cf-c97b4ca925da","Type":"ContainerStarted","Data":"ee904f0c6d4afa7f472f8188c70ac21ab27c75f4e7a4d13fdb83be7a83fc68b6"}
Jul 15 15:35:46.658146 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.658124    2583 generic.go:356] "Generic (PLEG): container finished" podID="06751222-5566-4053-8cfb-faffda2016fc" containerID="a55f7c15dcd6c2be98a700637d0568f659f8210e83fc07381e47e20a6c309a41" exitCode=0
Jul 15 15:35:46.658232 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.658202    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x95gs" event={"ID":"06751222-5566-4053-8cfb-faffda2016fc","Type":"ContainerDied","Data":"a55f7c15dcd6c2be98a700637d0568f659f8210e83fc07381e47e20a6c309a41"}
Jul 15 15:35:46.660926 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.660848    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 15:35:46.661241 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.661222    2583 generic.go:356] "Generic (PLEG): container finished" podID="db3635c9-5545-49e5-9004-500eff2f48da" containerID="a73f09625dce80a611ba6272144646cd55f9cf2ef8a009e3104f735194686614" exitCode=1
Jul 15 15:35:46.661332 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.661286    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr" event={"ID":"db3635c9-5545-49e5-9004-500eff2f48da","Type":"ContainerStarted","Data":"48e9a80aa1efe893c6ccbc6a3e6445a379efa4e8698d4a8be75abfdf03b98798"}
Jul 15 15:35:46.661390 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.661364    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr" event={"ID":"db3635c9-5545-49e5-9004-500eff2f48da","Type":"ContainerStarted","Data":"b8eec8832919eecda80dde1984c9cbf6fefab008ccd9aa390f25a9c137df49cf"}
Jul 15 15:35:46.661447 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.661416    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr" event={"ID":"db3635c9-5545-49e5-9004-500eff2f48da","Type":"ContainerStarted","Data":"ea55a632e50c25c06b43b9925df307e95d14ab09fe8ac6f47f7685090d159b92"}
Jul 15 15:35:46.661492 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.661463    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr" event={"ID":"db3635c9-5545-49e5-9004-500eff2f48da","Type":"ContainerStarted","Data":"0d7485fa1725fb0845476606f2a15c3015bae59ad4739cfd755185fdfcdf9699"}
Jul 15 15:35:46.661538 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.661505    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr" event={"ID":"db3635c9-5545-49e5-9004-500eff2f48da","Type":"ContainerDied","Data":"a73f09625dce80a611ba6272144646cd55f9cf2ef8a009e3104f735194686614"}
Jul 15 15:35:46.661591 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.661551    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr" event={"ID":"db3635c9-5545-49e5-9004-500eff2f48da","Type":"ContainerStarted","Data":"aad97b6d889f9753868be7d71b3f89b1d5deb03bd21ce86b31e03f34e5a897a0"}
Jul 15 15:35:46.662625 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.662607    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp" event={"ID":"a073395d-6ca8-44f6-adea-8d02e13973ae","Type":"ContainerStarted","Data":"93df5e832dfba1c3a4a4d9dc26d6795cb88987b5eea14e8165169cf0d3be49dc"}
Jul 15 15:35:46.664069 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.664052    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l4xb7" event={"ID":"bef954d7-6fce-4c27-9f26-1a72529aa895","Type":"ContainerStarted","Data":"2162f37d7f210659a9a551871aadab03dba074e757515f2e6e53d411eb3ac1f2"}
Jul 15 15:35:46.665310 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.665293    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal" event={"ID":"102fbd48ff7ff0cfcd397c73fd966f70","Type":"ContainerStarted","Data":"38b5816665a1024dbac9cfde98dfd4fe44636dc63174e67671e7e26bc8cd7bd8"}
Jul 15 15:35:46.671065 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.671029    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal" podStartSLOduration=22.671016773 podStartE2EDuration="22.671016773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:28.647514304 +0000 UTC m=+6.056287589" watchObservedRunningTime="2026-07-15 15:35:46.671016773 +0000 UTC m=+24.079789963"
Jul 15 15:35:46.671297 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.671276    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m9ggg" podStartSLOduration=3.586395616 podStartE2EDuration="23.671270207s" totalImagesPullingTime="20.084874591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:46.671078394 +0000 UTC m=+24.079851587" watchObservedRunningTime="2026-07-15 15:35:46.671270207 +0000 UTC m=+24.080043396"
Jul 15 15:35:46.690174 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.690137    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-l4xb7" podStartSLOduration=3.526729244 podStartE2EDuration="23.69012258s" totalImagesPullingTime="20.163393336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:46.689635909 +0000 UTC m=+24.098409101" watchObservedRunningTime="2026-07-15 15:35:46.69012258 +0000 UTC m=+24.098895770"
Jul 15 15:35:46.739645 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.739593    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m5qk2" podStartSLOduration=3.637566702 podStartE2EDuration="23.739577987s" totalImagesPullingTime="20.102011285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:46.739142844 +0000 UTC m=+24.147916033" watchObservedRunningTime="2026-07-15 15:35:46.739577987 +0000 UTC m=+24.148351177"
Jul 15 15:35:46.758668 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.758625    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal" podStartSLOduration=22.758610988 podStartE2EDuration="22.758610988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:46.758097633 +0000 UTC m=+24.166870847" watchObservedRunningTime="2026-07-15 15:35:46.758610988 +0000 UTC m=+24.167384177"
Jul 15 15:35:46.794252 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.794204    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mwrjx" podStartSLOduration=3.705325823 podStartE2EDuration="23.794188495s" totalImagesPullingTime="20.088862672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:46.793919263 +0000 UTC m=+24.202692455" watchObservedRunningTime="2026-07-15 15:35:46.794188495 +0000 UTC m=+24.202961686"
Jul 15 15:35:46.794410 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:46.794276    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h7fgx" podStartSLOduration=3.700084101 podStartE2EDuration="23.794270399s" totalImagesPullingTime="20.094186298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:46.773760425 +0000 UTC m=+24.182533628" watchObservedRunningTime="2026-07-15 15:35:46.794270399 +0000 UTC m=+24.203043643"
Jul 15 15:35:47.047815 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:47.047791    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 15:35:47.297185 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:47.297000    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T15:35:47.047809703Z","UUID":"c63fbc1a-7d1b-48ed-a5d0-0488bf215f83","Handler":null,"Name":"","Endpoint":""}
Jul 15 15:35:47.298485 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:47.298467    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 15:35:47.298590 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:47.298506    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 15:35:47.486517 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:47.486475    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m9ggg"
Jul 15 15:35:47.487058 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:47.487042    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m9ggg"
Jul 15 15:35:47.668222 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:47.668140    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4vwc6" event={"ID":"dcd4d915-d684-4aee-9a48-0e00aad98d39","Type":"ContainerStarted","Data":"23c77268215bf0ab36837139e87fb661623fbf07a03d3682cfb92f3aafaa4b1c"}
Jul 15 15:35:47.669887 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:47.669856    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp" event={"ID":"a073395d-6ca8-44f6-adea-8d02e13973ae","Type":"ContainerStarted","Data":"01697c9a1f00ace04b716c138529647bcb62d31568b7c6ecdb5b6dd74b5a939f"}
Jul 15 15:35:47.670759 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:47.670739    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m9ggg"
Jul 15 15:35:47.671074 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:47.671061    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m9ggg"
Jul 15 15:35:47.711982 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:47.711918    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4vwc6" podStartSLOduration=4.595762416 podStartE2EDuration="24.711903295s" totalImagesPullingTime="20.116140879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:47.690114765 +0000 UTC m=+25.098887955" watchObservedRunningTime="2026-07-15 15:35:47.711903295 +0000 UTC m=+25.120676519"
Jul 15 15:35:48.579097 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:48.579068    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:48.579311 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:48.579177    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:48.579311 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:48.579189    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:48.579311 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:48.579212    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:48.579311 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:48.579305    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:48.579528 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:48.579391    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:48.676531 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:48.676496    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 15:35:48.679812 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:48.679787    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp" event={"ID":"a073395d-6ca8-44f6-adea-8d02e13973ae","Type":"ContainerStarted","Data":"2dbc280d5ac59984c809f6d18867f52bdcacebb3c8282715ee22fe06874ddd9f"}
Jul 15 15:35:48.700633 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:48.700572    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bdxrp" podStartSLOduration=3.440868979 podStartE2EDuration="25.700548007s" totalImagesPullingTime="22.259679028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:48.700119854 +0000 UTC m=+26.108893062" watchObservedRunningTime="2026-07-15 15:35:48.700548007 +0000 UTC m=+26.109321198"
Jul 15 15:35:49.395652 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:49.395460    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:49.573352 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:49.573316    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:49.670203 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:49.670113    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:49.685787 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:49.685751    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 15:35:49.686333 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:49.686309    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr" event={"ID":"db3635c9-5545-49e5-9004-500eff2f48da","Type":"ContainerStarted","Data":"f4916a4c608a4b44f1ccc4c927ea8f1ba5e07b4ea50f390ee3a7c4e5667aab20"}
Jul 15 15:35:49.751218 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:49.751172    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:50.579565 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:50.579532    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:50.579565 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:50.579561    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:50.579840 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:50.579565    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:50.579840 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:50.579654    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:50.579840 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:50.579734    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:50.579840 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:50.579799    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:52.579937 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:52.579682    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:52.580550 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:52.579723    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:52.580550 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:52.579997    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:52.580550 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:52.579726    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:52.580550 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:52.580066    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:52.580550 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:52.580128    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:52.694042 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:52.694008    2583 generic.go:356] "Generic (PLEG): container finished" podID="06751222-5566-4053-8cfb-faffda2016fc" containerID="427d4045d597bae76b545aa556d3656ada99f8da744b17890d84c1ad3b7c7c34" exitCode=0
Jul 15 15:35:52.694231 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:52.694094    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x95gs" event={"ID":"06751222-5566-4053-8cfb-faffda2016fc","Type":"ContainerDied","Data":"427d4045d597bae76b545aa556d3656ada99f8da744b17890d84c1ad3b7c7c34"}
Jul 15 15:35:52.697832 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:52.697811    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 15:35:52.698180 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:52.698162    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr" event={"ID":"db3635c9-5545-49e5-9004-500eff2f48da","Type":"ContainerStarted","Data":"1beecca54de548080bae99d5943dd3a3c70d74433fc6257ada63d645e49170ec"}
Jul 15 15:35:52.698392 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:52.698376    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:52.698464 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:52.698429    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:52.698611 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:52.698596    2583 scope.go:117] "RemoveContainer" containerID="a73f09625dce80a611ba6272144646cd55f9cf2ef8a009e3104f735194686614"
Jul 15 15:35:52.714531 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:52.714511    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:53.704700 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:53.704676    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 15:35:53.705310 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:53.705078    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr" event={"ID":"db3635c9-5545-49e5-9004-500eff2f48da","Type":"ContainerStarted","Data":"04505e32641a74c8ee7a5a70b0cacab07cf845f1043a12429660e1906cf8a248"}
Jul 15 15:35:53.706033 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:53.705360    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:53.720693 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:53.720668    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:35:53.739497 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:53.739442    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr" podStartSLOduration=10.288264359 podStartE2EDuration="30.739426104s" totalImagesPullingTime="20.451161745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:53.739007029 +0000 UTC m=+31.147780219" watchObservedRunningTime="2026-07-15 15:35:53.739426104 +0000 UTC m=+31.148199293"
Jul 15 15:35:54.018969 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:54.018743    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tts5k"]
Jul 15 15:35:54.019123 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:54.019059    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:54.019163 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:54.019141    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:54.022758 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:54.022732    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5jk56"]
Jul 15 15:35:54.022889 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:54.022848    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:54.023000 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:54.022976    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:54.023374 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:54.023356    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m5gdn"]
Jul 15 15:35:54.023462 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:54.023432    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:54.023519 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:54.023496    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:54.709260 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:54.709222    2583 generic.go:356] "Generic (PLEG): container finished" podID="06751222-5566-4053-8cfb-faffda2016fc" containerID="8cb0a739815a7770afd2d48239d69ef5af4da49d9dd0673101aebfc855b4d20d" exitCode=0
Jul 15 15:35:54.709676 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:54.709317    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x95gs" event={"ID":"06751222-5566-4053-8cfb-faffda2016fc","Type":"ContainerDied","Data":"8cb0a739815a7770afd2d48239d69ef5af4da49d9dd0673101aebfc855b4d20d"}
Jul 15 15:35:55.461588 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:55.461552    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:55.524582 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:55.524556    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:55.578792 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:55.578768    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:55.578972 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:55.578777    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:55.578972 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:55.578863    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:55.578972 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:55.578964    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:55.579110 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:55.578777    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:55.579110 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:55.579065    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:56.715671 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:56.715639    2583 generic.go:356] "Generic (PLEG): container finished" podID="06751222-5566-4053-8cfb-faffda2016fc" containerID="65be66e6a9db62a828f5811f34743a7e070bcb280336e6c74cc353da08056be1" exitCode=0
Jul 15 15:35:56.716253 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:56.715693    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x95gs" event={"ID":"06751222-5566-4053-8cfb-faffda2016fc","Type":"ContainerDied","Data":"65be66e6a9db62a828f5811f34743a7e070bcb280336e6c74cc353da08056be1"}
Jul 15 15:35:56.932829 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:56.932796    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs\") pod \"network-metrics-daemon-5jk56\" (UID: \"1c2e9a13-471e-478c-b38e-6748dc7ede63\") " pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:56.933027 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:56.932865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret\") pod \"global-pull-secret-syncer-tts5k\" (UID: \"b0b6ce0e-c412-48dd-a538-19e92a2910ed\") " pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:56.933027 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:56.932937    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:56.933027 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:56.932976    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:56.933027 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:56.933005    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs podName:1c2e9a13-471e-478c-b38e-6748dc7ede63 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:28.932992155 +0000 UTC m=+66.341765324 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs") pod "network-metrics-daemon-5jk56" (UID: "1c2e9a13-471e-478c-b38e-6748dc7ede63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:56.933027 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:56.933029    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret podName:b0b6ce0e-c412-48dd-a538-19e92a2910ed nodeName:}" failed. No retries permitted until 2026-07-15 15:36:28.93301375 +0000 UTC m=+66.341786918 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret") pod "global-pull-secret-syncer-tts5k" (UID: "b0b6ce0e-c412-48dd-a538-19e92a2910ed") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:56.978701 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:56.978630    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:57.033749 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:57.033720    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9d9x\" (UniqueName: \"kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x\") pod \"network-check-target-m5gdn\" (UID: \"be1ab9a0-8cba-4834-a20c-a36d2117c38c\") " pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:57.034115 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:57.034091    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:35:57.034338 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:57.034322    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:35:57.034397 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:57.034347    2583 projected.go:196] Error preparing data for projected volume kube-api-access-l9d9x for pod openshift-network-diagnostics/network-check-target-m5gdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:57.034446 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:57.034417    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x podName:be1ab9a0-8cba-4834-a20c-a36d2117c38c nodeName:}" failed. No retries permitted until 2026-07-15 15:36:29.034396222 +0000 UTC m=+66.443169407 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9d9x" (UniqueName: "kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x") pod "network-check-target-m5gdn" (UID: "be1ab9a0-8cba-4834-a20c-a36d2117c38c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:57.084450 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:57.084416    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:57.326091 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:57.326001    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:57.445098 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:57.445052    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:57.579811 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:57.579722    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:57.579991 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:57.579722    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:57.579991 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:57.579852    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tts5k" podUID="b0b6ce0e-c412-48dd-a538-19e92a2910ed"
Jul 15 15:35:57.579991 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:57.579727    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:57.579991 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:57.579966    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jk56" podUID="1c2e9a13-471e-478c-b38e-6748dc7ede63"
Jul 15 15:35:57.580204 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:57.580018    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5gdn" podUID="be1ab9a0-8cba-4834-a20c-a36d2117c38c"
Jul 15 15:35:57.999294 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:57.999258    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:58.167036 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:58.167003    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:58.464854 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:58.464818    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:59.094804 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.094770    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:59.158408 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.158372    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:59.453492 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.453465    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeReady"
Jul 15 15:35:59.453685 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.453606    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 15:35:59.487627 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.487594    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:59.496849 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.496823    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c5d89789c-8mxgm"]
Jul 15 15:35:59.499163 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.499141    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.505124 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.505076    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 15:35:59.505739 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.505510    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b5ggf\""
Jul 15 15:35:59.506506 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.506487    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 15:35:59.506902 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.506885    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 15:35:59.508594 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.508575    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8fvlg"]
Jul 15 15:35:59.510299 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.510281    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8fvlg"
Jul 15 15:35:59.517796 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.517757    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 15:35:59.517796 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.517766    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 15:35:59.518034 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.517820    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 15:35:59.518806 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.518786    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c5xml"]
Jul 15 15:35:59.518912 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.518809    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qwxrd\""
Jul 15 15:35:59.520806 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.520765    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 15:35:59.521227 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.521211    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c5xml"
Jul 15 15:35:59.528230 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.528210    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dq8c7\""
Jul 15 15:35:59.529059 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.529034    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c5d89789c-8mxgm"]
Jul 15 15:35:59.530432 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.530285    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8fvlg"]
Jul 15 15:35:59.530643 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.530625    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 15:35:59.530758 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.530693    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 15:35:59.546417 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.546394    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c5xml"]
Jul 15 15:35:59.551970 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.551925    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8885308-1313-405b-8a21-0ce34e5fb3a5-installation-pull-secrets\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.552076 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.551978    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-bound-sa-token\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.552076 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.552026    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8885308-1313-405b-8a21-0ce34e5fb3a5-ca-trust-extracted\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.552170 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.552085    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.552170 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.552110    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-certificates\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.552170 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.552156    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8885308-1313-405b-8a21-0ce34e5fb3a5-trusted-ca\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.552304 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.552187    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf9kc\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-kube-api-access-wf9kc\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.552304 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.552212    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8885308-1313-405b-8a21-0ce34e5fb3a5-image-registry-private-configuration\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.560728 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.560702    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ggmcc"]
Jul 15 15:35:59.562675 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.562656    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:35:59.565688 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.565666    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 15:35:59.565803 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.565783    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 15:35:59.566754 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.566020    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 15:35:59.566754 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.566117    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 15:35:59.567326 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.567302    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cvjqc\""
Jul 15 15:35:59.578631 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.578606    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ggmcc"]
Jul 15 15:35:59.582992 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.582972    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:35:59.583089 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.583006    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:35:59.583145 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.583099    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:35:59.587966 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.587927    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 15:35:59.588154 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.588133    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 15:35:59.590043 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.590017    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 15:35:59.590043 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.590033    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xhclp\""
Jul 15 15:35:59.590195 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.590061    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-89d92\""
Jul 15 15:35:59.590342 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.590330    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 15:35:59.594604 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.594581    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:59.653100 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653040    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbfd6\" (UniqueName: \"kubernetes.io/projected/6fdde45b-3a66-404d-8787-84e6f3084714-kube-api-access-gbfd6\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:35:59.653281 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8885308-1313-405b-8a21-0ce34e5fb3a5-installation-pull-secrets\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.653281 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-bound-sa-token\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.653281 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653196    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:35:59.653281 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653224    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hvsj\" (UniqueName: \"kubernetes.io/projected/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-api-access-4hvsj\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:35:59.653281 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:35:59.653512 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653296    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8885308-1313-405b-8a21-0ce34e5fb3a5-ca-trust-extracted\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.653512 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653332    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wslbn\" (UniqueName: \"kubernetes.io/projected/3b182ec6-d85a-4859-96d3-eeffbe877dc9-kube-api-access-wslbn\") pod \"ingress-canary-8fvlg\" (UID: \"3b182ec6-d85a-4859-96d3-eeffbe877dc9\") " pod="openshift-ingress-canary/ingress-canary-8fvlg"
Jul 15 15:35:59.653512 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653367    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3c8a4344-4412-43ef-8c3a-160e358c4a9d-crio-socket\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:35:59.653512 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653407    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fdde45b-3a66-404d-8787-84e6f3084714-config-volume\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:35:59.653512 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653422    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b182ec6-d85a-4859-96d3-eeffbe877dc9-cert\") pod \"ingress-canary-8fvlg\" (UID: \"3b182ec6-d85a-4859-96d3-eeffbe877dc9\") " pod="openshift-ingress-canary/ingress-canary-8fvlg"
Jul 15 15:35:59.653512 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653450    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.653512 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653468    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-certificates\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.653789 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:59.653549    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 15:35:59.653789 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:59.653567    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5d89789c-8mxgm: secret "image-registry-tls" not found
Jul 15 15:35:59.653789 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:59.653621    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls podName:d8885308-1313-405b-8a21-0ce34e5fb3a5 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:00.153601669 +0000 UTC m=+37.562374858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls") pod "image-registry-6c5d89789c-8mxgm" (UID: "d8885308-1313-405b-8a21-0ce34e5fb3a5") : secret "image-registry-tls" not found
Jul 15 15:35:59.653789 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653625    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8885308-1313-405b-8a21-0ce34e5fb3a5-ca-trust-extracted\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.653789 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653639    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8885308-1313-405b-8a21-0ce34e5fb3a5-trusted-ca\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.653789 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653667    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c8a4344-4412-43ef-8c3a-160e358c4a9d-data-volume\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:35:59.653789 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653776    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fdde45b-3a66-404d-8787-84e6f3084714-tmp-dir\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:35:59.654120 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653805    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf9kc\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-kube-api-access-wf9kc\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.654120 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653847    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8885308-1313-405b-8a21-0ce34e5fb3a5-image-registry-private-configuration\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.654120 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653901    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:35:59.654120 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.653911    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-certificates\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.654527 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.654508    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8885308-1313-405b-8a21-0ce34e5fb3a5-trusted-ca\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.657659 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.657640    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8885308-1313-405b-8a21-0ce34e5fb3a5-installation-pull-secrets\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.657810 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.657791    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8885308-1313-405b-8a21-0ce34e5fb3a5-image-registry-private-configuration\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.665670 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.665649    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf9kc\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-kube-api-access-wf9kc\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.666823 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.666798    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-bound-sa-token\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:35:59.755239 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.755145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wslbn\" (UniqueName: \"kubernetes.io/projected/3b182ec6-d85a-4859-96d3-eeffbe877dc9-kube-api-access-wslbn\") pod \"ingress-canary-8fvlg\" (UID: \"3b182ec6-d85a-4859-96d3-eeffbe877dc9\") " pod="openshift-ingress-canary/ingress-canary-8fvlg"
Jul 15 15:35:59.755239 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.755189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3c8a4344-4412-43ef-8c3a-160e358c4a9d-crio-socket\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:35:59.755239 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.755219    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fdde45b-3a66-404d-8787-84e6f3084714-config-volume\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:35:59.755239 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.755235    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b182ec6-d85a-4859-96d3-eeffbe877dc9-cert\") pod \"ingress-canary-8fvlg\" (UID: \"3b182ec6-d85a-4859-96d3-eeffbe877dc9\") " pod="openshift-ingress-canary/ingress-canary-8fvlg"
Jul 15 15:35:59.755501 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.755477    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3c8a4344-4412-43ef-8c3a-160e358c4a9d-crio-socket\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:35:59.755563 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.755524    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c8a4344-4412-43ef-8c3a-160e358c4a9d-data-volume\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:35:59.755606 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.755571    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fdde45b-3a66-404d-8787-84e6f3084714-tmp-dir\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:35:59.755637 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.755620    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:35:59.755681 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.755673    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbfd6\" (UniqueName: \"kubernetes.io/projected/6fdde45b-3a66-404d-8787-84e6f3084714-kube-api-access-gbfd6\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:35:59.755726 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.755710    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:35:59.755775 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.755734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hvsj\" (UniqueName: \"kubernetes.io/projected/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-api-access-4hvsj\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:35:59.755775 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.755758    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:35:59.755874 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:59.755774    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 15:35:59.755874 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.755839    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c8a4344-4412-43ef-8c3a-160e358c4a9d-data-volume\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:35:59.755874 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:59.755843    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 15:35:59.755874 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:59.755871    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 15:35:59.756082 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:59.755847    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls podName:6fdde45b-3a66-404d-8787-84e6f3084714 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:00.255827977 +0000 UTC m=+37.664601157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls") pod "dns-default-c5xml" (UID: "6fdde45b-3a66-404d-8787-84e6f3084714") : secret "dns-default-metrics-tls" not found
Jul 15 15:35:59.756082 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:59.755901    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls podName:3c8a4344-4412-43ef-8c3a-160e358c4a9d nodeName:}" failed. No retries permitted until 2026-07-15 15:36:00.255888169 +0000 UTC m=+37.664661338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ggmcc" (UID: "3c8a4344-4412-43ef-8c3a-160e358c4a9d") : secret "insights-runtime-extractor-tls" not found
Jul 15 15:35:59.756082 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.755903    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fdde45b-3a66-404d-8787-84e6f3084714-tmp-dir\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:35:59.756082 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.755866    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fdde45b-3a66-404d-8787-84e6f3084714-config-volume\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:35:59.756082 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:35:59.755918    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-rbac-proxy-cm podName:3c8a4344-4412-43ef-8c3a-160e358c4a9d nodeName:}" failed. No retries permitted until 2026-07-15 15:36:00.255907951 +0000 UTC m=+37.664681119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ggmcc" (UID: "3c8a4344-4412-43ef-8c3a-160e358c4a9d") : configmap "kube-rbac-proxy" not found
Jul 15 15:35:59.758071 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.758053    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b182ec6-d85a-4859-96d3-eeffbe877dc9-cert\") pod \"ingress-canary-8fvlg\" (UID: \"3b182ec6-d85a-4859-96d3-eeffbe877dc9\") " pod="openshift-ingress-canary/ingress-canary-8fvlg"
Jul 15 15:35:59.771851 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.771823    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wslbn\" (UniqueName: \"kubernetes.io/projected/3b182ec6-d85a-4859-96d3-eeffbe877dc9-kube-api-access-wslbn\") pod \"ingress-canary-8fvlg\" (UID: \"3b182ec6-d85a-4859-96d3-eeffbe877dc9\") " pod="openshift-ingress-canary/ingress-canary-8fvlg"
Jul 15 15:35:59.781431 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.781389    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hvsj\" (UniqueName: \"kubernetes.io/projected/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-api-access-4hvsj\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:35:59.784336 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.784314    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbfd6\" (UniqueName: \"kubernetes.io/projected/6fdde45b-3a66-404d-8787-84e6f3084714-kube-api-access-gbfd6\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:35:59.817382 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.817347    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:35:59.820235 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.820212    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8fvlg"
Jul 15 15:35:59.909680 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:35:59.909640    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:00.158350 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:00.158242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:36:00.158916 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:00.158441    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 15:36:00.158916 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:00.158466    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5d89789c-8mxgm: secret "image-registry-tls" not found
Jul 15 15:36:00.158916 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:00.158537    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls podName:d8885308-1313-405b-8a21-0ce34e5fb3a5 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:01.158515627 +0000 UTC m=+38.567288797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls") pod "image-registry-6c5d89789c-8mxgm" (UID: "d8885308-1313-405b-8a21-0ce34e5fb3a5") : secret "image-registry-tls" not found
Jul 15 15:36:00.172417 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:00.172388    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mwrjx_43c2120c-175e-49b8-9a9d-25fbfcdd6481/dns-node-resolver/0.log"
Jul 15 15:36:00.259359 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:00.259308    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:36:00.259533 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:00.259370    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:36:00.259533 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:00.259451    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 15:36:00.259630 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:00.259537    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-rbac-proxy-cm podName:3c8a4344-4412-43ef-8c3a-160e358c4a9d nodeName:}" failed. No retries permitted until 2026-07-15 15:36:01.25951482 +0000 UTC m=+38.668288017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ggmcc" (UID: "3c8a4344-4412-43ef-8c3a-160e358c4a9d") : configmap "kube-rbac-proxy" not found
Jul 15 15:36:00.259630 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:00.259554    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 15:36:00.259630 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:00.259460    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:36:00.259630 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:00.259558    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 15:36:00.259630 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:00.259616    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls podName:6fdde45b-3a66-404d-8787-84e6f3084714 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:01.259603127 +0000 UTC m=+38.668376295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls") pod "dns-default-c5xml" (UID: "6fdde45b-3a66-404d-8787-84e6f3084714") : secret "dns-default-metrics-tls" not found
Jul 15 15:36:00.259829 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:00.259644    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls podName:3c8a4344-4412-43ef-8c3a-160e358c4a9d nodeName:}" failed. No retries permitted until 2026-07-15 15:36:01.259630067 +0000 UTC m=+38.668403241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ggmcc" (UID: "3c8a4344-4412-43ef-8c3a-160e358c4a9d") : secret "insights-runtime-extractor-tls" not found
Jul 15 15:36:00.916615 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:00.916388    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8fvlg"]
Jul 15 15:36:00.921377 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:00.921347    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b182ec6_d85a_4859_96d3_eeffbe877dc9.slice/crio-85ce760c4c6a1ace6b1358db7bfdda9c2f12d58eac920d8c1284db26e74c7317 WatchSource:0}: Error finding container 85ce760c4c6a1ace6b1358db7bfdda9c2f12d58eac920d8c1284db26e74c7317: Status 404 returned error can't find the container with id 85ce760c4c6a1ace6b1358db7bfdda9c2f12d58eac920d8c1284db26e74c7317
Jul 15 15:36:01.167698 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:01.167599    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:36:01.168106 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:01.167794    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 15:36:01.168106 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:01.167819    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5d89789c-8mxgm: secret "image-registry-tls" not found
Jul 15 15:36:01.168106 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:01.167883    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls podName:d8885308-1313-405b-8a21-0ce34e5fb3a5 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:03.167866218 +0000 UTC m=+40.576639386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls") pod "image-registry-6c5d89789c-8mxgm" (UID: "d8885308-1313-405b-8a21-0ce34e5fb3a5") : secret "image-registry-tls" not found
Jul 15 15:36:01.268469 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:01.268434    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:36:01.268679 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:01.268492    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:36:01.268679 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:01.268513    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:36:01.268679 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:01.268586    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 15:36:01.268679 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:01.268606    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 15:36:01.268679 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:01.268617    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 15:36:01.268679 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:01.268656    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-rbac-proxy-cm podName:3c8a4344-4412-43ef-8c3a-160e358c4a9d nodeName:}" failed. No retries permitted until 2026-07-15 15:36:03.268640613 +0000 UTC m=+40.677413797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ggmcc" (UID: "3c8a4344-4412-43ef-8c3a-160e358c4a9d") : configmap "kube-rbac-proxy" not found
Jul 15 15:36:01.268679 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:01.268681    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls podName:6fdde45b-3a66-404d-8787-84e6f3084714 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:03.268664498 +0000 UTC m=+40.677437666 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls") pod "dns-default-c5xml" (UID: "6fdde45b-3a66-404d-8787-84e6f3084714") : secret "dns-default-metrics-tls" not found
Jul 15 15:36:01.268914 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:01.268699    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls podName:3c8a4344-4412-43ef-8c3a-160e358c4a9d nodeName:}" failed. No retries permitted until 2026-07-15 15:36:03.268690085 +0000 UTC m=+40.677463256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ggmcc" (UID: "3c8a4344-4412-43ef-8c3a-160e358c4a9d") : secret "insights-runtime-extractor-tls" not found
Jul 15 15:36:01.300226 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:01.300193    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:01.368444 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:01.368418    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h7fgx_f980a640-3a85-4ec8-a905-20a33aca6a40/node-ca/0.log"
Jul 15 15:36:01.399409 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:01.399372    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:01.465718 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:01.465686    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:01.730306 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:01.730204    2583 generic.go:356] "Generic (PLEG): container finished" podID="06751222-5566-4053-8cfb-faffda2016fc" containerID="b349d0b7c8d82fdc7e9e7f3f9121050949ef6c70cea1e7f87ea8d7778c3e8cd4" exitCode=0
Jul 15 15:36:01.730306 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:01.730295    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x95gs" event={"ID":"06751222-5566-4053-8cfb-faffda2016fc","Type":"ContainerDied","Data":"b349d0b7c8d82fdc7e9e7f3f9121050949ef6c70cea1e7f87ea8d7778c3e8cd4"}
Jul 15 15:36:01.731573 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:01.731532    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8fvlg" event={"ID":"3b182ec6-d85a-4859-96d3-eeffbe877dc9","Type":"ContainerStarted","Data":"85ce760c4c6a1ace6b1358db7bfdda9c2f12d58eac920d8c1284db26e74c7317"}
Jul 15 15:36:02.348452 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:02.348414    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:02.737554 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:02.737520    2583 generic.go:356] "Generic (PLEG): container finished" podID="06751222-5566-4053-8cfb-faffda2016fc" containerID="8b25bf089324d11f72a51ab0c8be2f384a12ea809bd8bc1711bfe67f721d86c7" exitCode=0
Jul 15 15:36:02.737709 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:02.737579    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x95gs" event={"ID":"06751222-5566-4053-8cfb-faffda2016fc","Type":"ContainerDied","Data":"8b25bf089324d11f72a51ab0c8be2f384a12ea809bd8bc1711bfe67f721d86c7"}
Jul 15 15:36:03.184088 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:03.184000    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:36:03.184255 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:03.184130    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 15:36:03.184255 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:03.184145    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5d89789c-8mxgm: secret "image-registry-tls" not found
Jul 15 15:36:03.184255 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:03.184209    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls podName:d8885308-1313-405b-8a21-0ce34e5fb3a5 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:07.184189015 +0000 UTC m=+44.592962197 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls") pod "image-registry-6c5d89789c-8mxgm" (UID: "d8885308-1313-405b-8a21-0ce34e5fb3a5") : secret "image-registry-tls" not found
Jul 15 15:36:03.284526 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:03.284493    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:36:03.284735 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:03.284548    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:36:03.284735 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:03.284574    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:36:03.284735 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:03.284659    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 15:36:03.284735 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:03.284666    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 15:36:03.284735 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:03.284722    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-rbac-proxy-cm podName:3c8a4344-4412-43ef-8c3a-160e358c4a9d nodeName:}" failed. No retries permitted until 2026-07-15 15:36:07.284707295 +0000 UTC m=+44.693480463 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ggmcc" (UID: "3c8a4344-4412-43ef-8c3a-160e358c4a9d") : configmap "kube-rbac-proxy" not found
Jul 15 15:36:03.285084 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:03.284745    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls podName:3c8a4344-4412-43ef-8c3a-160e358c4a9d nodeName:}" failed. No retries permitted until 2026-07-15 15:36:07.284732444 +0000 UTC m=+44.693505633 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ggmcc" (UID: "3c8a4344-4412-43ef-8c3a-160e358c4a9d") : secret "insights-runtime-extractor-tls" not found
Jul 15 15:36:03.285084 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:03.284666    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 15:36:03.285084 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:03.284769    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls podName:6fdde45b-3a66-404d-8787-84e6f3084714 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:07.284762325 +0000 UTC m=+44.693535493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls") pod "dns-default-c5xml" (UID: "6fdde45b-3a66-404d-8787-84e6f3084714") : secret "dns-default-metrics-tls" not found
Jul 15 15:36:03.367608 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:03.367581    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:03.472512 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:03.472482    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:03.743285 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:03.743196    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x95gs" event={"ID":"06751222-5566-4053-8cfb-faffda2016fc","Type":"ContainerStarted","Data":"a13ae2d5b776974934dac05b57554e040895ee0abe16d453600b680167e5ae31"}
Jul 15 15:36:03.747545 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:03.747513    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8fvlg" event={"ID":"3b182ec6-d85a-4859-96d3-eeffbe877dc9","Type":"ContainerStarted","Data":"8f376dd2956d45021a212919b87429cb96548c6bb5353882953b9b4d1c8f12f0"}
Jul 15 15:36:03.771719 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:03.771670    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x95gs" podStartSLOduration=8.929663411 podStartE2EDuration="40.771655246s" totalImagesPullingTime="31.841991835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:03.770165411 +0000 UTC m=+41.178938627" watchObservedRunningTime="2026-07-15 15:36:03.771655246 +0000 UTC m=+41.180428436"
Jul 15 15:36:03.797560 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:03.797499    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8fvlg" podStartSLOduration=2.312870113 podStartE2EDuration="4.797479698s" totalImagesPullingTime="2.484609585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:03.796506933 +0000 UTC m=+41.205280121" watchObservedRunningTime="2026-07-15 15:36:03.797479698 +0000 UTC m=+41.206252889"
Jul 15 15:36:05.208142 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:05.208111    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:05.821437 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:05.821407    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:06.354890 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:06.354855    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:06.460277 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:06.460246    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:06.555652 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:06.555621    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:06.704237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:06.704205    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:07.215819 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:07.215782    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:36:07.216013 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:07.215895    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 15:36:07.216013 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:07.215907    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5d89789c-8mxgm: secret "image-registry-tls" not found
Jul 15 15:36:07.216013 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:07.215987    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls podName:d8885308-1313-405b-8a21-0ce34e5fb3a5 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:15.215970265 +0000 UTC m=+52.624743446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls") pod "image-registry-6c5d89789c-8mxgm" (UID: "d8885308-1313-405b-8a21-0ce34e5fb3a5") : secret "image-registry-tls" not found
Jul 15 15:36:07.317030 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:07.316986    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:36:07.317235 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:07.317053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:36:07.317235 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:07.317092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:36:07.317235 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:07.317165    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 15:36:07.317235 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:07.317175    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 15:36:07.317235 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:07.317228    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls podName:6fdde45b-3a66-404d-8787-84e6f3084714 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:15.317211966 +0000 UTC m=+52.725985134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls") pod "dns-default-c5xml" (UID: "6fdde45b-3a66-404d-8787-84e6f3084714") : secret "dns-default-metrics-tls" not found
Jul 15 15:36:07.317492 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:07.317246    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls podName:3c8a4344-4412-43ef-8c3a-160e358c4a9d nodeName:}" failed. No retries permitted until 2026-07-15 15:36:15.31723856 +0000 UTC m=+52.726011729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ggmcc" (UID: "3c8a4344-4412-43ef-8c3a-160e358c4a9d") : secret "insights-runtime-extractor-tls" not found
Jul 15 15:36:07.317652 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:07.317632    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c8a4344-4412-43ef-8c3a-160e358c4a9d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:36:07.436814 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:07.436779    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:07.526424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:07.526337    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:08.633554 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:08.633521    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:08.760225 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:08.760193    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:08.831140 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:08.831112    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:09.044271 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:09.044240    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:09.256101 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:09.256069    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:09.433818 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:09.433752    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:10.045089 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:10.045035    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:10.262530 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:10.262495    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:11.569139 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:11.569109    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:11.673461 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:11.673429    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:11.973661 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:11.973629    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:12.073659 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:12.073628    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:12.552598 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:12.552567    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:12.653265 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:12.653237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:12.831457 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:12.831354    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:13.101368 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:13.101287    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:13.226458 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:13.226412    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:13.437230 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:13.437132    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:14.428300 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:14.428266    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:14.831977 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:14.831931    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:15.039744 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.039685    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:15.224792 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.224762    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:15.277143 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.277112    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:36:15.281009 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.280984    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls\") pod \"image-registry-6c5d89789c-8mxgm\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") " pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:36:15.378308 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.378246    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:36:15.378485 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.378384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:36:15.382162 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.381427    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c8a4344-4412-43ef-8c3a-160e358c4a9d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggmcc\" (UID: \"3c8a4344-4412-43ef-8c3a-160e358c4a9d\") " pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:36:15.382162 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.381470    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fdde45b-3a66-404d-8787-84e6f3084714-metrics-tls\") pod \"dns-default-c5xml\" (UID: \"6fdde45b-3a66-404d-8787-84e6f3084714\") " pod="openshift-dns/dns-default-c5xml"
Jul 15 15:36:15.410390 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.410350    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:36:15.429280 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.429233    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:15.432704 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.432687    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c5xml"
Jul 15 15:36:15.472902 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.472873    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ggmcc"
Jul 15 15:36:15.588621 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.588591    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c5d89789c-8mxgm"]
Jul 15 15:36:15.592086 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:15.592058    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8885308_1313_405b_8a21_0ce34e5fb3a5.slice/crio-8ccd4c1d0d66e650f35e607f0f08cd674f050051ad8983bfc8d50b7524aee9bb WatchSource:0}: Error finding container 8ccd4c1d0d66e650f35e607f0f08cd674f050051ad8983bfc8d50b7524aee9bb: Status 404 returned error can't find the container with id 8ccd4c1d0d66e650f35e607f0f08cd674f050051ad8983bfc8d50b7524aee9bb
Jul 15 15:36:15.621424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.621397    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c5xml"]
Jul 15 15:36:15.624325 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:15.624300    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fdde45b_3a66_404d_8787_84e6f3084714.slice/crio-63ab266a6ce213caca929e8f6389a341e3025470b05eaf3bee6e4adcf4dc5e63 WatchSource:0}: Error finding container 63ab266a6ce213caca929e8f6389a341e3025470b05eaf3bee6e4adcf4dc5e63: Status 404 returned error can't find the container with id 63ab266a6ce213caca929e8f6389a341e3025470b05eaf3bee6e4adcf4dc5e63
Jul 15 15:36:15.644782 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.644760    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ggmcc"]
Jul 15 15:36:15.647160 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:15.647139    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c8a4344_4412_43ef_8c3a_160e358c4a9d.slice/crio-9e97be04da329841ce08ed247e2d42dee62dbc1bd1ebe4ed51a3b2f8ace5c4af WatchSource:0}: Error finding container 9e97be04da329841ce08ed247e2d42dee62dbc1bd1ebe4ed51a3b2f8ace5c4af: Status 404 returned error can't find the container with id 9e97be04da329841ce08ed247e2d42dee62dbc1bd1ebe4ed51a3b2f8ace5c4af
Jul 15 15:36:15.777161 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.777047    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c5xml" event={"ID":"6fdde45b-3a66-404d-8787-84e6f3084714","Type":"ContainerStarted","Data":"63ab266a6ce213caca929e8f6389a341e3025470b05eaf3bee6e4adcf4dc5e63"}
Jul 15 15:36:15.778497 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.778469    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm" event={"ID":"d8885308-1313-405b-8a21-0ce34e5fb3a5","Type":"ContainerStarted","Data":"fa652a19d38668645767603f5ae2dfd74b7439d09fce5e0b3b25dc32a8180c65"}
Jul 15 15:36:15.778622 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.778512    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm" event={"ID":"d8885308-1313-405b-8a21-0ce34e5fb3a5","Type":"ContainerStarted","Data":"8ccd4c1d0d66e650f35e607f0f08cd674f050051ad8983bfc8d50b7524aee9bb"}
Jul 15 15:36:15.778622 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.778555    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:36:15.779516 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.779497    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ggmcc" event={"ID":"3c8a4344-4412-43ef-8c3a-160e358c4a9d","Type":"ContainerStarted","Data":"9e97be04da329841ce08ed247e2d42dee62dbc1bd1ebe4ed51a3b2f8ace5c4af"}
Jul 15 15:36:15.814835 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:15.814790    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm" podStartSLOduration=40.814775068 podStartE2EDuration="40.814775068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:15.814296136 +0000 UTC m=+53.223069326" watchObservedRunningTime="2026-07-15 15:36:15.814775068 +0000 UTC m=+53.223548258"
Jul 15 15:36:16.428381 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:16.428344    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:16.629144 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:16.629051    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:17.871894 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:17.871864    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:17.972221 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:17.972182    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:18.073397 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:18.073326    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:18.214666 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:18.214630    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:18.285798 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:18.285766    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:18.789302 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:18.789267    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c5xml" event={"ID":"6fdde45b-3a66-404d-8787-84e6f3084714","Type":"ContainerStarted","Data":"8b720758b1bb8c97ec1707b7a8d33ddd080d4a07c5e328e19166b2bf3fdc8d48"}
Jul 15 15:36:18.789483 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:18.789329    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c5xml" event={"ID":"6fdde45b-3a66-404d-8787-84e6f3084714","Type":"ContainerStarted","Data":"2edd4e5831d80f80d59e328351958fc0fbb5ae29f2ad780a446864673e9bff23"}
Jul 15 15:36:18.789483 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:18.789376    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c5xml"
Jul 15 15:36:18.811170 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:18.811115    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-c5xml" podStartSLOduration=17.676032426 podStartE2EDuration="19.811096714s" totalImagesPullingTime="2.135064288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:18.81016638 +0000 UTC m=+56.218939584" watchObservedRunningTime="2026-07-15 15:36:18.811096714 +0000 UTC m=+56.219869901"
Jul 15 15:36:19.008252 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:19.008212    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:19.209564 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:19.209461    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:19.608579 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:19.608106    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:19.717285 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:19.717256    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:21.720920 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.720885    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z"]
Jul 15 15:36:21.724248 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.724224    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z"
Jul 15 15:36:21.728982 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.728826    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 15:36:21.729329 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.729308    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 15:36:21.734426 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.733513    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 15:36:21.734426 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.733860    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 15:36:21.736236 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.736209    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7"]
Jul 15 15:36:21.739158 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.738832    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7"
Jul 15 15:36:21.744071 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.743618    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 15:36:21.744071 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.743895    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-kmgh5\""
Jul 15 15:36:21.744705 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.744643    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z"]
Jul 15 15:36:21.754801 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.754743    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7"]
Jul 15 15:36:21.764534 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.764509    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c5d89789c-8mxgm"]
Jul 15 15:36:21.799731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.799696    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ggmcc" event={"ID":"3c8a4344-4412-43ef-8c3a-160e358c4a9d","Type":"ContainerStarted","Data":"376d0156f5f1081d10aebb20235c6d65e37ff07e26f75216c2dafb02afecf0f0"}
Jul 15 15:36:21.835241 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.835213    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5946abc6-bad0-4ec1-9932-a361c7a7de95-klusterlet-config\") pod \"klusterlet-addon-workmgr-5fc888d89f-tg26z\" (UID: \"5946abc6-bad0-4ec1-9932-a361c7a7de95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z"
Jul 15 15:36:21.835424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.835249    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4tk2\" (UniqueName: \"kubernetes.io/projected/8ea27d41-ceb8-4644-b7f3-92bef812ef68-kube-api-access-s4tk2\") pod \"managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7\" (UID: \"8ea27d41-ceb8-4644-b7f3-92bef812ef68\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7"
Jul 15 15:36:21.835424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.835350    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ea27d41-ceb8-4644-b7f3-92bef812ef68-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7\" (UID: \"8ea27d41-ceb8-4644-b7f3-92bef812ef68\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7"
Jul 15 15:36:21.835424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.835377    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5946abc6-bad0-4ec1-9932-a361c7a7de95-tmp\") pod \"klusterlet-addon-workmgr-5fc888d89f-tg26z\" (UID: \"5946abc6-bad0-4ec1-9932-a361c7a7de95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z"
Jul 15 15:36:21.835424 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.835402    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7wmn\" (UniqueName: \"kubernetes.io/projected/5946abc6-bad0-4ec1-9932-a361c7a7de95-kube-api-access-f7wmn\") pod \"klusterlet-addon-workmgr-5fc888d89f-tg26z\" (UID: \"5946abc6-bad0-4ec1-9932-a361c7a7de95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z"
Jul 15 15:36:21.896777 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.896738    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"]
Jul 15 15:36:21.898641 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.898619    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:21.901416 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.901376    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:21.915910 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.915886    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"]
Jul 15 15:36:21.936174 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.936141    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ea27d41-ceb8-4644-b7f3-92bef812ef68-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7\" (UID: \"8ea27d41-ceb8-4644-b7f3-92bef812ef68\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7"
Jul 15 15:36:21.936174 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.936183    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5946abc6-bad0-4ec1-9932-a361c7a7de95-tmp\") pod \"klusterlet-addon-workmgr-5fc888d89f-tg26z\" (UID: \"5946abc6-bad0-4ec1-9932-a361c7a7de95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z"
Jul 15 15:36:21.936414 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.936320    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7wmn\" (UniqueName: \"kubernetes.io/projected/5946abc6-bad0-4ec1-9932-a361c7a7de95-kube-api-access-f7wmn\") pod \"klusterlet-addon-workmgr-5fc888d89f-tg26z\" (UID: \"5946abc6-bad0-4ec1-9932-a361c7a7de95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z"
Jul 15 15:36:21.936414 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.936409    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5946abc6-bad0-4ec1-9932-a361c7a7de95-klusterlet-config\") pod \"klusterlet-addon-workmgr-5fc888d89f-tg26z\" (UID: \"5946abc6-bad0-4ec1-9932-a361c7a7de95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z"
Jul 15 15:36:21.936520 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.936441    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4tk2\" (UniqueName: \"kubernetes.io/projected/8ea27d41-ceb8-4644-b7f3-92bef812ef68-kube-api-access-s4tk2\") pod \"managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7\" (UID: \"8ea27d41-ceb8-4644-b7f3-92bef812ef68\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7"
Jul 15 15:36:21.937313 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.936562    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5946abc6-bad0-4ec1-9932-a361c7a7de95-tmp\") pod \"klusterlet-addon-workmgr-5fc888d89f-tg26z\" (UID: \"5946abc6-bad0-4ec1-9932-a361c7a7de95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z"
Jul 15 15:36:21.939264 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.939239    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ea27d41-ceb8-4644-b7f3-92bef812ef68-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7\" (UID: \"8ea27d41-ceb8-4644-b7f3-92bef812ef68\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7"
Jul 15 15:36:21.941654 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.939985    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5946abc6-bad0-4ec1-9932-a361c7a7de95-klusterlet-config\") pod \"klusterlet-addon-workmgr-5fc888d89f-tg26z\" (UID: \"5946abc6-bad0-4ec1-9932-a361c7a7de95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z"
Jul 15 15:36:21.955839 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.955814    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7wmn\" (UniqueName: \"kubernetes.io/projected/5946abc6-bad0-4ec1-9932-a361c7a7de95-kube-api-access-f7wmn\") pod \"klusterlet-addon-workmgr-5fc888d89f-tg26z\" (UID: \"5946abc6-bad0-4ec1-9932-a361c7a7de95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z"
Jul 15 15:36:21.956285 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.956257    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4tk2\" (UniqueName: \"kubernetes.io/projected/8ea27d41-ceb8-4644-b7f3-92bef812ef68-kube-api-access-s4tk2\") pod \"managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7\" (UID: \"8ea27d41-ceb8-4644-b7f3-92bef812ef68\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7"
Jul 15 15:36:21.992125 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:21.992042    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:22.037583 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.037548    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded984a8-2d13-4dc2-97ac-72ee9f035b82-registry-tls\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.037749 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.037692    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ded984a8-2d13-4dc2-97ac-72ee9f035b82-bound-sa-token\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.037749 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.037728    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ded984a8-2d13-4dc2-97ac-72ee9f035b82-installation-pull-secrets\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.037900 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.037753    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ded984a8-2d13-4dc2-97ac-72ee9f035b82-registry-certificates\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.037900 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.037787    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szlvb\" (UniqueName: \"kubernetes.io/projected/ded984a8-2d13-4dc2-97ac-72ee9f035b82-kube-api-access-szlvb\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.038032 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.037904    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z"
Jul 15 15:36:22.038032 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.037978    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ded984a8-2d13-4dc2-97ac-72ee9f035b82-image-registry-private-configuration\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.038125 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.038051    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ded984a8-2d13-4dc2-97ac-72ee9f035b82-trusted-ca\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.038125 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.038084    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ded984a8-2d13-4dc2-97ac-72ee9f035b82-ca-trust-extracted\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.064115 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.064086    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7"
Jul 15 15:36:22.091633 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.091567    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:22.139544 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.139508    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szlvb\" (UniqueName: \"kubernetes.io/projected/ded984a8-2d13-4dc2-97ac-72ee9f035b82-kube-api-access-szlvb\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.139736 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.139575    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ded984a8-2d13-4dc2-97ac-72ee9f035b82-image-registry-private-configuration\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.139736 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.139605    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ded984a8-2d13-4dc2-97ac-72ee9f035b82-trusted-ca\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.139736 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.139634    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ded984a8-2d13-4dc2-97ac-72ee9f035b82-ca-trust-extracted\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.139736 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.139675    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded984a8-2d13-4dc2-97ac-72ee9f035b82-registry-tls\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.139736 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.139761    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ded984a8-2d13-4dc2-97ac-72ee9f035b82-bound-sa-token\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.140166 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.139789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ded984a8-2d13-4dc2-97ac-72ee9f035b82-installation-pull-secrets\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.140166 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.139818    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ded984a8-2d13-4dc2-97ac-72ee9f035b82-registry-certificates\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.140282 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.140216    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ded984a8-2d13-4dc2-97ac-72ee9f035b82-ca-trust-extracted\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.141437 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.141181    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ded984a8-2d13-4dc2-97ac-72ee9f035b82-registry-certificates\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.142144 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.142120    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ded984a8-2d13-4dc2-97ac-72ee9f035b82-trusted-ca\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.143936 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.143913    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ded984a8-2d13-4dc2-97ac-72ee9f035b82-installation-pull-secrets\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.144609 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.144350    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ded984a8-2d13-4dc2-97ac-72ee9f035b82-image-registry-private-configuration\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.145438 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.145388    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded984a8-2d13-4dc2-97ac-72ee9f035b82-registry-tls\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.166176 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.165989    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ded984a8-2d13-4dc2-97ac-72ee9f035b82-bound-sa-token\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.166770 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.166730    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szlvb\" (UniqueName: \"kubernetes.io/projected/ded984a8-2d13-4dc2-97ac-72ee9f035b82-kube-api-access-szlvb\") pod \"image-registry-6dd6b6ccfb-npjrm\" (UID: \"ded984a8-2d13-4dc2-97ac-72ee9f035b82\") " pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.208449 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.208393    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.210276 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.210246    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z"]
Jul 15 15:36:22.214795 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:22.214765    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5946abc6_bad0_4ec1_9932_a361c7a7de95.slice/crio-3dbcc50a7e5e30ce520eb5bdc878cbdd5722920071eeb4a37caf660abc457452 WatchSource:0}: Error finding container 3dbcc50a7e5e30ce520eb5bdc878cbdd5722920071eeb4a37caf660abc457452: Status 404 returned error can't find the container with id 3dbcc50a7e5e30ce520eb5bdc878cbdd5722920071eeb4a37caf660abc457452
Jul 15 15:36:22.215563 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.215454    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:22.233584 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.233515    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7"]
Jul 15 15:36:22.237612 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:22.237582    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ea27d41_ceb8_4644_b7f3_92bef812ef68.slice/crio-922740328bd5ae0af0282840672cf56aa9c49072f22cd02f81ae062f84e39643 WatchSource:0}: Error finding container 922740328bd5ae0af0282840672cf56aa9c49072f22cd02f81ae062f84e39643: Status 404 returned error can't find the container with id 922740328bd5ae0af0282840672cf56aa9c49072f22cd02f81ae062f84e39643
Jul 15 15:36:22.307813 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.307734    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:22.354189 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.354154    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"]
Jul 15 15:36:22.356825 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:22.356796    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded984a8_2d13_4dc2_97ac_72ee9f035b82.slice/crio-ea617ab72d8d6a596c60f9e716f7af9641cd0f20d065a38ff393cc0b63ce951f WatchSource:0}: Error finding container ea617ab72d8d6a596c60f9e716f7af9641cd0f20d065a38ff393cc0b63ce951f: Status 404 returned error can't find the container with id ea617ab72d8d6a596c60f9e716f7af9641cd0f20d065a38ff393cc0b63ce951f
Jul 15 15:36:22.804488 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.804453    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm" event={"ID":"ded984a8-2d13-4dc2-97ac-72ee9f035b82","Type":"ContainerStarted","Data":"0dd06d65976d768599b5cce64eebf2921a542827a7f1e223c881cef130862d90"}
Jul 15 15:36:22.804996 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.804508    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm" event={"ID":"ded984a8-2d13-4dc2-97ac-72ee9f035b82","Type":"ContainerStarted","Data":"ea617ab72d8d6a596c60f9e716f7af9641cd0f20d065a38ff393cc0b63ce951f"}
Jul 15 15:36:22.804996 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.804563    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:22.806013 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.805977    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z" event={"ID":"5946abc6-bad0-4ec1-9932-a361c7a7de95","Type":"ContainerStarted","Data":"3dbcc50a7e5e30ce520eb5bdc878cbdd5722920071eeb4a37caf660abc457452"}
Jul 15 15:36:22.807120 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.807096    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7" event={"ID":"8ea27d41-ceb8-4644-b7f3-92bef812ef68","Type":"ContainerStarted","Data":"922740328bd5ae0af0282840672cf56aa9c49072f22cd02f81ae062f84e39643"}
Jul 15 15:36:22.828961 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:22.828895    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm" podStartSLOduration=1.82887347 podStartE2EDuration="1.82887347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:22.827440313 +0000 UTC m=+60.236213504" watchObservedRunningTime="2026-07-15 15:36:22.82887347 +0000 UTC m=+60.237646661"
Jul 15 15:36:24.462495 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:24.462460    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:24.535692 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:24.535647    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:24.628325 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:24.628282    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:24.716084 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:24.716019    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:25.466764 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:25.466728    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:25.571640 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:25.571601    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:25.728812 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:25.728733    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqdzr"
Jul 15 15:36:25.821335 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:25.821293    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ggmcc" event={"ID":"3c8a4344-4412-43ef-8c3a-160e358c4a9d","Type":"ContainerStarted","Data":"07ff9367bb8bdd0e321d588731e4964b06463790c8cc3bd5d980418838e94021"}
Jul 15 15:36:25.841901 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:25.841865    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:26.045885 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:26.045810    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:26.623996 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:26.623961    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:26.706992 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:26.706938    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:26.993994 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:26.993903    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:27.822441 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:27.822402    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:28.794832 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:28.794804    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c5xml"
Jul 15 15:36:28.833984 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:28.833932    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z" event={"ID":"5946abc6-bad0-4ec1-9932-a361c7a7de95","Type":"ContainerStarted","Data":"b8ef38d7fca1cbe6cd15085ffd020f23b43c9d1a85d30239f73d3de23a06779c"}
Jul 15 15:36:28.834443 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:28.834422    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z"
Jul 15 15:36:28.835938 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:28.835832    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7" event={"ID":"8ea27d41-ceb8-4644-b7f3-92bef812ef68","Type":"ContainerStarted","Data":"d89f201ed3a1afbd5051e68000df358a38fe5a914787297cc9ab7df215f20af5"}
Jul 15 15:36:28.836073 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:28.835942    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z"
Jul 15 15:36:28.852614 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:28.852568    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fc888d89f-tg26z" podStartSLOduration=2.131187989 podStartE2EDuration="7.852553062s" totalImagesPullingTime="5.721365073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:28.851568214 +0000 UTC m=+66.260341451" watchObservedRunningTime="2026-07-15 15:36:28.852553062 +0000 UTC m=+66.261326252"
Jul 15 15:36:28.890898 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:28.890827    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54cffd6ddd-6dqn7" podStartSLOduration=2.204100513 podStartE2EDuration="7.890809677s" totalImagesPullingTime="5.686709164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:28.889897125 +0000 UTC m=+66.298670340" watchObservedRunningTime="2026-07-15 15:36:28.890809677 +0000 UTC m=+66.299582867"
Jul 15 15:36:28.895382 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:28.895068    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:28.996187 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:28.996142    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret\") pod \"global-pull-secret-syncer-tts5k\" (UID: \"b0b6ce0e-c412-48dd-a538-19e92a2910ed\") " pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:36:28.996361 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:28.996225    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs\") pod \"network-metrics-daemon-5jk56\" (UID: \"1c2e9a13-471e-478c-b38e-6748dc7ede63\") " pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:36:28.999168 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:28.999138    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 15:36:28.999168 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:28.999161    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 15:36:28.999807 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:28.999786    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:29.009185 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:29.009161    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c2e9a13-471e-478c-b38e-6748dc7ede63-metrics-certs\") pod \"network-metrics-daemon-5jk56\" (UID: \"1c2e9a13-471e-478c-b38e-6748dc7ede63\") " pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:36:29.009526 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:29.009508    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0b6ce0e-c412-48dd-a538-19e92a2910ed-original-pull-secret\") pod \"global-pull-secret-syncer-tts5k\" (UID: \"b0b6ce0e-c412-48dd-a538-19e92a2910ed\") " pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:36:29.097621 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:29.097542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9d9x\" (UniqueName: \"kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x\") pod \"network-check-target-m5gdn\" (UID: \"be1ab9a0-8cba-4834-a20c-a36d2117c38c\") " pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:36:29.100385 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:29.100363    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 15:36:29.111021 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:29.110998    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 15:36:29.122129 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:29.122094    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9d9x\" (UniqueName: \"kubernetes.io/projected/be1ab9a0-8cba-4834-a20c-a36d2117c38c-kube-api-access-l9d9x\") pod \"network-check-target-m5gdn\" (UID: \"be1ab9a0-8cba-4834-a20c-a36d2117c38c\") " pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:36:29.296876 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:29.296845    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-89d92\""
Jul 15 15:36:29.302121 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:29.302094    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tts5k"
Jul 15 15:36:29.305224 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:29.305195    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jk56"
Jul 15 15:36:29.309674 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:29.309655    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xhclp\""
Jul 15 15:36:29.318421 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:29.318341    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:36:29.419488 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:29.419407    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:29.511414 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:29.511373    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:29.649464 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:29.649425    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:29.886330 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:29.886279    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:29.931224 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:29.931190    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tts5k"]
Jul 15 15:36:29.934372 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:29.934347    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b6ce0e_c412_48dd_a538_19e92a2910ed.slice/crio-03a27dd5f2686f926eb894ef48b4963ec89b01fbfc00e8c8d0bfa52bcbd433f1 WatchSource:0}: Error finding container 03a27dd5f2686f926eb894ef48b4963ec89b01fbfc00e8c8d0bfa52bcbd433f1: Status 404 returned error can't find the container with id 03a27dd5f2686f926eb894ef48b4963ec89b01fbfc00e8c8d0bfa52bcbd433f1
Jul 15 15:36:30.136049 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:30.136022    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m5gdn"]
Jul 15 15:36:30.138738 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:30.138704    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe1ab9a0_8cba_4834_a20c_a36d2117c38c.slice/crio-2772c80b0acb729dc55e92f95dced43079ea0356925698b2208ddfc043f35d7d WatchSource:0}: Error finding container 2772c80b0acb729dc55e92f95dced43079ea0356925698b2208ddfc043f35d7d: Status 404 returned error can't find the container with id 2772c80b0acb729dc55e92f95dced43079ea0356925698b2208ddfc043f35d7d
Jul 15 15:36:30.139788 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:30.139770    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5jk56"]
Jul 15 15:36:30.141794 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:30.141691    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c2e9a13_471e_478c_b38e_6748dc7ede63.slice/crio-d8ebbc1477c6f261092610ae1adef71b41ad55c7a78d7336da1d19441900c960 WatchSource:0}: Error finding container d8ebbc1477c6f261092610ae1adef71b41ad55c7a78d7336da1d19441900c960: Status 404 returned error can't find the container with id d8ebbc1477c6f261092610ae1adef71b41ad55c7a78d7336da1d19441900c960
Jul 15 15:36:30.237742 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:30.237706    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:30.301066 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:30.301020    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:30.847765 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:30.847731    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ggmcc" event={"ID":"3c8a4344-4412-43ef-8c3a-160e358c4a9d","Type":"ContainerStarted","Data":"2e3ce6a496ea051de14be2a9a1cbcd1cbebd8fa757e8ec6b6e375fea4c601967"}
Jul 15 15:36:30.848983 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:30.848933    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m5gdn" event={"ID":"be1ab9a0-8cba-4834-a20c-a36d2117c38c","Type":"ContainerStarted","Data":"2772c80b0acb729dc55e92f95dced43079ea0356925698b2208ddfc043f35d7d"}
Jul 15 15:36:30.850197 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:30.850169    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5jk56" event={"ID":"1c2e9a13-471e-478c-b38e-6748dc7ede63","Type":"ContainerStarted","Data":"d8ebbc1477c6f261092610ae1adef71b41ad55c7a78d7336da1d19441900c960"}
Jul 15 15:36:30.851346 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:30.851325    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tts5k" event={"ID":"b0b6ce0e-c412-48dd-a538-19e92a2910ed","Type":"ContainerStarted","Data":"03a27dd5f2686f926eb894ef48b4963ec89b01fbfc00e8c8d0bfa52bcbd433f1"}
Jul 15 15:36:30.877527 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:30.877474    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ggmcc" podStartSLOduration=17.920881436 podStartE2EDuration="31.87745654s" totalImagesPullingTime="13.956575104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:30.876217066 +0000 UTC m=+68.284990285" watchObservedRunningTime="2026-07-15 15:36:30.87745654 +0000 UTC m=+68.286229743"
Jul 15 15:36:31.771231 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:31.771187    2583 patch_prober.go:28] interesting pod/image-registry-6c5d89789c-8mxgm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 15:36:31.771729 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:31.771255    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm" podUID="d8885308-1313-405b-8a21-0ce34e5fb3a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 15:36:31.859123 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:31.858981    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5jk56" event={"ID":"1c2e9a13-471e-478c-b38e-6748dc7ede63","Type":"ContainerStarted","Data":"47c825b2258658cfe68b069a1031c0b9b4f0e1249b5659e8f8e1676167e1eb6c"}
Jul 15 15:36:31.859123 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:31.859048    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5jk56" event={"ID":"1c2e9a13-471e-478c-b38e-6748dc7ede63","Type":"ContainerStarted","Data":"83a7aceb14bcc1129a245cbe063ffd14d294a6b0bd6211ef1af9cbcf4fed03e5"}
Jul 15 15:36:31.970501 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:31.970465    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:32.071020 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:32.070913    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:32.131449 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:32.131414    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:32.517450 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:32.517408    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:32.618462 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:32.618412    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:33.889278 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:33.889237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:33.953254 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:33.953218    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:35.875990 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:35.875931    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tts5k" event={"ID":"b0b6ce0e-c412-48dd-a538-19e92a2910ed","Type":"ContainerStarted","Data":"9fbbcedeadd0c081b0ee43e109c281190ad552d96f2ba6f8bc967c6e5671ee47"}
Jul 15 15:36:35.877556 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:35.877525    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m5gdn" event={"ID":"be1ab9a0-8cba-4834-a20c-a36d2117c38c","Type":"ContainerStarted","Data":"778411edacba28d7de295b6b9552dbbc0b3877b6c26caf47beb6d98a71d7f988"}
Jul 15 15:36:35.877728 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:35.877581    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:36:35.898942 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:35.898843    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tts5k" podStartSLOduration=67.193119239 podStartE2EDuration="1m12.898824835s" totalImagesPullingTime="5.705705596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:35.898117735 +0000 UTC m=+73.306890946" watchObservedRunningTime="2026-07-15 15:36:35.898824835 +0000 UTC m=+73.307598025"
Jul 15 15:36:35.899128 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:35.899075    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5jk56" podStartSLOduration=72.034294432 podStartE2EDuration="1m12.899065454s" totalImagesPullingTime="864.771022ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:31.879740075 +0000 UTC m=+69.288513286" watchObservedRunningTime="2026-07-15 15:36:35.899065454 +0000 UTC m=+73.307838644"
Jul 15 15:36:35.916720 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:35.916673    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m5gdn" podStartSLOduration=67.416134688 podStartE2EDuration="1m12.916658717s" totalImagesPullingTime="5.500524029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:35.915841593 +0000 UTC m=+73.324614784" watchObservedRunningTime="2026-07-15 15:36:35.916658717 +0000 UTC m=+73.325431943"
Jul 15 15:36:37.944358 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:37.944322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:38.043850 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:38.043815    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:38.507133 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:38.507098    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:38.662875 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:38.662839    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:38.771826 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:38.771754    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:41.589582 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:41.589542    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:41.689808 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:41.689775    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:41.769325 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:41.769301    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:36:43.816358 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:43.816333    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6dd6b6ccfb-npjrm"
Jul 15 15:36:43.975063 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:43.975028    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:44.077023 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:44.076928    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:44.179986 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:44.179915    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:44.307173 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:44.307141    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:44.390781 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:44.390701    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:46.604996 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:46.604940    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:46.708759 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:46.708714    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:46.788802 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:46.788757    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm" podUID="d8885308-1313-405b-8a21-0ce34e5fb3a5" containerName="registry" containerID="cri-o://fa652a19d38668645767603f5ae2dfd74b7439d09fce5e0b3b25dc32a8180c65" gracePeriod=30
Jul 15 15:36:46.907811 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:46.907786    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:46.913583 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:46.913560    2583 generic.go:356] "Generic (PLEG): container finished" podID="d8885308-1313-405b-8a21-0ce34e5fb3a5" containerID="fa652a19d38668645767603f5ae2dfd74b7439d09fce5e0b3b25dc32a8180c65" exitCode=0
Jul 15 15:36:46.913697 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:46.913595    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm" event={"ID":"d8885308-1313-405b-8a21-0ce34e5fb3a5","Type":"ContainerDied","Data":"fa652a19d38668645767603f5ae2dfd74b7439d09fce5e0b3b25dc32a8180c65"}
Jul 15 15:36:47.025192 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.025151    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:36:47.131055 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.131023    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8885308-1313-405b-8a21-0ce34e5fb3a5-installation-pull-secrets\") pod \"d8885308-1313-405b-8a21-0ce34e5fb3a5\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") "
Jul 15 15:36:47.131055 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.131058    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8885308-1313-405b-8a21-0ce34e5fb3a5-image-registry-private-configuration\") pod \"d8885308-1313-405b-8a21-0ce34e5fb3a5\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") "
Jul 15 15:36:47.131290 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.131099    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8885308-1313-405b-8a21-0ce34e5fb3a5-trusted-ca\") pod \"d8885308-1313-405b-8a21-0ce34e5fb3a5\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") "
Jul 15 15:36:47.131290 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.131129    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf9kc\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-kube-api-access-wf9kc\") pod \"d8885308-1313-405b-8a21-0ce34e5fb3a5\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") "
Jul 15 15:36:47.131290 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.131161    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8885308-1313-405b-8a21-0ce34e5fb3a5-ca-trust-extracted\") pod \"d8885308-1313-405b-8a21-0ce34e5fb3a5\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") "
Jul 15 15:36:47.131290 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.131176    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-bound-sa-token\") pod \"d8885308-1313-405b-8a21-0ce34e5fb3a5\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") "
Jul 15 15:36:47.131290 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.131203    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-certificates\") pod \"d8885308-1313-405b-8a21-0ce34e5fb3a5\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") "
Jul 15 15:36:47.131290 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.131241    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls\") pod \"d8885308-1313-405b-8a21-0ce34e5fb3a5\" (UID: \"d8885308-1313-405b-8a21-0ce34e5fb3a5\") "
Jul 15 15:36:47.131752 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.131640    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8885308-1313-405b-8a21-0ce34e5fb3a5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d8885308-1313-405b-8a21-0ce34e5fb3a5" (UID: "d8885308-1313-405b-8a21-0ce34e5fb3a5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:36:47.131752 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.131697    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d8885308-1313-405b-8a21-0ce34e5fb3a5" (UID: "d8885308-1313-405b-8a21-0ce34e5fb3a5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:36:47.133676 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.133648    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8885308-1313-405b-8a21-0ce34e5fb3a5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d8885308-1313-405b-8a21-0ce34e5fb3a5" (UID: "d8885308-1313-405b-8a21-0ce34e5fb3a5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:36:47.133788 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.133736    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8885308-1313-405b-8a21-0ce34e5fb3a5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d8885308-1313-405b-8a21-0ce34e5fb3a5" (UID: "d8885308-1313-405b-8a21-0ce34e5fb3a5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:36:47.133976 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.133927    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d8885308-1313-405b-8a21-0ce34e5fb3a5" (UID: "d8885308-1313-405b-8a21-0ce34e5fb3a5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:36:47.134063 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.134006    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-kube-api-access-wf9kc" (OuterVolumeSpecName: "kube-api-access-wf9kc") pod "d8885308-1313-405b-8a21-0ce34e5fb3a5" (UID: "d8885308-1313-405b-8a21-0ce34e5fb3a5"). InnerVolumeSpecName "kube-api-access-wf9kc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:36:47.134295 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.134280    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d8885308-1313-405b-8a21-0ce34e5fb3a5" (UID: "d8885308-1313-405b-8a21-0ce34e5fb3a5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:36:47.140279 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.140249    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8885308-1313-405b-8a21-0ce34e5fb3a5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d8885308-1313-405b-8a21-0ce34e5fb3a5" (UID: "d8885308-1313-405b-8a21-0ce34e5fb3a5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:36:47.232270 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.232235    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-tls\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 15:36:47.232270 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.232268    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8885308-1313-405b-8a21-0ce34e5fb3a5-installation-pull-secrets\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 15:36:47.232467 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.232284    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8885308-1313-405b-8a21-0ce34e5fb3a5-image-registry-private-configuration\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 15:36:47.232467 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.232297    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8885308-1313-405b-8a21-0ce34e5fb3a5-trusted-ca\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 15:36:47.232467 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.232308    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf9kc\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-kube-api-access-wf9kc\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 15:36:47.232467 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.232318    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8885308-1313-405b-8a21-0ce34e5fb3a5-ca-trust-extracted\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 15:36:47.232467 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.232329    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8885308-1313-405b-8a21-0ce34e5fb3a5-bound-sa-token\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 15:36:47.232467 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.232339    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8885308-1313-405b-8a21-0ce34e5fb3a5-registry-certificates\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 15:36:47.350636 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.350600    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:47.451572 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.451540    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:47.918341 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.918269    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm"
Jul 15 15:36:47.918341 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.918274    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5d89789c-8mxgm" event={"ID":"d8885308-1313-405b-8a21-0ce34e5fb3a5","Type":"ContainerDied","Data":"8ccd4c1d0d66e650f35e607f0f08cd674f050051ad8983bfc8d50b7524aee9bb"}
Jul 15 15:36:47.918341 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.918336    2583 scope.go:117] "RemoveContainer" containerID="fa652a19d38668645767603f5ae2dfd74b7439d09fce5e0b3b25dc32a8180c65"
Jul 15 15:36:47.937537 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.937514    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c5d89789c-8mxgm"]
Jul 15 15:36:47.942452 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:47.942427    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6c5d89789c-8mxgm"]
Jul 15 15:36:48.126378 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:48.126329    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:49.539162 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:49.539132    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:49.583219 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:49.583191    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8885308-1313-405b-8a21-0ce34e5fb3a5" path="/var/lib/kubelet/pods/d8885308-1313-405b-8a21-0ce34e5fb3a5/volumes"
Jul 15 15:36:49.605030 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:49.605002    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:50.532664 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:50.532638    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:52.782121 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:52.782083    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:52.878585 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:52.878554    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:52.990630 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:52.990597    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:53.058499 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.058412    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"]
Jul 15 15:36:53.058702 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.058687    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8885308-1313-405b-8a21-0ce34e5fb3a5" containerName="registry"
Jul 15 15:36:53.058770 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.058705    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8885308-1313-405b-8a21-0ce34e5fb3a5" containerName="registry"
Jul 15 15:36:53.058770 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.058764    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8885308-1313-405b-8a21-0ce34e5fb3a5" containerName="registry"
Jul 15 15:36:53.097932 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.097898    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:53.189730 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.189697    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:53.223304 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.223267    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"]
Jul 15 15:36:53.223450 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.223321    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"]
Jul 15 15:36:53.223450 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.223404    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"
Jul 15 15:36:53.226314 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.226234    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-h5td4\""
Jul 15 15:36:53.226314 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.226233    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 15:36:53.226314 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.226262    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 15 15:36:53.226314 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.226267    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 15 15:36:53.226314 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.226295    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 15:36:53.226625 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.226233    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 15:36:53.248162 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.248136    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6bbd8"]
Jul 15 15:36:53.248284 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.248262    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.255168 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.255151    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 15 15:36:53.255446 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.255429    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 15 15:36:53.255496 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.255435    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 15 15:36:53.255496 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.255483    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hpr7c\""
Jul 15 15:36:53.272419 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.272387    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"]
Jul 15 15:36:53.272539 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.272503    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.274779 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.274756    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac3ed45f-5acf-4546-9912-f2284022f3fc-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-rznwg\" (UID: \"ac3ed45f-5acf-4546-9912-f2284022f3fc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"
Jul 15 15:36:53.274887 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.274795    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac3ed45f-5acf-4546-9912-f2284022f3fc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-rznwg\" (UID: \"ac3ed45f-5acf-4546-9912-f2284022f3fc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"
Jul 15 15:36:53.274887 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.274813    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4l58\" (UniqueName: \"kubernetes.io/projected/ac3ed45f-5acf-4546-9912-f2284022f3fc-kube-api-access-f4l58\") pod \"openshift-state-metrics-84bd68b896-rznwg\" (UID: \"ac3ed45f-5acf-4546-9912-f2284022f3fc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"
Jul 15 15:36:53.274991 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.274885    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac3ed45f-5acf-4546-9912-f2284022f3fc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-rznwg\" (UID: \"ac3ed45f-5acf-4546-9912-f2284022f3fc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"
Jul 15 15:36:53.275390 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.275377    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 15:36:53.275829 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.275813    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kf856\""
Jul 15 15:36:53.275891 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.275876    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 15:36:53.276150 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.276133    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 15:36:53.307618 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.307593    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:53.375773 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.375702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac3ed45f-5acf-4546-9912-f2284022f3fc-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-rznwg\" (UID: \"ac3ed45f-5acf-4546-9912-f2284022f3fc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"
Jul 15 15:36:53.375773 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.375747    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7c67569-2b3b-4d5a-a157-916b5402240f-node-exporter-wtmp\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.375773 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.375775    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7c67569-2b3b-4d5a-a157-916b5402240f-node-exporter-textfile\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.376068 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.375808    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.376068 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.375847    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac3ed45f-5acf-4546-9912-f2284022f3fc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-rznwg\" (UID: \"ac3ed45f-5acf-4546-9912-f2284022f3fc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"
Jul 15 15:36:53.376068 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.375893    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4l58\" (UniqueName: \"kubernetes.io/projected/ac3ed45f-5acf-4546-9912-f2284022f3fc-kube-api-access-f4l58\") pod \"openshift-state-metrics-84bd68b896-rznwg\" (UID: \"ac3ed45f-5acf-4546-9912-f2284022f3fc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"
Jul 15 15:36:53.376068 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.375936    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7c67569-2b3b-4d5a-a157-916b5402240f-node-exporter-tls\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.376068 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.375993    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7c67569-2b3b-4d5a-a157-916b5402240f-root\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.376068 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.376040    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7c67569-2b3b-4d5a-a157-916b5402240f-metrics-client-ca\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.376359 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.376071    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.376359 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.376101    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.376359 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.376163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.376359 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.376195    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac3ed45f-5acf-4546-9912-f2284022f3fc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-rznwg\" (UID: \"ac3ed45f-5acf-4546-9912-f2284022f3fc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"
Jul 15 15:36:53.376359 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.376256    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.376359 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:53.376276    2583 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 15 15:36:53.376359 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.376285    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4444\" (UniqueName: \"kubernetes.io/projected/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-kube-api-access-j4444\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.376359 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.376324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7c67569-2b3b-4d5a-a157-916b5402240f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.376359 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:53.376342    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac3ed45f-5acf-4546-9912-f2284022f3fc-openshift-state-metrics-tls podName:ac3ed45f-5acf-4546-9912-f2284022f3fc nodeName:}" failed. No retries permitted until 2026-07-15 15:36:53.876322414 +0000 UTC m=+91.285095587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ac3ed45f-5acf-4546-9912-f2284022f3fc-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-rznwg" (UID: "ac3ed45f-5acf-4546-9912-f2284022f3fc") : secret "openshift-state-metrics-tls" not found
Jul 15 15:36:53.376716 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.376387    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7c67569-2b3b-4d5a-a157-916b5402240f-node-exporter-accelerators-collector-config\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.376716 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.376424    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7c67569-2b3b-4d5a-a157-916b5402240f-sys\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.376716 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.376442    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac3ed45f-5acf-4546-9912-f2284022f3fc-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-rznwg\" (UID: \"ac3ed45f-5acf-4546-9912-f2284022f3fc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"
Jul 15 15:36:53.376716 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.376448    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdwjh\" (UniqueName: \"kubernetes.io/projected/d7c67569-2b3b-4d5a-a157-916b5402240f-kube-api-access-qdwjh\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.378466 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.378437    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac3ed45f-5acf-4546-9912-f2284022f3fc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-rznwg\" (UID: \"ac3ed45f-5acf-4546-9912-f2284022f3fc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"
Jul 15 15:36:53.388344 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.388322    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4l58\" (UniqueName: \"kubernetes.io/projected/ac3ed45f-5acf-4546-9912-f2284022f3fc-kube-api-access-f4l58\") pod \"openshift-state-metrics-84bd68b896-rznwg\" (UID: \"ac3ed45f-5acf-4546-9912-f2284022f3fc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"
Jul 15 15:36:53.400870 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.400850    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:53.477038 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477008    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.477038 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477039    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4444\" (UniqueName: \"kubernetes.io/projected/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-kube-api-access-j4444\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.477324 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477065    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7c67569-2b3b-4d5a-a157-916b5402240f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.477324 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477089    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7c67569-2b3b-4d5a-a157-916b5402240f-node-exporter-accelerators-collector-config\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.477324 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477121    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7c67569-2b3b-4d5a-a157-916b5402240f-sys\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.477324 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477195    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7c67569-2b3b-4d5a-a157-916b5402240f-sys\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.477324 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477249    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdwjh\" (UniqueName: \"kubernetes.io/projected/d7c67569-2b3b-4d5a-a157-916b5402240f-kube-api-access-qdwjh\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.477324 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477295    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7c67569-2b3b-4d5a-a157-916b5402240f-node-exporter-wtmp\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.477630 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477328    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7c67569-2b3b-4d5a-a157-916b5402240f-node-exporter-textfile\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.477630 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477364    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.477630 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477420    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7c67569-2b3b-4d5a-a157-916b5402240f-node-exporter-tls\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.477630 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477485    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.477630 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477489    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7c67569-2b3b-4d5a-a157-916b5402240f-root\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.477630 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477554    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7c67569-2b3b-4d5a-a157-916b5402240f-metrics-client-ca\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.477630 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477584    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7c67569-2b3b-4d5a-a157-916b5402240f-node-exporter-wtmp\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.477630 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477590    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.477630 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477632    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7c67569-2b3b-4d5a-a157-916b5402240f-node-exporter-textfile\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.478085 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477643    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.478085 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:53.477659    2583 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 15 15:36:53.478085 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477692    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.478085 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:36:53.477722    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-kube-state-metrics-tls podName:b4b3e841-bbf8-402a-a3b4-b88fea12aad5 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:53.977704506 +0000 UTC m=+91.386477689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-h5qbj" (UID: "b4b3e841-bbf8-402a-a3b4-b88fea12aad5") : secret "kube-state-metrics-tls" not found
Jul 15 15:36:53.478085 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477822    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7c67569-2b3b-4d5a-a157-916b5402240f-node-exporter-accelerators-collector-config\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.478085 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.477936    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7c67569-2b3b-4d5a-a157-916b5402240f-root\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.478404 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.478086    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.478404 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.478144    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7c67569-2b3b-4d5a-a157-916b5402240f-metrics-client-ca\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.478404 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.478297    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.479714 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.479687    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7c67569-2b3b-4d5a-a157-916b5402240f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.479886 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.479865    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7c67569-2b3b-4d5a-a157-916b5402240f-node-exporter-tls\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.480193 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.480175    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.486546 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.486518    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdwjh\" (UniqueName: \"kubernetes.io/projected/d7c67569-2b3b-4d5a-a157-916b5402240f-kube-api-access-qdwjh\") pod \"node-exporter-6bbd8\" (UID: \"d7c67569-2b3b-4d5a-a157-916b5402240f\") " pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.487288 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.487264    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4444\" (UniqueName: \"kubernetes.io/projected/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-kube-api-access-j4444\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.500276 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.500229    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:53.580330 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.580299    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6bbd8"
Jul 15 15:36:53.599533 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:53.599509    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c67569_2b3b_4d5a_a157_916b5402240f.slice/crio-a480fabdb0ae5e319185ec858e91fb7f3cc04ca515d9e03a0d7585a7f9d0bd4b WatchSource:0}: Error finding container a480fabdb0ae5e319185ec858e91fb7f3cc04ca515d9e03a0d7585a7f9d0bd4b: Status 404 returned error can't find the container with id a480fabdb0ae5e319185ec858e91fb7f3cc04ca515d9e03a0d7585a7f9d0bd4b
Jul 15 15:36:53.601298 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.601271    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:53.722929 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.722902    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:53.881780 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.881737    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac3ed45f-5acf-4546-9912-f2284022f3fc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-rznwg\" (UID: \"ac3ed45f-5acf-4546-9912-f2284022f3fc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"
Jul 15 15:36:53.884048 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.884017    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac3ed45f-5acf-4546-9912-f2284022f3fc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-rznwg\" (UID: \"ac3ed45f-5acf-4546-9912-f2284022f3fc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"
Jul 15 15:36:53.939779 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.939750    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6bbd8" event={"ID":"d7c67569-2b3b-4d5a-a157-916b5402240f","Type":"ContainerStarted","Data":"a480fabdb0ae5e319185ec858e91fb7f3cc04ca515d9e03a0d7585a7f9d0bd4b"}
Jul 15 15:36:53.982406 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.982313    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:53.984671 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:53.984646    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4b3e841-bbf8-402a-a3b4-b88fea12aad5-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-h5qbj\" (UID: \"b4b3e841-bbf8-402a-a3b4-b88fea12aad5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:54.024707 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:54.024647    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:54.132112 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:54.132079    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"
Jul 15 15:36:54.157009 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:54.156913    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"
Jul 15 15:36:54.181759 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:54.181624    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:54.344494 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:54.344458    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg"]
Jul 15 15:36:54.346321 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:54.346298    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac3ed45f_5acf_4546_9912_f2284022f3fc.slice/crio-ab49ff2fa3dce57dcec1cb018764b55022c0050f987dcc15f78f101f850415a1 WatchSource:0}: Error finding container ab49ff2fa3dce57dcec1cb018764b55022c0050f987dcc15f78f101f850415a1: Status 404 returned error can't find the container with id ab49ff2fa3dce57dcec1cb018764b55022c0050f987dcc15f78f101f850415a1
Jul 15 15:36:54.367685 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:54.367653    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-h5qbj"]
Jul 15 15:36:54.370755 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:54.370727    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b3e841_bbf8_402a_a3b4_b88fea12aad5.slice/crio-8b6ef6eae227ecedb6bc568d2f2e41039109096d2d849f143259c84aaba18d88 WatchSource:0}: Error finding container 8b6ef6eae227ecedb6bc568d2f2e41039109096d2d849f143259c84aaba18d88: Status 404 returned error can't find the container with id 8b6ef6eae227ecedb6bc568d2f2e41039109096d2d849f143259c84aaba18d88
Jul 15 15:36:54.470351 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:54.470318    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:54.945216 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:54.945156    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg" event={"ID":"ac3ed45f-5acf-4546-9912-f2284022f3fc","Type":"ContainerStarted","Data":"a24fccf01d735620cab461ccd191374d4a13f4dc164f27f7d9132eea67dc8a28"}
Jul 15 15:36:54.945643 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:54.945241    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg" event={"ID":"ac3ed45f-5acf-4546-9912-f2284022f3fc","Type":"ContainerStarted","Data":"e207b647107d031eff3cce8a5c0ad66f2fef007158a732e339484fde8b3b7896"}
Jul 15 15:36:54.945643 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:54.945271    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg" event={"ID":"ac3ed45f-5acf-4546-9912-f2284022f3fc","Type":"ContainerStarted","Data":"ab49ff2fa3dce57dcec1cb018764b55022c0050f987dcc15f78f101f850415a1"}
Jul 15 15:36:54.946293 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:54.946269    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj" event={"ID":"b4b3e841-bbf8-402a-a3b4-b88fea12aad5","Type":"ContainerStarted","Data":"8b6ef6eae227ecedb6bc568d2f2e41039109096d2d849f143259c84aaba18d88"}
Jul 15 15:36:55.231509 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:55.231343    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:55.336837 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:55.336810    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:55.435694 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:55.435663    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:55.951728 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:55.951693    2583 generic.go:356] "Generic (PLEG): container finished" podID="d7c67569-2b3b-4d5a-a157-916b5402240f" containerID="833435d9ce5798baa279531b422e831114a7c178c91a5a5457ba789a76604c0d" exitCode=0
Jul 15 15:36:55.952156 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:55.951763    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6bbd8" event={"ID":"d7c67569-2b3b-4d5a-a157-916b5402240f","Type":"ContainerDied","Data":"833435d9ce5798baa279531b422e831114a7c178c91a5a5457ba789a76604c0d"}
Jul 15 15:36:56.121648 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.121618    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"]
Jul 15 15:36:56.146653 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.146626    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"]
Jul 15 15:36:56.146807 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.146706    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.149361 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.149341    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 15 15:36:56.149502 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.149348    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 15 15:36:56.149573 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.149541    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1ldjsvsk9grms\""
Jul 15 15:36:56.149683 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.149667    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 15 15:36:56.149756 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.149710    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 15 15:36:56.149811 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.149757    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tjfvf\""
Jul 15 15:36:56.149990 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.149974    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 15 15:36:56.201868 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.201789    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/732570c5-caf8-4854-8a18-50afa143b9b1-metrics-client-ca\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.201868 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.201837    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzhlj\" (UniqueName: \"kubernetes.io/projected/732570c5-caf8-4854-8a18-50afa143b9b1-kube-api-access-rzhlj\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.201868 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.201858    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-grpc-tls\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.202142 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.201934    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.202142 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.202007    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.202142 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.202030    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.202142 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.202050    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.202142 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.202077    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-thanos-querier-tls\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.303313 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.303274    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-thanos-querier-tls\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.303492 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.303318    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/732570c5-caf8-4854-8a18-50afa143b9b1-metrics-client-ca\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.303492 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.303363    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzhlj\" (UniqueName: \"kubernetes.io/projected/732570c5-caf8-4854-8a18-50afa143b9b1-kube-api-access-rzhlj\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.303492 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.303390    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-grpc-tls\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.303492 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.303421    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.303492 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.303449    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.303492 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.303478    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.303789 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.303625    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.304276 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.304251    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/732570c5-caf8-4854-8a18-50afa143b9b1-metrics-client-ca\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.306370 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.306316    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.306522 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.306475    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-grpc-tls\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.306522 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.306483    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.306522 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.306501    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-thanos-querier-tls\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.306638 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.306501    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.306638 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.306575    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/732570c5-caf8-4854-8a18-50afa143b9b1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.312029 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.312007    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzhlj\" (UniqueName: \"kubernetes.io/projected/732570c5-caf8-4854-8a18-50afa143b9b1-kube-api-access-rzhlj\") pod \"thanos-querier-6d5bbf459-mlsj9\" (UID: \"732570c5-caf8-4854-8a18-50afa143b9b1\") " pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.455487 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.455425    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:36:56.650668 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.650186    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"]
Jul 15 15:36:56.652798 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:56.652774    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod732570c5_caf8_4854_8a18_50afa143b9b1.slice/crio-5b57f94bf616601bb349abc39d56a895cdfb2e0f08c907dda96a1d199ef8da9f WatchSource:0}: Error finding container 5b57f94bf616601bb349abc39d56a895cdfb2e0f08c907dda96a1d199ef8da9f: Status 404 returned error can't find the container with id 5b57f94bf616601bb349abc39d56a895cdfb2e0f08c907dda96a1d199ef8da9f
Jul 15 15:36:56.958249 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.958159    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6bbd8" event={"ID":"d7c67569-2b3b-4d5a-a157-916b5402240f","Type":"ContainerStarted","Data":"ac71772e0ee13b050d6f2878605abd94e5abd7bfd4030ac55bc678dbb98637ff"}
Jul 15 15:36:56.958249 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.958218    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6bbd8" event={"ID":"d7c67569-2b3b-4d5a-a157-916b5402240f","Type":"ContainerStarted","Data":"146879cd6e4c921fa1249a34a516d9c5de481258ca2d8728744b3ec510a024ad"}
Jul 15 15:36:56.959461 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.959432    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9" event={"ID":"732570c5-caf8-4854-8a18-50afa143b9b1","Type":"ContainerStarted","Data":"5b57f94bf616601bb349abc39d56a895cdfb2e0f08c907dda96a1d199ef8da9f"}
Jul 15 15:36:56.961697 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.961655    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg" event={"ID":"ac3ed45f-5acf-4546-9912-f2284022f3fc","Type":"ContainerStarted","Data":"99f926170612c15f8ff2078b0852ffa220d38377106081a7a0bcd3009554b753"}
Jul 15 15:36:56.963971 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.963930    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj" event={"ID":"b4b3e841-bbf8-402a-a3b4-b88fea12aad5","Type":"ContainerStarted","Data":"d1871480748df2cad370d8e51714a8b9536ada7e64606378d752518e29a4d714"}
Jul 15 15:36:56.964061 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.963989    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj" event={"ID":"b4b3e841-bbf8-402a-a3b4-b88fea12aad5","Type":"ContainerStarted","Data":"5cb9d69da9b442a812bd055a43804fd616b69d6ef094bd6d6c38b1798dcc5749"}
Jul 15 15:36:56.964061 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.964013    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj" event={"ID":"b4b3e841-bbf8-402a-a3b4-b88fea12aad5","Type":"ContainerStarted","Data":"3cb7cbdad47f7fbfb7e5fc64fdefc7e7d4c58675c0c6db7edada3323b42c00a3"}
Jul 15 15:36:56.981558 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:56.981509    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6bbd8" podStartSLOduration=2.525105602 podStartE2EDuration="3.981494733s" totalImagesPullingTime="1.378130745s" totalInitContainerRuntime="78.258386ms" isStatefulPod=true podCreationTimestamp="2026-07-15 15:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:56.980776344 +0000 UTC m=+94.389549534" watchObservedRunningTime="2026-07-15 15:36:56.981494733 +0000 UTC m=+94.390267902"
Jul 15 15:36:57.003760 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.003713    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rznwg" podStartSLOduration=2.427500198 podStartE2EDuration="4.003696888s" totalImagesPullingTime="1.57619669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:57.002478459 +0000 UTC m=+94.411251651" watchObservedRunningTime="2026-07-15 15:36:57.003696888 +0000 UTC m=+94.412470077"
Jul 15 15:36:57.027978 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.027913    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-h5qbj" podStartSLOduration=2.037004965 podStartE2EDuration="4.027899127s" totalImagesPullingTime="1.990894162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:57.026694917 +0000 UTC m=+94.435468106" watchObservedRunningTime="2026-07-15 15:36:57.027899127 +0000 UTC m=+94.436672316"
Jul 15 15:36:57.340552 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.340472    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:57.440069 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.440038    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:57.470872 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.470838    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-69b68cf8d-rq4cr"]
Jul 15 15:36:57.496474 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.496437    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69b68cf8d-rq4cr"]
Jul 15 15:36:57.496652 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.496528    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.499259 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.499238    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 15 15:36:57.500463 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.500438    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 15 15:36:57.500574 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.500475    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8p51dg3ads2ag\""
Jul 15 15:36:57.500574 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.500499    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-g4nrv\""
Jul 15 15:36:57.500574 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.500527    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 15 15:36:57.500758 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.500745    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 15:36:57.614539 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.614451    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4acd7cd9-f9da-4754-a988-bb517d1061e4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.614539 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.614488    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4acd7cd9-f9da-4754-a988-bb517d1061e4-audit-log\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.614539 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.614510    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzdm6\" (UniqueName: \"kubernetes.io/projected/4acd7cd9-f9da-4754-a988-bb517d1061e4-kube-api-access-rzdm6\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.614754 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.614572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4acd7cd9-f9da-4754-a988-bb517d1061e4-metrics-server-audit-profiles\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.614754 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.614635    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4acd7cd9-f9da-4754-a988-bb517d1061e4-secret-metrics-server-tls\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.614754 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.614700    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4acd7cd9-f9da-4754-a988-bb517d1061e4-secret-metrics-server-client-certs\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.614754 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.614716    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4acd7cd9-f9da-4754-a988-bb517d1061e4-client-ca-bundle\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.715360 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.715323    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4acd7cd9-f9da-4754-a988-bb517d1061e4-secret-metrics-server-tls\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.715483 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.715368    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4acd7cd9-f9da-4754-a988-bb517d1061e4-secret-metrics-server-client-certs\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.715483 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.715384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4acd7cd9-f9da-4754-a988-bb517d1061e4-client-ca-bundle\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.715483 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.715418    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4acd7cd9-f9da-4754-a988-bb517d1061e4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.715603 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.715494    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4acd7cd9-f9da-4754-a988-bb517d1061e4-audit-log\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.715603 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.715520    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzdm6\" (UniqueName: \"kubernetes.io/projected/4acd7cd9-f9da-4754-a988-bb517d1061e4-kube-api-access-rzdm6\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.715603 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.715544    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4acd7cd9-f9da-4754-a988-bb517d1061e4-metrics-server-audit-profiles\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.716048 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.716022    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4acd7cd9-f9da-4754-a988-bb517d1061e4-audit-log\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.716234 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.716208    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4acd7cd9-f9da-4754-a988-bb517d1061e4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.716536 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.716517    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4acd7cd9-f9da-4754-a988-bb517d1061e4-metrics-server-audit-profiles\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.717938 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.717916    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4acd7cd9-f9da-4754-a988-bb517d1061e4-secret-metrics-server-tls\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.718442 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.718423    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4acd7cd9-f9da-4754-a988-bb517d1061e4-client-ca-bundle\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.718490 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.718458    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4acd7cd9-f9da-4754-a988-bb517d1061e4-secret-metrics-server-client-certs\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.727009 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.726985    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzdm6\" (UniqueName: \"kubernetes.io/projected/4acd7cd9-f9da-4754-a988-bb517d1061e4-kube-api-access-rzdm6\") pod \"metrics-server-69b68cf8d-rq4cr\" (UID: \"4acd7cd9-f9da-4754-a988-bb517d1061e4\") " pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.786544 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.786511    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:57.790444 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.790420    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-zzt94"]
Jul 15 15:36:57.805903 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.805871    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:36:57.828255 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.828219    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-zzt94"]
Jul 15 15:36:57.828393 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.828340    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zzt94"
Jul 15 15:36:57.830955 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.830920    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gmwcr\""
Jul 15 15:36:57.831075 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.831004    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 15 15:36:57.864903 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.864810    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:57.916898 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.916867    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtjlh\" (UniqueName: \"kubernetes.io/projected/8a44503b-afa3-484b-a944-387c78559614-kube-api-access-gtjlh\") pod \"monitoring-plugin-5f68df7f58-zzt94\" (UID: \"8a44503b-afa3-484b-a944-387c78559614\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zzt94"
Jul 15 15:36:57.917028 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.917005    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a44503b-afa3-484b-a944-387c78559614-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-zzt94\" (UID: \"8a44503b-afa3-484b-a944-387c78559614\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zzt94"
Jul 15 15:36:57.961657 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.961630    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69b68cf8d-rq4cr"]
Jul 15 15:36:57.964221 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:57.964190    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4acd7cd9_f9da_4754_a988_bb517d1061e4.slice/crio-afaa51dd426d9c4646df62470eda505c2a7f371742e28eb9bfb2d120fb985e0a WatchSource:0}: Error finding container afaa51dd426d9c4646df62470eda505c2a7f371742e28eb9bfb2d120fb985e0a: Status 404 returned error can't find the container with id afaa51dd426d9c4646df62470eda505c2a7f371742e28eb9bfb2d120fb985e0a
Jul 15 15:36:57.964578 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:57.964556    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:58.017635 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.017602    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtjlh\" (UniqueName: \"kubernetes.io/projected/8a44503b-afa3-484b-a944-387c78559614-kube-api-access-gtjlh\") pod \"monitoring-plugin-5f68df7f58-zzt94\" (UID: \"8a44503b-afa3-484b-a944-387c78559614\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zzt94"
Jul 15 15:36:58.018184 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.017836    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a44503b-afa3-484b-a944-387c78559614-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-zzt94\" (UID: \"8a44503b-afa3-484b-a944-387c78559614\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zzt94"
Jul 15 15:36:58.020298 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.020272    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a44503b-afa3-484b-a944-387c78559614-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-zzt94\" (UID: \"8a44503b-afa3-484b-a944-387c78559614\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zzt94"
Jul 15 15:36:58.026662 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.026646    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtjlh\" (UniqueName: \"kubernetes.io/projected/8a44503b-afa3-484b-a944-387c78559614-kube-api-access-gtjlh\") pod \"monitoring-plugin-5f68df7f58-zzt94\" (UID: \"8a44503b-afa3-484b-a944-387c78559614\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zzt94"
Jul 15 15:36:58.064746 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.064707    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:58.137019 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.136905    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zzt94"
Jul 15 15:36:58.274934 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.274902    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"]
Jul 15 15:36:58.298997 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.298941    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"]
Jul 15 15:36:58.299152 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.299016    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-zzt94"]
Jul 15 15:36:58.299152 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:58.299058    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a44503b_afa3_484b_a944_387c78559614.slice/crio-c276cb44ab492fe654ee231b1479b111481509d6ccc71de75b3aef9a5bae6d12 WatchSource:0}: Error finding container c276cb44ab492fe654ee231b1479b111481509d6ccc71de75b3aef9a5bae6d12: Status 404 returned error can't find the container with id c276cb44ab492fe654ee231b1479b111481509d6ccc71de75b3aef9a5bae6d12
Jul 15 15:36:58.299152 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.299078    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.304258 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.304239    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 15 15:36:58.304362 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.304339    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 15 15:36:58.304430 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.304404    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 15 15:36:58.304486 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.304444    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 15 15:36:58.304569 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.304550    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-tn9cv\""
Jul 15 15:36:58.304762 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.304747    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 15 15:36:58.311731 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.311712    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 15 15:36:58.421574 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.421482    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.421574 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.421527    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbxb4\" (UniqueName: \"kubernetes.io/projected/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-kube-api-access-jbxb4\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.421768 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.421643    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-telemeter-client-tls\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.421768 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.421676    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-serving-certs-ca-bundle\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.421768 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.421700    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-metrics-client-ca\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.421768 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.421740    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-secret-telemeter-client\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.421768 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.421760    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-federate-client-tls\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.421918 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.421799    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.522959 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.522923    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbxb4\" (UniqueName: \"kubernetes.io/projected/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-kube-api-access-jbxb4\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.523140 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.523027    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-telemeter-client-tls\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.523140 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.523057    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-serving-certs-ca-bundle\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.523140 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.523079    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-metrics-client-ca\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.523140 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.523103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-secret-telemeter-client\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.523321 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.523282    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-federate-client-tls\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.523370 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.523332    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.523416 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.523368    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.523904 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.523878    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-metrics-client-ca\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.524057 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.523878    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-serving-certs-ca-bundle\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.524288 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.524268    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.526086 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.526063    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-secret-telemeter-client\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.526259 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.526239    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-telemeter-client-tls\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.526300 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.526240    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.526300 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.526285    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-federate-client-tls\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.532033 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.532014    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbxb4\" (UniqueName: \"kubernetes.io/projected/4f0d25b8-054c-418a-b5a3-17f6af9c3d27-kube-api-access-jbxb4\") pod \"telemeter-client-7b4f8cb767-7rxwn\" (UID: \"4f0d25b8-054c-418a-b5a3-17f6af9c3d27\") " pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.620188 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.620150    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"
Jul 15 15:36:58.783288 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.783266    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn"]
Jul 15 15:36:58.785236 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:58.785206    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f0d25b8_054c_418a_b5a3_17f6af9c3d27.slice/crio-63936354ff6534bd53239e20144083c2fc915d892ddf4d6634edb8c0c9ff50de WatchSource:0}: Error finding container 63936354ff6534bd53239e20144083c2fc915d892ddf4d6634edb8c0c9ff50de: Status 404 returned error can't find the container with id 63936354ff6534bd53239e20144083c2fc915d892ddf4d6634edb8c0c9ff50de
Jul 15 15:36:58.971230 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.971196    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr" event={"ID":"4acd7cd9-f9da-4754-a988-bb517d1061e4","Type":"ContainerStarted","Data":"afaa51dd426d9c4646df62470eda505c2a7f371742e28eb9bfb2d120fb985e0a"}
Jul 15 15:36:58.972268 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.972238    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn" event={"ID":"4f0d25b8-054c-418a-b5a3-17f6af9c3d27","Type":"ContainerStarted","Data":"63936354ff6534bd53239e20144083c2fc915d892ddf4d6634edb8c0c9ff50de"}
Jul 15 15:36:58.973287 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:58.973260    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zzt94" event={"ID":"8a44503b-afa3-484b-a944-387c78559614","Type":"ContainerStarted","Data":"c276cb44ab492fe654ee231b1479b111481509d6ccc71de75b3aef9a5bae6d12"}
Jul 15 15:36:59.317340 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.317235    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:36:59.318266 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.318246    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 15:36:59.337691 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.337664    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.341436 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.341408    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 15:36:59.341797 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.341773    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 15:36:59.342061 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.342041    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 15:36:59.342061 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.342050    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 15:36:59.342912 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.342338    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 15:36:59.342912 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.342351    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b48f6\""
Jul 15 15:36:59.342912 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.342613    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 15:36:59.342912 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.342744    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 15:36:59.342912 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.342818    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 15:36:59.344300 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.344096    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 15:36:59.344442 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.344338    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 15:36:59.345808 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.344995    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 15:36:59.345808 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.345564    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ejvttkr27r32l\""
Jul 15 15:36:59.345808 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.345574    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 15:36:59.345808 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.345577    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 15:36:59.346514 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.346490    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 15:36:59.350571 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.350548    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 15:36:59.432267 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432230    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-config\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.432267 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432268    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b8a9318d-cf80-49a6-924e-ad1d5970adb4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.432513 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432350    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.432513 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432407    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.432513 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.432513 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432466    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.432513 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432480    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.432513 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432501    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b8a9318d-cf80-49a6-924e-ad1d5970adb4-config-out\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.432783 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432521    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-web-config\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.432783 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432550    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.432783 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b8a9318d-cf80-49a6-924e-ad1d5970adb4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.432783 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432626    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.432783 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432662    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c6kr\" (UniqueName: \"kubernetes.io/projected/b8a9318d-cf80-49a6-924e-ad1d5970adb4-kube-api-access-9c6kr\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.432783 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432729    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.433049 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432790    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.433049 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432835    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.433049 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432903    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.433049 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432931    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.433049 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.432981    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.433049 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.433035    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.533705 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.533664    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.533705 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.533716    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.533989 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.533746    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.533989 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.533781    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.533989 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.533803    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.533989 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.533835    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.533989 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.533881    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.533989 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.533920    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-config\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.533989 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.533940    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b8a9318d-cf80-49a6-924e-ad1d5970adb4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.534310 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.534002    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.534310 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.534043    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.534310 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.534072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.534310 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.534124    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.534310 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.534148    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.534310 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.534178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b8a9318d-cf80-49a6-924e-ad1d5970adb4-config-out\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.534310 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.534200    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-web-config\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.534310 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.534224    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.534310 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.534249    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b8a9318d-cf80-49a6-924e-ad1d5970adb4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.534310 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.534273    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.534310 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.534295    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c6kr\" (UniqueName: \"kubernetes.io/projected/b8a9318d-cf80-49a6-924e-ad1d5970adb4-kube-api-access-9c6kr\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.537483 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.537382    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.538315 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.538280    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.538905 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.538871    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.539241 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.539219    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-config\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.539431 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.539409    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.539562 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.539422    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b8a9318d-cf80-49a6-924e-ad1d5970adb4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.539705 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.539683    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b8a9318d-cf80-49a6-924e-ad1d5970adb4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.539886 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.539867    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.540125 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.540106    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.540280 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.540261    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b8a9318d-cf80-49a6-924e-ad1d5970adb4-config-out\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.540697 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.540674    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.541429 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.541404    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.541678 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.541632    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8a9318d-cf80-49a6-924e-ad1d5970adb4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.543300 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.543262    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-web-config\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.543624 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.543576    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.543888 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.543847    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.544388 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.544368    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.544479 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.544367    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.544627 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.544597    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c6kr\" (UniqueName: \"kubernetes.io/projected/b8a9318d-cf80-49a6-924e-ad1d5970adb4-kube-api-access-9c6kr\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.545339 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.545128    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b8a9318d-cf80-49a6-924e-ad1d5970adb4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b8a9318d-cf80-49a6-924e-ad1d5970adb4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.651848 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.651744    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:36:59.841036 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.840754    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 15:36:59.844359 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:36:59.844330    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a9318d_cf80_49a6_924e_ad1d5970adb4.slice/crio-47073c152d75b32c6642cdaaa9b4de18da9d269b23f6f3d56eea4de33c69998b WatchSource:0}: Error finding container 47073c152d75b32c6642cdaaa9b4de18da9d269b23f6f3d56eea4de33c69998b: Status 404 returned error can't find the container with id 47073c152d75b32c6642cdaaa9b4de18da9d269b23f6f3d56eea4de33c69998b
Jul 15 15:36:59.980692 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:36:59.980641    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b8a9318d-cf80-49a6-924e-ad1d5970adb4","Type":"ContainerStarted","Data":"47073c152d75b32c6642cdaaa9b4de18da9d269b23f6f3d56eea4de33c69998b"}
Jul 15 15:37:03.000497 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:03.000218    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr" event={"ID":"4acd7cd9-f9da-4754-a988-bb517d1061e4","Type":"ContainerStarted","Data":"16666c93a0765de0aa60fca4616777f7eccd58a93a929927e9963b11a8bd7aa9"}
Jul 15 15:37:03.002015 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:03.001981    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zzt94" event={"ID":"8a44503b-afa3-484b-a944-387c78559614","Type":"ContainerStarted","Data":"852179c92dd6217744c9699e920f59a7578bbc7d11cf78dd5f3cac0f1aceac89"}
Jul 15 15:37:03.002217 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:03.002200    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zzt94"
Jul 15 15:37:03.003861 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:03.003833    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn" event={"ID":"4f0d25b8-054c-418a-b5a3-17f6af9c3d27","Type":"ContainerStarted","Data":"cddd5ba5d5be827282bcce279d672684fdaf729e24f1531599f5fa1868cbe953"}
Jul 15 15:37:03.005655 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:03.005628    2583 generic.go:356] "Generic (PLEG): container finished" podID="b8a9318d-cf80-49a6-924e-ad1d5970adb4" containerID="7e7c1576409f12aec30e2c24ab0381c8d05ddce29e25521012f8af0a316ded97" exitCode=0
Jul 15 15:37:03.005765 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:03.005717    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b8a9318d-cf80-49a6-924e-ad1d5970adb4","Type":"ContainerDied","Data":"7e7c1576409f12aec30e2c24ab0381c8d05ddce29e25521012f8af0a316ded97"}
Jul 15 15:37:03.008566 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:03.008539    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9" event={"ID":"732570c5-caf8-4854-8a18-50afa143b9b1","Type":"ContainerStarted","Data":"41690687f1d61872e4f274f6bda15a52d0be465b85d87829dc8f7a162e410450"}
Jul 15 15:37:03.008673 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:03.008598    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9" event={"ID":"732570c5-caf8-4854-8a18-50afa143b9b1","Type":"ContainerStarted","Data":"79d00069895f1f429990301a1a98333247e326d05f944f0829f074be8772302f"}
Jul 15 15:37:03.008673 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:03.008664    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zzt94"
Jul 15 15:37:03.008791 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:03.008683    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9" event={"ID":"732570c5-caf8-4854-8a18-50afa143b9b1","Type":"ContainerStarted","Data":"4af5fa7ce50034f8f15e7427a2e0d3386e0fa0ae8af13ef631fae290e42dad69"}
Jul 15 15:37:03.020546 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:03.020491    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr" podStartSLOduration=1.9017541279999999 podStartE2EDuration="6.02047192s" totalImagesPullingTime="4.118717792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:37:03.020061421 +0000 UTC m=+100.428834612" watchObservedRunningTime="2026-07-15 15:37:03.02047192 +0000 UTC m=+100.429245109"
Jul 15 15:37:03.064085 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:03.063982    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zzt94" podStartSLOduration=2.27559995 podStartE2EDuration="6.063958755s" totalImagesPullingTime="3.788358805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:37:03.06373804 +0000 UTC m=+100.472511242" watchObservedRunningTime="2026-07-15 15:37:03.063958755 +0000 UTC m=+100.472731941"
Jul 15 15:37:04.014346 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:04.014307    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn" event={"ID":"4f0d25b8-054c-418a-b5a3-17f6af9c3d27","Type":"ContainerStarted","Data":"96a827b22f34c39d6a9714b2de8063b7470de67312ff3fbbb3b89b1970fd5ed6"}
Jul 15 15:37:04.014790 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:04.014383    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn" event={"ID":"4f0d25b8-054c-418a-b5a3-17f6af9c3d27","Type":"ContainerStarted","Data":"5f28252f7c057e0658165430a53778344b4fdf32caeef6b646f8a989b2959063"}
Jul 15 15:37:04.017070 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:04.017039    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9" event={"ID":"732570c5-caf8-4854-8a18-50afa143b9b1","Type":"ContainerStarted","Data":"9542e87c5cd7de1ae762c9844843499a74ac39a6ea867d75d7bce4df70e2d22c"}
Jul 15 15:37:04.017218 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:04.017108    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9" event={"ID":"732570c5-caf8-4854-8a18-50afa143b9b1","Type":"ContainerStarted","Data":"61ab4e176a84162ffd36719866404ce8e441dcc9eb86ff973cf62fbb4f92ed33"}
Jul 15 15:37:04.017218 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:04.017135    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9" event={"ID":"732570c5-caf8-4854-8a18-50afa143b9b1","Type":"ContainerStarted","Data":"7ddd29357a4814ea24af0212dea3f8b0332d6bb256b3930e73d5c1b7467a0f97"}
Jul 15 15:37:04.044250 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:04.044204    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7b4f8cb767-7rxwn" podStartSLOduration=1.747331375 podStartE2EDuration="6.044187751s" totalImagesPullingTime="4.296856376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:37:04.043115514 +0000 UTC m=+101.451888703" watchObservedRunningTime="2026-07-15 15:37:04.044187751 +0000 UTC m=+101.452960940"
Jul 15 15:37:04.076254 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:04.076189    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9" podStartSLOduration=1.919930158 podStartE2EDuration="8.076172917s" totalImagesPullingTime="6.156242759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:37:04.075331424 +0000 UTC m=+101.484104616" watchObservedRunningTime="2026-07-15 15:37:04.076172917 +0000 UTC m=+101.484946108"
Jul 15 15:37:05.022123 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:05.022086    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:37:06.883450 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:06.883426    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m5gdn"
Jul 15 15:37:07.031869 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:07.031840    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b8a9318d-cf80-49a6-924e-ad1d5970adb4","Type":"ContainerStarted","Data":"b86bfeafc3797c3ac8968e40a44d33fea7e9c9c9868e67c128a4d2bc679d2211"}
Jul 15 15:37:07.032008 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:07.031921    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b8a9318d-cf80-49a6-924e-ad1d5970adb4","Type":"ContainerStarted","Data":"31b1e8af317cc7dadb6365baa00e31e1e31daa14614655e4d34eee0706a4968b"}
Jul 15 15:37:08.038914 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:08.038875    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b8a9318d-cf80-49a6-924e-ad1d5970adb4","Type":"ContainerStarted","Data":"efffe491714c6deb4e4551a2dc0764abfe4cd9be2ba627df6ea60b2b921040ce"}
Jul 15 15:37:08.039366 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:08.038972    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b8a9318d-cf80-49a6-924e-ad1d5970adb4","Type":"ContainerStarted","Data":"e89e97b9efe3f8cdb2a77710821638f42730b288e5ba2c807e7273ec56ec4b62"}
Jul 15 15:37:08.039366 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:08.039015    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b8a9318d-cf80-49a6-924e-ad1d5970adb4","Type":"ContainerStarted","Data":"065204c65a8199314bac9c1ebd249603f6e177142ae8c001b9d21c712efec21b"}
Jul 15 15:37:08.039366 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:08.039049    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b8a9318d-cf80-49a6-924e-ad1d5970adb4","Type":"ContainerStarted","Data":"c94ec708890c12b019c42fd790474cafb59011c3c4696cf6b76f09f2a967c2d3"}
Jul 15 15:37:08.076068 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:08.076005    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.295949586 podStartE2EDuration="9.075988521s" totalImagesPullingTime="6.755453812s" totalInitContainerRuntime="24.585123ms" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:37:08.073539176 +0000 UTC m=+105.482312427" watchObservedRunningTime="2026-07-15 15:37:08.075988521 +0000 UTC m=+105.484761710"
Jul 15 15:37:09.652226 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:09.652195    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:37:11.031358 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:11.031333    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6d5bbf459-mlsj9"
Jul 15 15:37:12.005290 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:12.005253    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:37:12.105124 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:12.105089    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:37:16.241448 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:16.241415    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:37:16.339000 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:16.338969    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:37:17.806431 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:17.806388    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:37:17.806855 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:17.806460    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:37:34.303033 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:34.302995    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:37:37.811359 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:37.811332    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:37:37.814962 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:37.814923    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-69b68cf8d-rq4cr"
Jul 15 15:37:59.652375 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:59.652332    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:37:59.671517 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:37:59.671493    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:38:00.256666 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:00.256642    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 15:38:09.184247 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:09.184213    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:11.276186 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:11.276151    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:17.790322 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:17.790247    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:17.856329 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:17.856292    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:17.959906 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:17.959877    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:18.029325 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:18.029281    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:18.578171 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:18.578137    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:18.671171 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:18.671140    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:21.091505 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:21.091468    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:21.149257 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:21.149222    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:21.426067 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:21.425977    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:21.517422 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:21.517388    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:26.982081 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:26.982046    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:27.084183 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:27.084149    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:29.154606 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:29.154571    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:29.255369 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:29.255332    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:38:49.635981 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:38:49.635933    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:06.872078 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:06.872049    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:06.972697 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:06.972672    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:19.360727 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:19.360691    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:39.332132 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:39.332096    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:40.215543 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:40.215508    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:43.106668 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:43.106628    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:43.208313 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:43.208274    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:45.006696 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:45.006618    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:45.183028 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:45.182996    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:45.331787 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:45.331701    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:47.453989 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:47.453954    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:47.874124 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:47.874040    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:49.909181 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:49.909151    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:49.972788 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:49.972755    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:54.127004 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:54.126967    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:54.223933 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:54.223902    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:54.921931 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:54.921899    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:58.374893 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:58.374838    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:39:58.459563 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:39:58.459530    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:05.645645 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:05.645613    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:05.746995 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:05.746965    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:06.277397 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:06.277366    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:11.404153 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:11.404110    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:12.444426 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:12.444398    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:21.351151 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:21.351111    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:21.454128 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:21.454089    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:21.932683 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:21.932649    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:22.135038 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.134991    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:22.240528 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.240499    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:22.302411 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.302376    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"]
Jul 15 15:40:22.305657 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.305636    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.308935 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.308913    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 15:40:22.309094 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.308914    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 15:40:22.309169 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.309155    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jkffr\""
Jul 15 15:40:22.309206 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.309177    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 15:40:22.311206 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.311178    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 15:40:22.324306 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.324281    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"]
Jul 15 15:40:22.365123 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.365089    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8a4b832-c988-46d1-b06b-8289aee8d3ef-manifests\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-n7p28\" (UID: \"a8a4b832-c988-46d1-b06b-8289aee8d3ef\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.365123 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.365126    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8a4b832-c988-46d1-b06b-8289aee8d3ef-tmp\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-n7p28\" (UID: \"a8a4b832-c988-46d1-b06b-8289aee8d3ef\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.365548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.365149    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8a4b832-c988-46d1-b06b-8289aee8d3ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-n7p28\" (UID: \"a8a4b832-c988-46d1-b06b-8289aee8d3ef\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.365548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.365211    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtvvj\" (UniqueName: \"kubernetes.io/projected/a8a4b832-c988-46d1-b06b-8289aee8d3ef-kube-api-access-jtvvj\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-n7p28\" (UID: \"a8a4b832-c988-46d1-b06b-8289aee8d3ef\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.365548 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.365232    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8a4b832-c988-46d1-b06b-8289aee8d3ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-n7p28\" (UID: \"a8a4b832-c988-46d1-b06b-8289aee8d3ef\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.465821 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.465785    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8a4b832-c988-46d1-b06b-8289aee8d3ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-n7p28\" (UID: \"a8a4b832-c988-46d1-b06b-8289aee8d3ef\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.466038 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.465848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8a4b832-c988-46d1-b06b-8289aee8d3ef-manifests\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-n7p28\" (UID: \"a8a4b832-c988-46d1-b06b-8289aee8d3ef\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.466038 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.465880    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8a4b832-c988-46d1-b06b-8289aee8d3ef-tmp\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-n7p28\" (UID: \"a8a4b832-c988-46d1-b06b-8289aee8d3ef\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.466038 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.465901    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8a4b832-c988-46d1-b06b-8289aee8d3ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-n7p28\" (UID: \"a8a4b832-c988-46d1-b06b-8289aee8d3ef\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.466038 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.465967    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtvvj\" (UniqueName: \"kubernetes.io/projected/a8a4b832-c988-46d1-b06b-8289aee8d3ef-kube-api-access-jtvvj\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-n7p28\" (UID: \"a8a4b832-c988-46d1-b06b-8289aee8d3ef\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.466391 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.466361    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8a4b832-c988-46d1-b06b-8289aee8d3ef-manifests\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-n7p28\" (UID: \"a8a4b832-c988-46d1-b06b-8289aee8d3ef\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.468237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.468208    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8a4b832-c988-46d1-b06b-8289aee8d3ef-tmp\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-n7p28\" (UID: \"a8a4b832-c988-46d1-b06b-8289aee8d3ef\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.468323 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.468294    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8a4b832-c988-46d1-b06b-8289aee8d3ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-n7p28\" (UID: \"a8a4b832-c988-46d1-b06b-8289aee8d3ef\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.468363 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.468335    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8a4b832-c988-46d1-b06b-8289aee8d3ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-n7p28\" (UID: \"a8a4b832-c988-46d1-b06b-8289aee8d3ef\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.485103 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.485076    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtvvj\" (UniqueName: \"kubernetes.io/projected/a8a4b832-c988-46d1-b06b-8289aee8d3ef-kube-api-access-jtvvj\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-n7p28\" (UID: \"a8a4b832-c988-46d1-b06b-8289aee8d3ef\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.519540 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.519442    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:22.615260 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.615220    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:22.619242 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.619221    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:22.724902 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.724873    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:22.744598 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.744526    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"]
Jul 15 15:40:22.746985 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:40:22.746960    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a4b832_c988_46d1_b06b_8289aee8d3ef.slice/crio-4998f9d30d543e214bfcdcef9810b4052f67a7369f06b2ff42bd880e5fa3c2e9 WatchSource:0}: Error finding container 4998f9d30d543e214bfcdcef9810b4052f67a7369f06b2ff42bd880e5fa3c2e9: Status 404 returned error can't find the container with id 4998f9d30d543e214bfcdcef9810b4052f67a7369f06b2ff42bd880e5fa3c2e9
Jul 15 15:40:22.795369 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.795291    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28" event={"ID":"a8a4b832-c988-46d1-b06b-8289aee8d3ef","Type":"ContainerStarted","Data":"4998f9d30d543e214bfcdcef9810b4052f67a7369f06b2ff42bd880e5fa3c2e9"}
Jul 15 15:40:22.997920 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:22.997896    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 15:40:23.001728 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:23.001706    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 15:40:23.004268 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:23.004248    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 15:40:23.715907 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:23.715866    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:23.799096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:23.799026    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:26.817795 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:26.817759    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28" event={"ID":"a8a4b832-c988-46d1-b06b-8289aee8d3ef","Type":"ContainerStarted","Data":"5f8a3fa85de324915642914c660f5cb7ae7e2b7786497b958df1a44513231e2b"}
Jul 15 15:40:27.822679 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:27.822637    2583 generic.go:356] "Generic (PLEG): container finished" podID="a8a4b832-c988-46d1-b06b-8289aee8d3ef" containerID="5f8a3fa85de324915642914c660f5cb7ae7e2b7786497b958df1a44513231e2b" exitCode=0
Jul 15 15:40:27.823072 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:27.822710    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28" event={"ID":"a8a4b832-c988-46d1-b06b-8289aee8d3ef","Type":"ContainerDied","Data":"5f8a3fa85de324915642914c660f5cb7ae7e2b7786497b958df1a44513231e2b"}
Jul 15 15:40:27.823178 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:27.823160    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:40:28.828494 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:28.828460    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28" event={"ID":"a8a4b832-c988-46d1-b06b-8289aee8d3ef","Type":"ContainerStarted","Data":"0f99c9da531052b1605b87a271050ad9c804516841afab47f1ae0f07207f4039"}
Jul 15 15:40:28.828878 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:28.828594    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:28.857615 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:28.857561    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28" podStartSLOduration=2.394404424 podStartE2EDuration="6.857543168s" totalImagesPullingTime="3.395401138s" totalInitContainerRuntime="1.067737606s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:40:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:40:28.85627143 +0000 UTC m=+306.265044619" watchObservedRunningTime="2026-07-15 15:40:28.857543168 +0000 UTC m=+306.266316361"
Jul 15 15:40:30.435342 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:30.435309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:30.559470 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:30.559433    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:39.532445 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:39.532414    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:39.835246 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:39.835167    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-n7p28"
Jul 15 15:40:39.885479 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:39.885444    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:39.985715 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:39.985671    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:41.882008 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:41.881972    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:42.014028 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:42.013996    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:42.326076 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:42.326042    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:42.516997 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:42.516942    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:42.788910 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:42.788880    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:42.899384 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:42.899354    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:43.082295 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:43.082193    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:43.258399 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:43.258367    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:43.899081 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:43.899047    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:44.141961 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:44.141916    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:44.223024 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:44.222994    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:44.423259 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:44.423221    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:45.554458 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:45.554426    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:50.490537 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:50.490507    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:50.627063 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:50.627032    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:51.465849 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.465810    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"]
Jul 15 15:40:51.468106 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.468089    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.472620 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.472593    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 15:40:51.472760 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.472650    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 15:40:51.472760 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.472691    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 15:40:51.472915 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.472895    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9dv9x\""
Jul 15 15:40:51.485657 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.485626    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"]
Jul 15 15:40:51.515372 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.515330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21824abc-d876-4956-a30d-9a5cece33df7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.515372 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.515372    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21824abc-d876-4956-a30d-9a5cece33df7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.515776 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.515389    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21824abc-d876-4956-a30d-9a5cece33df7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.515776 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.515463    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cwg7\" (UniqueName: \"kubernetes.io/projected/21824abc-d876-4956-a30d-9a5cece33df7-kube-api-access-9cwg7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.515776 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.515484    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21824abc-d876-4956-a30d-9a5cece33df7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.515776 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.515504    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21824abc-d876-4956-a30d-9a5cece33df7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.515776 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.515530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21824abc-d876-4956-a30d-9a5cece33df7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.515776 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.515591    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21824abc-d876-4956-a30d-9a5cece33df7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.515776 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.515637    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21824abc-d876-4956-a30d-9a5cece33df7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.528225 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.528193    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:51.616096 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.616060    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cwg7\" (UniqueName: \"kubernetes.io/projected/21824abc-d876-4956-a30d-9a5cece33df7-kube-api-access-9cwg7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.616275 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.616105    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21824abc-d876-4956-a30d-9a5cece33df7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.616275 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.616125    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21824abc-d876-4956-a30d-9a5cece33df7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.616275 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.616147    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21824abc-d876-4956-a30d-9a5cece33df7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.616275 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.616229    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21824abc-d876-4956-a30d-9a5cece33df7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.616534 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.616307    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21824abc-d876-4956-a30d-9a5cece33df7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.616534 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.616393    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21824abc-d876-4956-a30d-9a5cece33df7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.616534 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.616435    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21824abc-d876-4956-a30d-9a5cece33df7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.616534 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.616457    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21824abc-d876-4956-a30d-9a5cece33df7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.616722 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.616554    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21824abc-d876-4956-a30d-9a5cece33df7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.616722 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.616632    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21824abc-d876-4956-a30d-9a5cece33df7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.616818 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.616737    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21824abc-d876-4956-a30d-9a5cece33df7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.616818 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.616791    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21824abc-d876-4956-a30d-9a5cece33df7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.617296 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.617273    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21824abc-d876-4956-a30d-9a5cece33df7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.618567 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.618543    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21824abc-d876-4956-a30d-9a5cece33df7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.618664 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.618653    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21824abc-d876-4956-a30d-9a5cece33df7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.626903 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.626884    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21824abc-d876-4956-a30d-9a5cece33df7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.628925 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.628906    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cwg7\" (UniqueName: \"kubernetes.io/projected/21824abc-d876-4956-a30d-9a5cece33df7-kube-api-access-9cwg7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47ssgs\" (UID: \"21824abc-d876-4956-a30d-9a5cece33df7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.778167 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.778089    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:51.853145 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.853110    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:51.933514 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:51.933488    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"]
Jul 15 15:40:51.935595 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:40:51.935573    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21824abc_d876_4956_a30d_9a5cece33df7.slice/crio-9d28b59335baa2dcaec540d25ffaf2b37637362994263bef9bdbe76344512700 WatchSource:0}: Error finding container 9d28b59335baa2dcaec540d25ffaf2b37637362994263bef9bdbe76344512700: Status 404 returned error can't find the container with id 9d28b59335baa2dcaec540d25ffaf2b37637362994263bef9bdbe76344512700
Jul 15 15:40:52.152129 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.152044    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:52.740934 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.740854    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"]
Jul 15 15:40:52.751838 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.751800    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"
Jul 15 15:40:52.757288 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.757202    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 15:40:52.758095 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.758070    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 15:40:52.758454 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.758419    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 15:40:52.759002 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.758076    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h2wn9\""
Jul 15 15:40:52.759248 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.758514    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 15:40:52.759501 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.759483    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 15:40:52.760099 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.760078    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"]
Jul 15 15:40:52.827339 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.827304    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef7a378b-6546-47b3-97f9-e24614a10e4e-metrics-cert\") pod \"lws-controller-manager-c74867c7d-ppldf\" (UID: \"ef7a378b-6546-47b3-97f9-e24614a10e4e\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"
Jul 15 15:40:52.827510 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.827397    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef7a378b-6546-47b3-97f9-e24614a10e4e-cert\") pod \"lws-controller-manager-c74867c7d-ppldf\" (UID: \"ef7a378b-6546-47b3-97f9-e24614a10e4e\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"
Jul 15 15:40:52.827510 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.827424    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x95fm\" (UniqueName: \"kubernetes.io/projected/ef7a378b-6546-47b3-97f9-e24614a10e4e-kube-api-access-x95fm\") pod \"lws-controller-manager-c74867c7d-ppldf\" (UID: \"ef7a378b-6546-47b3-97f9-e24614a10e4e\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"
Jul 15 15:40:52.827510 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.827481    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ef7a378b-6546-47b3-97f9-e24614a10e4e-manager-config\") pod \"lws-controller-manager-c74867c7d-ppldf\" (UID: \"ef7a378b-6546-47b3-97f9-e24614a10e4e\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"
Jul 15 15:40:52.928342 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.928303    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef7a378b-6546-47b3-97f9-e24614a10e4e-cert\") pod \"lws-controller-manager-c74867c7d-ppldf\" (UID: \"ef7a378b-6546-47b3-97f9-e24614a10e4e\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"
Jul 15 15:40:52.928517 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.928349    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x95fm\" (UniqueName: \"kubernetes.io/projected/ef7a378b-6546-47b3-97f9-e24614a10e4e-kube-api-access-x95fm\") pod \"lws-controller-manager-c74867c7d-ppldf\" (UID: \"ef7a378b-6546-47b3-97f9-e24614a10e4e\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"
Jul 15 15:40:52.928517 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.928411    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ef7a378b-6546-47b3-97f9-e24614a10e4e-manager-config\") pod \"lws-controller-manager-c74867c7d-ppldf\" (UID: \"ef7a378b-6546-47b3-97f9-e24614a10e4e\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"
Jul 15 15:40:52.928517 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.928459    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef7a378b-6546-47b3-97f9-e24614a10e4e-metrics-cert\") pod \"lws-controller-manager-c74867c7d-ppldf\" (UID: \"ef7a378b-6546-47b3-97f9-e24614a10e4e\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"
Jul 15 15:40:52.929499 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.929468    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ef7a378b-6546-47b3-97f9-e24614a10e4e-manager-config\") pod \"lws-controller-manager-c74867c7d-ppldf\" (UID: \"ef7a378b-6546-47b3-97f9-e24614a10e4e\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"
Jul 15 15:40:52.931587 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.931493    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs" event={"ID":"21824abc-d876-4956-a30d-9a5cece33df7","Type":"ContainerStarted","Data":"9d28b59335baa2dcaec540d25ffaf2b37637362994263bef9bdbe76344512700"}
Jul 15 15:40:52.931587 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.931515    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef7a378b-6546-47b3-97f9-e24614a10e4e-metrics-cert\") pod \"lws-controller-manager-c74867c7d-ppldf\" (UID: \"ef7a378b-6546-47b3-97f9-e24614a10e4e\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"
Jul 15 15:40:52.931807 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.931781    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef7a378b-6546-47b3-97f9-e24614a10e4e-cert\") pod \"lws-controller-manager-c74867c7d-ppldf\" (UID: \"ef7a378b-6546-47b3-97f9-e24614a10e4e\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"
Jul 15 15:40:52.948677 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:52.948633    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x95fm\" (UniqueName: \"kubernetes.io/projected/ef7a378b-6546-47b3-97f9-e24614a10e4e-kube-api-access-x95fm\") pod \"lws-controller-manager-c74867c7d-ppldf\" (UID: \"ef7a378b-6546-47b3-97f9-e24614a10e4e\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"
Jul 15 15:40:53.066935 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:53.066860    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"
Jul 15 15:40:53.222402 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:53.222365    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"]
Jul 15 15:40:53.223479 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:40:53.223441    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7a378b_6546_47b3_97f9_e24614a10e4e.slice/crio-66b5fb836bc35072f1475c67050332ce92066ae299d2af912d4da88c6361fe52 WatchSource:0}: Error finding container 66b5fb836bc35072f1475c67050332ce92066ae299d2af912d4da88c6361fe52: Status 404 returned error can't find the container with id 66b5fb836bc35072f1475c67050332ce92066ae299d2af912d4da88c6361fe52
Jul 15 15:40:53.920573 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:53.920499    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:53.946113 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:53.946075    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf" event={"ID":"ef7a378b-6546-47b3-97f9-e24614a10e4e","Type":"ContainerStarted","Data":"66b5fb836bc35072f1475c67050332ce92066ae299d2af912d4da88c6361fe52"}
Jul 15 15:40:54.049916 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.049873    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fpj28"]
Jul 15 15:40:54.055244 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.055215    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:54.055594 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.055572    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpj28"
Jul 15 15:40:54.061236 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.061215    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-j6blh\""
Jul 15 15:40:54.061391 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.061216    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 15 15:40:54.079782 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.079749    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fpj28"]
Jul 15 15:40:54.081626 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.081603    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv"]
Jul 15 15:40:54.084198 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.084179    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv"
Jul 15 15:40:54.093633 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.093611    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 15 15:40:54.093740 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.093719    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wn4v5\""
Jul 15 15:40:54.109312 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.109278    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv"]
Jul 15 15:40:54.141368 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.141330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqb7r\" (UniqueName: \"kubernetes.io/projected/3f025f0d-bd71-401d-84ff-326c92e4c7bb-kube-api-access-nqb7r\") pod \"kserve-controller-manager-d6f4b65b8-fpj28\" (UID: \"3f025f0d-bd71-401d-84ff-326c92e4c7bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpj28"
Jul 15 15:40:54.141570 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.141415    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twlnz\" (UniqueName: \"kubernetes.io/projected/803ad9e4-3bf5-4580-ad57-18fa30dc1bc4-kube-api-access-twlnz\") pod \"llmisvc-controller-manager-777c6bd7d5-vtkwv\" (UID: \"803ad9e4-3bf5-4580-ad57-18fa30dc1bc4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv"
Jul 15 15:40:54.141570 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.141436    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f025f0d-bd71-401d-84ff-326c92e4c7bb-cert\") pod \"kserve-controller-manager-d6f4b65b8-fpj28\" (UID: \"3f025f0d-bd71-401d-84ff-326c92e4c7bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpj28"
Jul 15 15:40:54.141570 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.141462    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/803ad9e4-3bf5-4580-ad57-18fa30dc1bc4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vtkwv\" (UID: \"803ad9e4-3bf5-4580-ad57-18fa30dc1bc4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv"
Jul 15 15:40:54.242495 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.242459    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqb7r\" (UniqueName: \"kubernetes.io/projected/3f025f0d-bd71-401d-84ff-326c92e4c7bb-kube-api-access-nqb7r\") pod \"kserve-controller-manager-d6f4b65b8-fpj28\" (UID: \"3f025f0d-bd71-401d-84ff-326c92e4c7bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpj28"
Jul 15 15:40:54.242696 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.242560    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twlnz\" (UniqueName: \"kubernetes.io/projected/803ad9e4-3bf5-4580-ad57-18fa30dc1bc4-kube-api-access-twlnz\") pod \"llmisvc-controller-manager-777c6bd7d5-vtkwv\" (UID: \"803ad9e4-3bf5-4580-ad57-18fa30dc1bc4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv"
Jul 15 15:40:54.242696 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.242587    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f025f0d-bd71-401d-84ff-326c92e4c7bb-cert\") pod \"kserve-controller-manager-d6f4b65b8-fpj28\" (UID: \"3f025f0d-bd71-401d-84ff-326c92e4c7bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpj28"
Jul 15 15:40:54.242696 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.242614    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/803ad9e4-3bf5-4580-ad57-18fa30dc1bc4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vtkwv\" (UID: \"803ad9e4-3bf5-4580-ad57-18fa30dc1bc4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv"
Jul 15 15:40:54.242836 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:40:54.242740    2583 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 15 15:40:54.242836 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:40:54.242799    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/803ad9e4-3bf5-4580-ad57-18fa30dc1bc4-cert podName:803ad9e4-3bf5-4580-ad57-18fa30dc1bc4 nodeName:}" failed. No retries permitted until 2026-07-15 15:40:54.74278051 +0000 UTC m=+332.151553679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/803ad9e4-3bf5-4580-ad57-18fa30dc1bc4-cert") pod "llmisvc-controller-manager-777c6bd7d5-vtkwv" (UID: "803ad9e4-3bf5-4580-ad57-18fa30dc1bc4") : secret "llmisvc-webhook-server-cert" not found
Jul 15 15:40:54.245189 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.245164    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f025f0d-bd71-401d-84ff-326c92e4c7bb-cert\") pod \"kserve-controller-manager-d6f4b65b8-fpj28\" (UID: \"3f025f0d-bd71-401d-84ff-326c92e4c7bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpj28"
Jul 15 15:40:54.281992 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.281935    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twlnz\" (UniqueName: \"kubernetes.io/projected/803ad9e4-3bf5-4580-ad57-18fa30dc1bc4-kube-api-access-twlnz\") pod \"llmisvc-controller-manager-777c6bd7d5-vtkwv\" (UID: \"803ad9e4-3bf5-4580-ad57-18fa30dc1bc4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv"
Jul 15 15:40:54.288311 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.288284    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:54.291211 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.291186    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqb7r\" (UniqueName: \"kubernetes.io/projected/3f025f0d-bd71-401d-84ff-326c92e4c7bb-kube-api-access-nqb7r\") pod \"kserve-controller-manager-d6f4b65b8-fpj28\" (UID: \"3f025f0d-bd71-401d-84ff-326c92e4c7bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpj28"
Jul 15 15:40:54.368351 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.368313    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpj28"
Jul 15 15:40:54.436940 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.436903    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:54.571740 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.571652    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:54.708862 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.708828    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:54.747733 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.747701    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/803ad9e4-3bf5-4580-ad57-18fa30dc1bc4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vtkwv\" (UID: \"803ad9e4-3bf5-4580-ad57-18fa30dc1bc4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv"
Jul 15 15:40:54.750121 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.750092    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/803ad9e4-3bf5-4580-ad57-18fa30dc1bc4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vtkwv\" (UID: \"803ad9e4-3bf5-4580-ad57-18fa30dc1bc4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv"
Jul 15 15:40:54.765790 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.765740    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:40:54.765899 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.765842    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:40:54.765899 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.765886    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:40:54.887155 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.886895    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fpj28"]
Jul 15 15:40:54.954222 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.954124    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpj28" event={"ID":"3f025f0d-bd71-401d-84ff-326c92e4c7bb","Type":"ContainerStarted","Data":"7c77a508304e5066ee32e8aceae28db152a1e4ee77082f5c1eac3747af3f6ec7"}
Jul 15 15:40:54.957204 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.957172    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs" event={"ID":"21824abc-d876-4956-a30d-9a5cece33df7","Type":"ContainerStarted","Data":"3a85c090ef7db9f7e93738c0fe4e8bd9ac35e9d5e0611c848f947b15710f2be6"}
Jul 15 15:40:54.996296 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:54.995984    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv"
Jul 15 15:40:55.006134 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:55.005499    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs" podStartSLOduration=1.17757858 podStartE2EDuration="4.005474076s" totalImagesPullingTime="2.827895496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:40:55.003676952 +0000 UTC m=+332.412450144" watchObservedRunningTime="2026-07-15 15:40:55.005474076 +0000 UTC m=+332.414247268"
Jul 15 15:40:55.215935 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:40:55.215900    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod803ad9e4_3bf5_4580_ad57_18fa30dc1bc4.slice/crio-4ad548e331d195f39ca883cf363ce6d8d2c66d1aa488f6588058c65cee4c1d67 WatchSource:0}: Error finding container 4ad548e331d195f39ca883cf363ce6d8d2c66d1aa488f6588058c65cee4c1d67: Status 404 returned error can't find the container with id 4ad548e331d195f39ca883cf363ce6d8d2c66d1aa488f6588058c65cee4c1d67
Jul 15 15:40:55.222522 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:55.222494    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv"]
Jul 15 15:40:55.778801 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:55.778768    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:55.784706 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:55.784678    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:55.973796 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:55.973747    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv" event={"ID":"803ad9e4-3bf5-4580-ad57-18fa30dc1bc4","Type":"ContainerStarted","Data":"4ad548e331d195f39ca883cf363ce6d8d2c66d1aa488f6588058c65cee4c1d67"}
Jul 15 15:40:55.974253 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:55.974079    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:55.975425 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:55.975400    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47ssgs"
Jul 15 15:40:57.662398 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:57.662360    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:58.599662 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:58.599627    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:40:58.992501 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:58.992462    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf" event={"ID":"ef7a378b-6546-47b3-97f9-e24614a10e4e","Type":"ContainerStarted","Data":"0b59bbb7200a55502b90962dd97ee0fc490bad445bf3086599800004efd6b547"}
Jul 15 15:40:58.992994 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:58.992602    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"
Jul 15 15:40:58.994425 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:58.994394    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpj28" event={"ID":"3f025f0d-bd71-401d-84ff-326c92e4c7bb","Type":"ContainerStarted","Data":"c5a6d1ff6a530bac66ff33708b1aa5bfbebc3e2d4a2076506dbd5ac8adb53c2e"}
Jul 15 15:40:58.994551 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:58.994447    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpj28"
Jul 15 15:40:58.995980 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:58.995955    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv" event={"ID":"803ad9e4-3bf5-4580-ad57-18fa30dc1bc4","Type":"ContainerStarted","Data":"fb6d5b7dcf2c5a604c5d51068762b28dfdd6225b00c4656831578b01fed1f766"}
Jul 15 15:40:58.996080 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:58.996042    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv"
Jul 15 15:40:59.019324 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:59.019268    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf" podStartSLOduration=1.57521999 podStartE2EDuration="7.019251654s" totalImagesPullingTime="5.444031664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:40:59.017491547 +0000 UTC m=+336.426264752" watchObservedRunningTime="2026-07-15 15:40:59.019251654 +0000 UTC m=+336.428024844"
Jul 15 15:40:59.044082 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:59.044034    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv" podStartSLOduration=1.583170703 podStartE2EDuration="5.044015828s" totalImagesPullingTime="3.460845125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:40:59.043124529 +0000 UTC m=+336.451897710" watchObservedRunningTime="2026-07-15 15:40:59.044015828 +0000 UTC m=+336.452789021"
Jul 15 15:40:59.062325 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:40:59.062272    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpj28" podStartSLOduration=1.282022652 podStartE2EDuration="5.062256642s" totalImagesPullingTime="3.78023399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:40:59.06135452 +0000 UTC m=+336.470127724" watchObservedRunningTime="2026-07-15 15:40:59.062256642 +0000 UTC m=+336.471029853"
Jul 15 15:41:10.003153 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:41:10.003123    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c74867c7d-ppldf"
Jul 15 15:41:27.499687 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:41:27.499601    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:41:27.559929 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:41:27.559895    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:41:30.003221 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:41:30.003193    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vtkwv"
Jul 15 15:41:30.006143 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:41:30.006119    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpj28"
Jul 15 15:41:43.512144 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:41:43.512109    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:41:44.653923 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:41:44.653889    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:41:44.763012 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:41:44.762974    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:11.915756 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:11.915726    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:12.525051 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:12.524988    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:14.481101 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:14.481066    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:16.944757 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:16.944727    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:17.416992 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:17.416886    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:17.521342 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:17.521310    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:18.829986 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:18.829936    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cwzx"]
Jul 15 15:42:18.832429 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:18.832413    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cwzx"
Jul 15 15:42:18.835187 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:18.835164    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 15 15:42:18.835309 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:18.835213    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wm4t2\""
Jul 15 15:42:18.836257 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:18.836236    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 15:42:18.836257 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:18.836255    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 15:42:18.850777 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:18.850755    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cwzx"]
Jul 15 15:42:18.989887 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:18.989846    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc5rs\" (UniqueName: \"kubernetes.io/projected/9bfb888b-7e26-4885-938d-5ada2c330baa-kube-api-access-xc5rs\") pod \"dns-operator-controller-manager-864dd78c4c-8cwzx\" (UID: \"9bfb888b-7e26-4885-938d-5ada2c330baa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cwzx"
Jul 15 15:42:19.091301 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:19.091211    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc5rs\" (UniqueName: \"kubernetes.io/projected/9bfb888b-7e26-4885-938d-5ada2c330baa-kube-api-access-xc5rs\") pod \"dns-operator-controller-manager-864dd78c4c-8cwzx\" (UID: \"9bfb888b-7e26-4885-938d-5ada2c330baa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cwzx"
Jul 15 15:42:19.101250 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:19.101214    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc5rs\" (UniqueName: \"kubernetes.io/projected/9bfb888b-7e26-4885-938d-5ada2c330baa-kube-api-access-xc5rs\") pod \"dns-operator-controller-manager-864dd78c4c-8cwzx\" (UID: \"9bfb888b-7e26-4885-938d-5ada2c330baa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cwzx"
Jul 15 15:42:19.142389 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:19.142354    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cwzx"
Jul 15 15:42:19.275417 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:19.275384    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cwzx"]
Jul 15 15:42:19.279039 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:42:19.279015    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bfb888b_7e26_4885_938d_5ada2c330baa.slice/crio-0fb051a533247f80d6a8f310dba28eb983372c8bb557c79e7f7f4f5866c2d355 WatchSource:0}: Error finding container 0fb051a533247f80d6a8f310dba28eb983372c8bb557c79e7f7f4f5866c2d355: Status 404 returned error can't find the container with id 0fb051a533247f80d6a8f310dba28eb983372c8bb557c79e7f7f4f5866c2d355
Jul 15 15:42:19.345367 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:19.345289    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cwzx" event={"ID":"9bfb888b-7e26-4885-938d-5ada2c330baa","Type":"ContainerStarted","Data":"0fb051a533247f80d6a8f310dba28eb983372c8bb557c79e7f7f4f5866c2d355"}
Jul 15 15:42:19.532127 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:19.532095    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:19.803714 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:19.803679    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:20.831968 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:20.831917    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:22.362626 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:22.362591    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cwzx" event={"ID":"9bfb888b-7e26-4885-938d-5ada2c330baa","Type":"ContainerStarted","Data":"c03b7830134b1e62b64fff7c3ea365864bee2a7c1d76f96318cf81f4e804665a"}
Jul 15 15:42:22.363007 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:22.362762    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cwzx"
Jul 15 15:42:22.383427 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:22.383376    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cwzx" podStartSLOduration=2.23615978 podStartE2EDuration="4.383360431s" totalImagesPullingTime="2.147200651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:42:22.382401827 +0000 UTC m=+419.791175044" watchObservedRunningTime="2026-07-15 15:42:22.383360431 +0000 UTC m=+419.792133620"
Jul 15 15:42:23.570551 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:23.570517    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:24.577232 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:24.577193    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:25.136054 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:25.136021    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"]
Jul 15 15:42:25.138492 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:25.138476    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"
Jul 15 15:42:25.141283 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:25.141262    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-lf4nr\""
Jul 15 15:42:25.149085 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:25.149063    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzfnf\" (UniqueName: \"kubernetes.io/projected/89e05204-85f3-4c20-8d5a-06f662837332-kube-api-access-rzfnf\") pod \"limitador-operator-controller-manager-859d7b78bd-ds8tq\" (UID: \"89e05204-85f3-4c20-8d5a-06f662837332\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"
Jul 15 15:42:25.160242 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:25.160214    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"]
Jul 15 15:42:25.250042 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:25.250005    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzfnf\" (UniqueName: \"kubernetes.io/projected/89e05204-85f3-4c20-8d5a-06f662837332-kube-api-access-rzfnf\") pod \"limitador-operator-controller-manager-859d7b78bd-ds8tq\" (UID: \"89e05204-85f3-4c20-8d5a-06f662837332\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"
Jul 15 15:42:25.259653 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:25.259612    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzfnf\" (UniqueName: \"kubernetes.io/projected/89e05204-85f3-4c20-8d5a-06f662837332-kube-api-access-rzfnf\") pod \"limitador-operator-controller-manager-859d7b78bd-ds8tq\" (UID: \"89e05204-85f3-4c20-8d5a-06f662837332\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"
Jul 15 15:42:25.448582 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:25.448545    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"
Jul 15 15:42:25.608110 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:42:25.608080    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e05204_85f3_4c20_8d5a_06f662837332.slice/crio-a839b52a93ad7d50f3382d50c7250687a2a3d3d27e6123748a225f9612810c9c WatchSource:0}: Error finding container a839b52a93ad7d50f3382d50c7250687a2a3d3d27e6123748a225f9612810c9c: Status 404 returned error can't find the container with id a839b52a93ad7d50f3382d50c7250687a2a3d3d27e6123748a225f9612810c9c
Jul 15 15:42:25.609535 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:25.609497    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"]
Jul 15 15:42:26.383574 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:26.383537    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq" event={"ID":"89e05204-85f3-4c20-8d5a-06f662837332","Type":"ContainerStarted","Data":"a839b52a93ad7d50f3382d50c7250687a2a3d3d27e6123748a225f9612810c9c"}
Jul 15 15:42:26.598776 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:26.598735    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:26.692672 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:26.692646    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:26.964261 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:26.964165    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:27.066181 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:27.066144    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:28.394393 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:28.394355    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq" event={"ID":"89e05204-85f3-4c20-8d5a-06f662837332","Type":"ContainerStarted","Data":"49b9c8ed3242865160fa3941ac9aad0a1eff8af63bd62827cde2d799b26b22bd"}
Jul 15 15:42:28.394761 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:28.394423    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"
Jul 15 15:42:28.408488 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:28.408462    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:28.415634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:28.415596    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq" podStartSLOduration=1.170298532 podStartE2EDuration="3.415581389s" totalImagesPullingTime="2.245282857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:42:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:42:28.414106423 +0000 UTC m=+425.822879615" watchObservedRunningTime="2026-07-15 15:42:28.415581389 +0000 UTC m=+425.824354578"
Jul 15 15:42:28.519266 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:28.519234    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:28.683816 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:28.683736    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:30.559391 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:30.559355    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:30.675975 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:30.675916    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:32.382181 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:32.382145    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:32.618540 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:32.618509    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:33.369292 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:33.369265    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8cwzx"
Jul 15 15:42:35.982931 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:35.982899    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:36.060751 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:36.060720    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:39.406892 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:39.406859    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"
Jul 15 15:42:42.173746 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:42.173714    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:42.260357 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:42.260320    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:43.284547 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:43.284498    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"]
Jul 15 15:42:43.286982 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:43.286965    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"
Jul 15 15:42:43.289433 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:43.289414    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qsq6x\""
Jul 15 15:42:43.304972 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:43.304930    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"]
Jul 15 15:42:43.410594 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:43.410552    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59e403ff-3c48-4d61-a743-28df0ddbd137-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9blm8\" (UID: \"59e403ff-3c48-4d61-a743-28df0ddbd137\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"
Jul 15 15:42:43.410841 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:43.410665    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkkcx\" (UniqueName: \"kubernetes.io/projected/59e403ff-3c48-4d61-a743-28df0ddbd137-kube-api-access-xkkcx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9blm8\" (UID: \"59e403ff-3c48-4d61-a743-28df0ddbd137\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"
Jul 15 15:42:43.511216 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:43.511177    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59e403ff-3c48-4d61-a743-28df0ddbd137-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9blm8\" (UID: \"59e403ff-3c48-4d61-a743-28df0ddbd137\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"
Jul 15 15:42:43.511377 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:43.511244    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkkcx\" (UniqueName: \"kubernetes.io/projected/59e403ff-3c48-4d61-a743-28df0ddbd137-kube-api-access-xkkcx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9blm8\" (UID: \"59e403ff-3c48-4d61-a743-28df0ddbd137\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"
Jul 15 15:42:43.511594 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:43.511576    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59e403ff-3c48-4d61-a743-28df0ddbd137-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9blm8\" (UID: \"59e403ff-3c48-4d61-a743-28df0ddbd137\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"
Jul 15 15:42:43.528035 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:43.528000    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkkcx\" (UniqueName: \"kubernetes.io/projected/59e403ff-3c48-4d61-a743-28df0ddbd137-kube-api-access-xkkcx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9blm8\" (UID: \"59e403ff-3c48-4d61-a743-28df0ddbd137\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"
Jul 15 15:42:43.596803 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:43.596723    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"
Jul 15 15:42:43.734138 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:43.734062    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"]
Jul 15 15:42:43.736765 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:42:43.736740    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e403ff_3c48_4d61_a743_28df0ddbd137.slice/crio-a2f63a7c82219e56c720818e04d42f09c8339505d4245799a9321f6c7ac21059 WatchSource:0}: Error finding container a2f63a7c82219e56c720818e04d42f09c8339505d4245799a9321f6c7ac21059: Status 404 returned error can't find the container with id a2f63a7c82219e56c720818e04d42f09c8339505d4245799a9321f6c7ac21059
Jul 15 15:42:44.062796 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.062758    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"]
Jul 15 15:42:44.067288 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.067261    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"]
Jul 15 15:42:44.096141 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.096111    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"]
Jul 15 15:42:44.099509 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.099483    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"
Jul 15 15:42:44.115113 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.115079    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"]
Jul 15 15:42:44.115323 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.115296    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq" podUID="89e05204-85f3-4c20-8d5a-06f662837332" containerName="manager" containerID="cri-o://49b9c8ed3242865160fa3941ac9aad0a1eff8af63bd62827cde2d799b26b22bd" gracePeriod=2
Jul 15 15:42:44.117307 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.117282    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"]
Jul 15 15:42:44.126067 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.126037    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"]
Jul 15 15:42:44.144373 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:42:44.144323    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ds8tq\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="89e05204-85f3-4c20-8d5a-06f662837332" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"
Jul 15 15:42:44.147603 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.147581    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bhvtt"]
Jul 15 15:42:44.147939 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.147928    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89e05204-85f3-4c20-8d5a-06f662837332" containerName="manager"
Jul 15 15:42:44.147939 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.147940    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="89e05204-85f3-4c20-8d5a-06f662837332" containerName="manager"
Jul 15 15:42:44.148039 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.148015    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="89e05204-85f3-4c20-8d5a-06f662837332" containerName="manager"
Jul 15 15:42:44.150049 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.150029    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bhvtt"
Jul 15 15:42:44.152480 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:42:44.152453    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ds8tq\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="89e05204-85f3-4c20-8d5a-06f662837332" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"
Jul 15 15:42:44.161559 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.161538    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bhvtt"]
Jul 15 15:42:44.217802 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.217774    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdpfw\" (UniqueName: \"kubernetes.io/projected/c917582c-9a83-4ba3-87cb-040ee2b39822-kube-api-access-tdpfw\") pod \"limitador-operator-controller-manager-859d7b78bd-bhvtt\" (UID: \"c917582c-9a83-4ba3-87cb-040ee2b39822\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bhvtt"
Jul 15 15:42:44.217980 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.217837    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba61789c-fff8-4841-8ea4-996729f89529-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kv592\" (UID: \"ba61789c-fff8-4841-8ea4-996729f89529\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"
Jul 15 15:42:44.217980 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.217922    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpb2k\" (UniqueName: \"kubernetes.io/projected/ba61789c-fff8-4841-8ea4-996729f89529-kube-api-access-kpb2k\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kv592\" (UID: \"ba61789c-fff8-4841-8ea4-996729f89529\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"
Jul 15 15:42:44.318491 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.318411    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpb2k\" (UniqueName: \"kubernetes.io/projected/ba61789c-fff8-4841-8ea4-996729f89529-kube-api-access-kpb2k\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kv592\" (UID: \"ba61789c-fff8-4841-8ea4-996729f89529\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"
Jul 15 15:42:44.318873 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.318511    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdpfw\" (UniqueName: \"kubernetes.io/projected/c917582c-9a83-4ba3-87cb-040ee2b39822-kube-api-access-tdpfw\") pod \"limitador-operator-controller-manager-859d7b78bd-bhvtt\" (UID: \"c917582c-9a83-4ba3-87cb-040ee2b39822\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bhvtt"
Jul 15 15:42:44.318873 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.318609    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba61789c-fff8-4841-8ea4-996729f89529-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kv592\" (UID: \"ba61789c-fff8-4841-8ea4-996729f89529\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"
Jul 15 15:42:44.319047 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.319024    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba61789c-fff8-4841-8ea4-996729f89529-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kv592\" (UID: \"ba61789c-fff8-4841-8ea4-996729f89529\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"
Jul 15 15:42:44.328209 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.328179    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpb2k\" (UniqueName: \"kubernetes.io/projected/ba61789c-fff8-4841-8ea4-996729f89529-kube-api-access-kpb2k\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kv592\" (UID: \"ba61789c-fff8-4841-8ea4-996729f89529\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"
Jul 15 15:42:44.328342 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.328321    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdpfw\" (UniqueName: \"kubernetes.io/projected/c917582c-9a83-4ba3-87cb-040ee2b39822-kube-api-access-tdpfw\") pod \"limitador-operator-controller-manager-859d7b78bd-bhvtt\" (UID: \"c917582c-9a83-4ba3-87cb-040ee2b39822\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bhvtt"
Jul 15 15:42:44.360545 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.360523    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"
Jul 15 15:42:44.362737 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:42:44.362703    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ds8tq\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="89e05204-85f3-4c20-8d5a-06f662837332" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"
Jul 15 15:42:44.411425 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.411391    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"
Jul 15 15:42:44.419726 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.419697    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzfnf\" (UniqueName: \"kubernetes.io/projected/89e05204-85f3-4c20-8d5a-06f662837332-kube-api-access-rzfnf\") pod \"89e05204-85f3-4c20-8d5a-06f662837332\" (UID: \"89e05204-85f3-4c20-8d5a-06f662837332\") "
Jul 15 15:42:44.422305 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.422259    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89e05204-85f3-4c20-8d5a-06f662837332-kube-api-access-rzfnf" (OuterVolumeSpecName: "kube-api-access-rzfnf") pod "89e05204-85f3-4c20-8d5a-06f662837332" (UID: "89e05204-85f3-4c20-8d5a-06f662837332"). InnerVolumeSpecName "kube-api-access-rzfnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:42:44.474743 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.473147    2583 generic.go:356] "Generic (PLEG): container finished" podID="89e05204-85f3-4c20-8d5a-06f662837332" containerID="49b9c8ed3242865160fa3941ac9aad0a1eff8af63bd62827cde2d799b26b22bd" exitCode=0
Jul 15 15:42:44.474743 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.473271    2583 scope.go:117] "RemoveContainer" containerID="49b9c8ed3242865160fa3941ac9aad0a1eff8af63bd62827cde2d799b26b22bd"
Jul 15 15:42:44.474743 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.473425    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"
Jul 15 15:42:44.476514 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:42:44.476477    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ds8tq\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="89e05204-85f3-4c20-8d5a-06f662837332" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"
Jul 15 15:42:44.484118 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.484099    2583 scope.go:117] "RemoveContainer" containerID="49b9c8ed3242865160fa3941ac9aad0a1eff8af63bd62827cde2d799b26b22bd"
Jul 15 15:42:44.484404 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:42:44.484384    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49b9c8ed3242865160fa3941ac9aad0a1eff8af63bd62827cde2d799b26b22bd\": container with ID starting with 49b9c8ed3242865160fa3941ac9aad0a1eff8af63bd62827cde2d799b26b22bd not found: ID does not exist" containerID="49b9c8ed3242865160fa3941ac9aad0a1eff8af63bd62827cde2d799b26b22bd"
Jul 15 15:42:44.484461 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.484413    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49b9c8ed3242865160fa3941ac9aad0a1eff8af63bd62827cde2d799b26b22bd"} err="failed to get container status \"49b9c8ed3242865160fa3941ac9aad0a1eff8af63bd62827cde2d799b26b22bd\": rpc error: code = NotFound desc = could not find container \"49b9c8ed3242865160fa3941ac9aad0a1eff8af63bd62827cde2d799b26b22bd\": container with ID starting with 49b9c8ed3242865160fa3941ac9aad0a1eff8af63bd62827cde2d799b26b22bd not found: ID does not exist"
Jul 15 15:42:44.486149 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:42:44.486119    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ds8tq\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="89e05204-85f3-4c20-8d5a-06f662837332" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"
Jul 15 15:42:44.495305 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.495283    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bhvtt"
Jul 15 15:42:44.521513 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.521439    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzfnf\" (UniqueName: \"kubernetes.io/projected/89e05204-85f3-4c20-8d5a-06f662837332-kube-api-access-rzfnf\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 15:42:44.562493 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.562352    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"]
Jul 15 15:42:44.642852 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:42:44.642822    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba61789c_fff8_4841_8ea4_996729f89529.slice/crio-33671583696fc79563af82b79535b242484dc79274b4a4932651419d61a7af3d WatchSource:0}: Error finding container 33671583696fc79563af82b79535b242484dc79274b4a4932651419d61a7af3d: Status 404 returned error can't find the container with id 33671583696fc79563af82b79535b242484dc79274b4a4932651419d61a7af3d
Jul 15 15:42:44.649997 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:44.649969    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bhvtt"]
Jul 15 15:42:44.696521 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:42:44.696486    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc917582c_9a83_4ba3_87cb_040ee2b39822.slice/crio-67cbfdb1e8b3704dd3143c0fb8ef1f3d40672a1919d45225b2107a8600517768 WatchSource:0}: Error finding container 67cbfdb1e8b3704dd3143c0fb8ef1f3d40672a1919d45225b2107a8600517768: Status 404 returned error can't find the container with id 67cbfdb1e8b3704dd3143c0fb8ef1f3d40672a1919d45225b2107a8600517768
Jul 15 15:42:45.482801 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:45.482762    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bhvtt" event={"ID":"c917582c-9a83-4ba3-87cb-040ee2b39822","Type":"ContainerStarted","Data":"29258e74ffa931b0c66b3c64567cfc7d2a54b8784852e2f8a26c6dbc4ad36674"}
Jul 15 15:42:45.483274 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:45.482837    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bhvtt" event={"ID":"c917582c-9a83-4ba3-87cb-040ee2b39822","Type":"ContainerStarted","Data":"67cbfdb1e8b3704dd3143c0fb8ef1f3d40672a1919d45225b2107a8600517768"}
Jul 15 15:42:45.483274 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:45.482872    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bhvtt"
Jul 15 15:42:45.485360 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:42:45.485323    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ds8tq\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="89e05204-85f3-4c20-8d5a-06f662837332" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8tq"
Jul 15 15:42:45.486193 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:45.486163    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592" event={"ID":"ba61789c-fff8-4841-8ea4-996729f89529","Type":"ContainerStarted","Data":"33671583696fc79563af82b79535b242484dc79274b4a4932651419d61a7af3d"}
Jul 15 15:42:45.512558 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:45.512506    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bhvtt" podStartSLOduration=1.5124876280000001 podStartE2EDuration="1.512487628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:42:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:42:45.51167352 +0000 UTC m=+442.920446712" watchObservedRunningTime="2026-07-15 15:42:45.512487628 +0000 UTC m=+442.921260820"
Jul 15 15:42:45.586896 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:45.586859    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89e05204-85f3-4c20-8d5a-06f662837332" path="/var/lib/kubelet/pods/89e05204-85f3-4c20-8d5a-06f662837332/volumes"
Jul 15 15:42:45.979930 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:45.979884    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:46.081376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:46.081331    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:46.566377 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:46.566349    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:46.667806 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:46.667774    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:48.504064 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:48.504023    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8" podUID="59e403ff-3c48-4d61-a743-28df0ddbd137" containerName="manager" containerID="cri-o://c24395d92d4906a40a3b031f137baf494b5e4a3ea87966a8ffb8b0a2bea19531" gracePeriod=2
Jul 15 15:42:48.505661 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:48.505637    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592" event={"ID":"ba61789c-fff8-4841-8ea4-996729f89529","Type":"ContainerStarted","Data":"a412c7e284c8ccf0192ec6c3aad148f23fcff2c73a50171efb461a36cc9627e6"}
Jul 15 15:42:48.505842 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:48.505825    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"
Jul 15 15:42:48.529488 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:48.529444    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592" podStartSLOduration=1.049317231 podStartE2EDuration="4.529426207s" totalImagesPullingTime="3.480108976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:42:48.526866109 +0000 UTC m=+445.935639322" watchObservedRunningTime="2026-07-15 15:42:48.529426207 +0000 UTC m=+445.938199399"
Jul 15 15:42:48.746609 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:48.746583    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"
Jul 15 15:42:48.749178 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:42:48.749149    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9blm8\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="59e403ff-3c48-4d61-a743-28df0ddbd137" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"
Jul 15 15:42:48.861472 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:48.861382    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59e403ff-3c48-4d61-a743-28df0ddbd137-extensions-socket-volume\") pod \"59e403ff-3c48-4d61-a743-28df0ddbd137\" (UID: \"59e403ff-3c48-4d61-a743-28df0ddbd137\") "
Jul 15 15:42:48.861472 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:48.861457    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkkcx\" (UniqueName: \"kubernetes.io/projected/59e403ff-3c48-4d61-a743-28df0ddbd137-kube-api-access-xkkcx\") pod \"59e403ff-3c48-4d61-a743-28df0ddbd137\" (UID: \"59e403ff-3c48-4d61-a743-28df0ddbd137\") "
Jul 15 15:42:48.861672 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:48.861649    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59e403ff-3c48-4d61-a743-28df0ddbd137-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "59e403ff-3c48-4d61-a743-28df0ddbd137" (UID: "59e403ff-3c48-4d61-a743-28df0ddbd137"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:42:48.863456 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:48.863435    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59e403ff-3c48-4d61-a743-28df0ddbd137-kube-api-access-xkkcx" (OuterVolumeSpecName: "kube-api-access-xkkcx") pod "59e403ff-3c48-4d61-a743-28df0ddbd137" (UID: "59e403ff-3c48-4d61-a743-28df0ddbd137"). InnerVolumeSpecName "kube-api-access-xkkcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:42:48.960113 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:48.960080    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:48.962313 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:48.962296    2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59e403ff-3c48-4d61-a743-28df0ddbd137-extensions-socket-volume\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 15:42:48.962386 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:48.962316    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkkcx\" (UniqueName: \"kubernetes.io/projected/59e403ff-3c48-4d61-a743-28df0ddbd137-kube-api-access-xkkcx\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 15:42:49.056898 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:49.056862    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:49.511459 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:49.511425    2583 generic.go:356] "Generic (PLEG): container finished" podID="59e403ff-3c48-4d61-a743-28df0ddbd137" containerID="c24395d92d4906a40a3b031f137baf494b5e4a3ea87966a8ffb8b0a2bea19531" exitCode=2
Jul 15 15:42:49.511911 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:49.511473    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"
Jul 15 15:42:49.511911 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:49.511531    2583 scope.go:117] "RemoveContainer" containerID="c24395d92d4906a40a3b031f137baf494b5e4a3ea87966a8ffb8b0a2bea19531"
Jul 15 15:42:49.514001 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:42:49.513969    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9blm8\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="59e403ff-3c48-4d61-a743-28df0ddbd137" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"
Jul 15 15:42:49.521053 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:49.521011    2583 scope.go:117] "RemoveContainer" containerID="c24395d92d4906a40a3b031f137baf494b5e4a3ea87966a8ffb8b0a2bea19531"
Jul 15 15:42:49.521324 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:42:49.521306    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c24395d92d4906a40a3b031f137baf494b5e4a3ea87966a8ffb8b0a2bea19531\": container with ID starting with c24395d92d4906a40a3b031f137baf494b5e4a3ea87966a8ffb8b0a2bea19531 not found: ID does not exist" containerID="c24395d92d4906a40a3b031f137baf494b5e4a3ea87966a8ffb8b0a2bea19531"
Jul 15 15:42:49.521392 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:49.521335    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24395d92d4906a40a3b031f137baf494b5e4a3ea87966a8ffb8b0a2bea19531"} err="failed to get container status \"c24395d92d4906a40a3b031f137baf494b5e4a3ea87966a8ffb8b0a2bea19531\": rpc error: code = NotFound desc = could not find container \"c24395d92d4906a40a3b031f137baf494b5e4a3ea87966a8ffb8b0a2bea19531\": container with ID starting with c24395d92d4906a40a3b031f137baf494b5e4a3ea87966a8ffb8b0a2bea19531 not found: ID does not exist"
Jul 15 15:42:49.523051 ip-10-0-135-178 kubenswrapper[2583]: E0715 15:42:49.523027    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9blm8\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="59e403ff-3c48-4d61-a743-28df0ddbd137" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9blm8"
Jul 15 15:42:49.584440 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:49.584410    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59e403ff-3c48-4d61-a743-28df0ddbd137" path="/var/lib/kubelet/pods/59e403ff-3c48-4d61-a743-28df0ddbd137/volumes"
Jul 15 15:42:54.160228 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:54.160194    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:54.262088 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:54.262052    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:42:56.494967 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:56.494912    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bhvtt"
Jul 15 15:42:59.514988 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:42:59.514932    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"
Jul 15 15:43:00.783629 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:00.783595    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:00.881818 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:00.881784    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:05.841811 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:05.841775    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:05.907233 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:05.907183    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:12.427926 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:12.427885    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"]
Jul 15 15:43:12.428492 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:12.428133    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592" podUID="ba61789c-fff8-4841-8ea4-996729f89529" containerName="manager" containerID="cri-o://a412c7e284c8ccf0192ec6c3aad148f23fcff2c73a50171efb461a36cc9627e6" gracePeriod=10
Jul 15 15:43:12.623478 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:12.623444    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba61789c-fff8-4841-8ea4-996729f89529" containerID="a412c7e284c8ccf0192ec6c3aad148f23fcff2c73a50171efb461a36cc9627e6" exitCode=0
Jul 15 15:43:12.623627 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:12.623522    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592" event={"ID":"ba61789c-fff8-4841-8ea4-996729f89529","Type":"ContainerDied","Data":"a412c7e284c8ccf0192ec6c3aad148f23fcff2c73a50171efb461a36cc9627e6"}
Jul 15 15:43:12.681597 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:12.681538    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"
Jul 15 15:43:12.774564 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:12.774533    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpb2k\" (UniqueName: \"kubernetes.io/projected/ba61789c-fff8-4841-8ea4-996729f89529-kube-api-access-kpb2k\") pod \"ba61789c-fff8-4841-8ea4-996729f89529\" (UID: \"ba61789c-fff8-4841-8ea4-996729f89529\") "
Jul 15 15:43:12.774760 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:12.774581    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba61789c-fff8-4841-8ea4-996729f89529-extensions-socket-volume\") pod \"ba61789c-fff8-4841-8ea4-996729f89529\" (UID: \"ba61789c-fff8-4841-8ea4-996729f89529\") "
Jul 15 15:43:12.775077 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:12.775055    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba61789c-fff8-4841-8ea4-996729f89529-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ba61789c-fff8-4841-8ea4-996729f89529" (UID: "ba61789c-fff8-4841-8ea4-996729f89529"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:43:12.776582 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:12.776557    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba61789c-fff8-4841-8ea4-996729f89529-kube-api-access-kpb2k" (OuterVolumeSpecName: "kube-api-access-kpb2k") pod "ba61789c-fff8-4841-8ea4-996729f89529" (UID: "ba61789c-fff8-4841-8ea4-996729f89529"). InnerVolumeSpecName "kube-api-access-kpb2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:43:12.875842 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:12.875806    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpb2k\" (UniqueName: \"kubernetes.io/projected/ba61789c-fff8-4841-8ea4-996729f89529-kube-api-access-kpb2k\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 15:43:12.875842 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:12.875837    2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba61789c-fff8-4841-8ea4-996729f89529-extensions-socket-volume\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 15:43:13.629326 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:13.629301    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"
Jul 15 15:43:13.629326 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:13.629308    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592" event={"ID":"ba61789c-fff8-4841-8ea4-996729f89529","Type":"ContainerDied","Data":"33671583696fc79563af82b79535b242484dc79274b4a4932651419d61a7af3d"}
Jul 15 15:43:13.629764 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:13.629363    2583 scope.go:117] "RemoveContainer" containerID="a412c7e284c8ccf0192ec6c3aad148f23fcff2c73a50171efb461a36cc9627e6"
Jul 15 15:43:13.647008 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:13.646981    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"]
Jul 15 15:43:13.648679 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:13.648654    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kv592"]
Jul 15 15:43:15.584778 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:15.584742    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba61789c-fff8-4841-8ea4-996729f89529" path="/var/lib/kubelet/pods/ba61789c-fff8-4841-8ea4-996729f89529/volumes"
Jul 15 15:43:16.061773 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.061743    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"]
Jul 15 15:43:16.062199 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.062182    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59e403ff-3c48-4d61-a743-28df0ddbd137" containerName="manager"
Jul 15 15:43:16.062304 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.062201    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="59e403ff-3c48-4d61-a743-28df0ddbd137" containerName="manager"
Jul 15 15:43:16.062304 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.062219    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba61789c-fff8-4841-8ea4-996729f89529" containerName="manager"
Jul 15 15:43:16.062304 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.062227    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba61789c-fff8-4841-8ea4-996729f89529" containerName="manager"
Jul 15 15:43:16.062846 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.062329    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="59e403ff-3c48-4d61-a743-28df0ddbd137" containerName="manager"
Jul 15 15:43:16.062846 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.062345    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba61789c-fff8-4841-8ea4-996729f89529" containerName="manager"
Jul 15 15:43:16.065364 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.065342    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.068140 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.068125    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-j5ltj\""
Jul 15 15:43:16.076076 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.076053    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"]
Jul 15 15:43:16.090019 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.089989    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:16.105704 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.105671    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b5835d1-1eb9-4459-ab99-254d09aa6138-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.105704 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.105705    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b5835d1-1eb9-4459-ab99-254d09aa6138-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.105896 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.105742    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b5835d1-1eb9-4459-ab99-254d09aa6138-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.105896 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.105792    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f626\" (UniqueName: \"kubernetes.io/projected/2b5835d1-1eb9-4459-ab99-254d09aa6138-kube-api-access-5f626\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.105896 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.105850    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b5835d1-1eb9-4459-ab99-254d09aa6138-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.105896 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.105871    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b5835d1-1eb9-4459-ab99-254d09aa6138-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.105896 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.105896    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b5835d1-1eb9-4459-ab99-254d09aa6138-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.106151 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.105917    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b5835d1-1eb9-4459-ab99-254d09aa6138-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.106151 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.106030    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b5835d1-1eb9-4459-ab99-254d09aa6138-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.207343 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.207304    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b5835d1-1eb9-4459-ab99-254d09aa6138-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.207343 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.207343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b5835d1-1eb9-4459-ab99-254d09aa6138-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.207606 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.207360    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b5835d1-1eb9-4459-ab99-254d09aa6138-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.207606 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.207398    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b5835d1-1eb9-4459-ab99-254d09aa6138-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.207606 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.207415    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f626\" (UniqueName: \"kubernetes.io/projected/2b5835d1-1eb9-4459-ab99-254d09aa6138-kube-api-access-5f626\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.207606 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.207470    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b5835d1-1eb9-4459-ab99-254d09aa6138-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.207606 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.207486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b5835d1-1eb9-4459-ab99-254d09aa6138-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.207606 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.207519    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b5835d1-1eb9-4459-ab99-254d09aa6138-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.207606 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.207540    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b5835d1-1eb9-4459-ab99-254d09aa6138-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.207983 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.207873    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b5835d1-1eb9-4459-ab99-254d09aa6138-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.207983 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.207898    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b5835d1-1eb9-4459-ab99-254d09aa6138-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.208134 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.208111    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b5835d1-1eb9-4459-ab99-254d09aa6138-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.208228 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.208210    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b5835d1-1eb9-4459-ab99-254d09aa6138-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.208468 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.208448    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b5835d1-1eb9-4459-ab99-254d09aa6138-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.209729 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.209707    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b5835d1-1eb9-4459-ab99-254d09aa6138-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.209832 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.209819    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b5835d1-1eb9-4459-ab99-254d09aa6138-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.216549 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.216517    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b5835d1-1eb9-4459-ab99-254d09aa6138-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.216629 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.216563    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f626\" (UniqueName: \"kubernetes.io/projected/2b5835d1-1eb9-4459-ab99-254d09aa6138-kube-api-access-5f626\") pod \"maas-default-gateway-openshift-default-56654dcf7-rfd9v\" (UID: \"2b5835d1-1eb9-4459-ab99-254d09aa6138\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.376047 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.375936    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:16.512373 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.512292    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"]
Jul 15 15:43:16.514487 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.514461    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:16.514606 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:43:16.514484    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b5835d1_1eb9_4459_ab99_254d09aa6138.slice/crio-b6c1317f402ddc895c771bbee01d050122bc9c38ff0cfb63b88404cb58de7fbf WatchSource:0}: Error finding container b6c1317f402ddc895c771bbee01d050122bc9c38ff0cfb63b88404cb58de7fbf: Status 404 returned error can't find the container with id b6c1317f402ddc895c771bbee01d050122bc9c38ff0cfb63b88404cb58de7fbf
Jul 15 15:43:16.516405 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.516375    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:43:16.516468 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.516435    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:43:16.516468 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.516464    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:43:16.652232 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.652143    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v" event={"ID":"2b5835d1-1eb9-4459-ab99-254d09aa6138","Type":"ContainerStarted","Data":"347d8af1f0ce8fcdc69208eb15521a26d4b6a4c594abd3f88674a4b5d5bda136"}
Jul 15 15:43:16.652232 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.652194    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v" event={"ID":"2b5835d1-1eb9-4459-ab99-254d09aa6138","Type":"ContainerStarted","Data":"b6c1317f402ddc895c771bbee01d050122bc9c38ff0cfb63b88404cb58de7fbf"}
Jul 15 15:43:16.672332 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:16.672275    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v" podStartSLOduration=0.672252017 podStartE2EDuration="672.252017ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:43:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:43:16.670519365 +0000 UTC m=+474.079292556" watchObservedRunningTime="2026-07-15 15:43:16.672252017 +0000 UTC m=+474.081025208"
Jul 15 15:43:17.376561 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:17.376515    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:17.381448 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:17.381423    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:17.519417 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:17.519382    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:17.657755 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:17.657670    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:17.658643 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:17.658622    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:43:29.567904 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:29.567873    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:29.664070 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:29.664034    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:29.764780 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:29.764740    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:29.885847 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:29.885765    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:43:29.889564 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:29.889542    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"
Jul 15 15:43:29.892129 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:29.892105    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 15:43:29.892265 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:29.892245    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nflhn\""
Jul 15 15:43:29.899023 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:29.898991    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:43:29.931145 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:29.931115    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:43:29.931643 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:29.931619    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2368128d-7b8f-4074-8ac4-e279236e2cfd-config-file\") pod \"limitador-limitador-54d6d988d5-qzjpr\" (UID: \"2368128d-7b8f-4074-8ac4-e279236e2cfd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"
Jul 15 15:43:29.931739 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:29.931693    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8kdc\" (UniqueName: \"kubernetes.io/projected/2368128d-7b8f-4074-8ac4-e279236e2cfd-kube-api-access-j8kdc\") pod \"limitador-limitador-54d6d988d5-qzjpr\" (UID: \"2368128d-7b8f-4074-8ac4-e279236e2cfd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"
Jul 15 15:43:30.032364 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:30.032329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8kdc\" (UniqueName: \"kubernetes.io/projected/2368128d-7b8f-4074-8ac4-e279236e2cfd-kube-api-access-j8kdc\") pod \"limitador-limitador-54d6d988d5-qzjpr\" (UID: \"2368128d-7b8f-4074-8ac4-e279236e2cfd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"
Jul 15 15:43:30.032571 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:30.032412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2368128d-7b8f-4074-8ac4-e279236e2cfd-config-file\") pod \"limitador-limitador-54d6d988d5-qzjpr\" (UID: \"2368128d-7b8f-4074-8ac4-e279236e2cfd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"
Jul 15 15:43:30.033092 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:30.033075    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2368128d-7b8f-4074-8ac4-e279236e2cfd-config-file\") pod \"limitador-limitador-54d6d988d5-qzjpr\" (UID: \"2368128d-7b8f-4074-8ac4-e279236e2cfd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"
Jul 15 15:43:30.041707 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:30.041681    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8kdc\" (UniqueName: \"kubernetes.io/projected/2368128d-7b8f-4074-8ac4-e279236e2cfd-kube-api-access-j8kdc\") pod \"limitador-limitador-54d6d988d5-qzjpr\" (UID: \"2368128d-7b8f-4074-8ac4-e279236e2cfd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"
Jul 15 15:43:30.200491 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:30.200459    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"
Jul 15 15:43:30.337634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:30.337608    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:43:30.339581 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:43:30.339553    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2368128d_7b8f_4074_8ac4_e279236e2cfd.slice/crio-8a99ca7f1339dce0e0995601ea2ef6f534a1da2ad30db5bca1be23a0df465da6 WatchSource:0}: Error finding container 8a99ca7f1339dce0e0995601ea2ef6f534a1da2ad30db5bca1be23a0df465da6: Status 404 returned error can't find the container with id 8a99ca7f1339dce0e0995601ea2ef6f534a1da2ad30db5bca1be23a0df465da6
Jul 15 15:43:30.422691 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:30.422654    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:30.518885 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:30.518804    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:30.719698 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:30.719658    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qzjpr" event={"ID":"2368128d-7b8f-4074-8ac4-e279236e2cfd","Type":"ContainerStarted","Data":"8a99ca7f1339dce0e0995601ea2ef6f534a1da2ad30db5bca1be23a0df465da6"}
Jul 15 15:43:32.731229 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:32.731199    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qzjpr" event={"ID":"2368128d-7b8f-4074-8ac4-e279236e2cfd","Type":"ContainerStarted","Data":"6e6b4a9501791b0a30bb5242bc048c2d7aca1e1a28f10e4542fd76a47cf1119b"}
Jul 15 15:43:32.731586 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:32.731258    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"
Jul 15 15:43:32.751023 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:32.750979    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-qzjpr" podStartSLOduration=1.437305867 podStartE2EDuration="3.750964649s" totalImagesPullingTime="2.313658782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:43:32.748903105 +0000 UTC m=+490.157676296" watchObservedRunningTime="2026-07-15 15:43:32.750964649 +0000 UTC m=+490.159737860"
Jul 15 15:43:43.736693 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:43.736668    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"
Jul 15 15:43:49.257694 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:49.257656    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:49.361314 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:49.361282    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:49.749339 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:49.749301    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:55.829050 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:55.828994    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:43:55.895910 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:43:55.895875    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:02.412023 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:02.411992    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:02.761512 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:02.761470    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:09.541467 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:09.541427    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:09.626163 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:09.626128    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:09.692532 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:09.692504    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:09.968984 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:09.968919    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:13.417045 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:13.416992    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:13.519394 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:13.519358    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:20.370989 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:20.370888    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:46.846365 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:46.846330    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:46.946215 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:46.946169    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:47.310031 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:47.310000    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:47.541776 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:47.541741    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:48.075330 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:48.075295    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:48.113506 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:48.113466    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:44:48.160883 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:48.160841    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:56.110117 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:56.110078    2583 generic.go:356] "Generic (PLEG): container finished" podID="2b5835d1-1eb9-4459-ab99-254d09aa6138" containerID="347d8af1f0ce8fcdc69208eb15521a26d4b6a4c594abd3f88674a4b5d5bda136" exitCode=0
Jul 15 15:44:56.110554 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:56.110149    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v" event={"ID":"2b5835d1-1eb9-4459-ab99-254d09aa6138","Type":"ContainerDied","Data":"347d8af1f0ce8fcdc69208eb15521a26d4b6a4c594abd3f88674a4b5d5bda136"}
Jul 15 15:44:56.110554 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:56.110539    2583 scope.go:117] "RemoveContainer" containerID="347d8af1f0ce8fcdc69208eb15521a26d4b6a4c594abd3f88674a4b5d5bda136"
Jul 15 15:44:56.111533 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:56.111505    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:44:56.111605 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:56.111590    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:44:56.111643 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:56.111631    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 15:44:57.118004 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:57.117940    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v" event={"ID":"2b5835d1-1eb9-4459-ab99-254d09aa6138","Type":"ContainerStarted","Data":"88d50d498b4aa1a3af057ccb232d72f47d9dc89550301dde6b85b6f2e3b3de59"}
Jul 15 15:44:57.376360 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:57.376252    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:44:57.376550 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:57.376526    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rfd9v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 15 15:44:57.376635 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:57.376586    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v" podUID="2b5835d1-1eb9-4459-ab99-254d09aa6138" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 15 15:44:58.087913 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:58.087874    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:58.188846 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:58.188808    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:44:58.377209 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:58.377112    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rfd9v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 15 15:44:58.377209 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:58.377169    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v" podUID="2b5835d1-1eb9-4459-ab99-254d09aa6138" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 15 15:44:59.376745 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:59.376702    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rfd9v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 15 15:44:59.377245 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:44:59.376762    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v" podUID="2b5835d1-1eb9-4459-ab99-254d09aa6138" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 15 15:45:00.377343 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:00.377300    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rfd9v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 15 15:45:00.377719 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:00.377361    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v" podUID="2b5835d1-1eb9-4459-ab99-254d09aa6138" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 15 15:45:01.380433 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:01.380402    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:45:01.380899 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:01.380802    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:45:01.381574 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:01.381559    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rfd9v"
Jul 15 15:45:07.806888 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:07.806855    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:45:08.177419 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:08.177335    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:45:16.822236 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:16.822186    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:45:17.772871 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:17.772835    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:45:23.028179 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:23.028152    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 15:45:23.032063 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:23.032044    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 15:45:30.931313 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:30.931280    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:45:32.089392 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:32.089362    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:45:32.827177 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:32.827141    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:45:36.688168 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:36.688130    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:45:38.485211 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:38.485180    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:45:59.499942 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.499909    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"]
Jul 15 15:45:59.503486 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.503465    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.506204 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.506178    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 15:45:59.506330 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.506208    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 15:45:59.507364 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.507346    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bxntm\""
Jul 15 15:45:59.507364 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.507358    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 15 15:45:59.514566 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.514543    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"]
Jul 15 15:45:59.589696 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.589661    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fef1eb0-dd33-49fa-84c0-13f542fe957d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.589989 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.589937    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fef1eb0-dd33-49fa-84c0-13f542fe957d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.590128 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.590000    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfmwm\" (UniqueName: \"kubernetes.io/projected/0fef1eb0-dd33-49fa-84c0-13f542fe957d-kube-api-access-mfmwm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.590128 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.590032    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fef1eb0-dd33-49fa-84c0-13f542fe957d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.590128 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.590070    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fef1eb0-dd33-49fa-84c0-13f542fe957d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.590128 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.590096    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fef1eb0-dd33-49fa-84c0-13f542fe957d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.597849 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.597817    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:45:59.690933 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.690892    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fef1eb0-dd33-49fa-84c0-13f542fe957d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.691155 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.690961    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fef1eb0-dd33-49fa-84c0-13f542fe957d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.691155 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.690990    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfmwm\" (UniqueName: \"kubernetes.io/projected/0fef1eb0-dd33-49fa-84c0-13f542fe957d-kube-api-access-mfmwm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.691155 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.691016    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fef1eb0-dd33-49fa-84c0-13f542fe957d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.691155 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.691051    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fef1eb0-dd33-49fa-84c0-13f542fe957d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.691155 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.691076    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fef1eb0-dd33-49fa-84c0-13f542fe957d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.691510 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.691336    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fef1eb0-dd33-49fa-84c0-13f542fe957d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.691675 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.691633    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fef1eb0-dd33-49fa-84c0-13f542fe957d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.691801 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.691781    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fef1eb0-dd33-49fa-84c0-13f542fe957d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.693652 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.693632    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fef1eb0-dd33-49fa-84c0-13f542fe957d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.694501 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.694478    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fef1eb0-dd33-49fa-84c0-13f542fe957d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.702387 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.702331    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfmwm\" (UniqueName: \"kubernetes.io/projected/0fef1eb0-dd33-49fa-84c0-13f542fe957d-kube-api-access-mfmwm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbjks\" (UID: \"0fef1eb0-dd33-49fa-84c0-13f542fe957d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.813764 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.813676    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:45:59.947512 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.947482    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"]
Jul 15 15:45:59.950887 ip-10-0-135-178 kubenswrapper[2583]: W0715 15:45:59.950858    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fef1eb0_dd33_49fa_84c0_13f542fe957d.slice/crio-7c47c665c79d6fa895382aa2c6a5b7931b27149d113c196737411eaa5c71e268 WatchSource:0}: Error finding container 7c47c665c79d6fa895382aa2c6a5b7931b27149d113c196737411eaa5c71e268: Status 404 returned error can't find the container with id 7c47c665c79d6fa895382aa2c6a5b7931b27149d113c196737411eaa5c71e268
Jul 15 15:45:59.952171 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:45:59.952150    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:46:00.423654 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:46:00.423591    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks" event={"ID":"0fef1eb0-dd33-49fa-84c0-13f542fe957d","Type":"ContainerStarted","Data":"7c47c665c79d6fa895382aa2c6a5b7931b27149d113c196737411eaa5c71e268"}
Jul 15 15:46:01.430710 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:46:01.430619    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks" event={"ID":"0fef1eb0-dd33-49fa-84c0-13f542fe957d","Type":"ContainerStarted","Data":"e8de640c26f35e206b7c94f224ec7678cd5e32b0ba2df4a73ad677b2d569f1b8"}
Jul 15 15:46:01.452566 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:46:01.452499    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks" podStartSLOduration=1.343988008 podStartE2EDuration="2.452483277s" totalImagesPullingTime="1.108495269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:45:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:46:01.450482548 +0000 UTC m=+638.859255757" watchObservedRunningTime="2026-07-15 15:46:01.452483277 +0000 UTC m=+638.861256466"
Jul 15 15:46:01.483035 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:46:01.482998    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:46:06.232871 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:46:06.232838    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:46:07.222105 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:46:07.222070    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:46:09.196903 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:46:09.196865    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:46:09.814759 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:46:09.814722    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:46:09.814977 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:46:09.814784    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:46:09.827237 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:46:09.827211    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:46:10.485036 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:46:10.485008    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbjks"
Jul 15 15:46:17.945742 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:46:17.945706    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:47:19.818434 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:47:19.818348    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:47:20.352904 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:47:20.352872    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:47:21.002606 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:47:21.002571    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:47:21.513183 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:47:21.513150    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:47:51.492385 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:47:51.492347    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:48:01.180397 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:48:01.180353    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:48:03.709473 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:48:03.709426    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:48:03.812087 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:48:03.812047    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:48:12.570799 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:48:12.570756    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:48:17.829671 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:48:17.829638    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:48:17.931396 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:48:17.931363    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:48:21.586275 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:48:21.586243    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:48:32.572665 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:48:32.572634    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:48:34.632867 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:48:34.632836    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:48:36.837560 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:48:36.837525    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:48:49.946670 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:48:49.946632    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:48:50.006443 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:48:50.006416    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:49:18.226648 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:49:18.226600    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:49:18.323515 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:49:18.323480    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:49:18.443971 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:49:18.443919    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:49:24.375282 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:49:24.375248    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:49:24.475444 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:49:24.475410    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:49:25.384808 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:49:25.384781    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:49:25.485761 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:49:25.485727    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:49:30.663253 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:49:30.663217    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:49:30.742222 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:49:30.742189    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:49:48.179414 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:49:48.179376    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:49:58.171713 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:49:58.171659    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:50:08.177907 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:50:08.177870    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:50:17.188642 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:50:17.188558    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:50:23.062335 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:50:23.062294    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 15:50:23.063134 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:50:23.063115    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 15:50:26.785537 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:50:26.785499    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:50:35.586730 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:50:35.586699    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:50:46.180914 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:50:46.180881    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:50:53.290670 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:50:53.290630    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:51:00.901696 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:51:00.901654    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:51:10.878904 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:51:10.878871    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:51:21.984669 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:51:21.984636    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:51:30.481188 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:51:30.481136    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:51:53.882642 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:51:53.882604    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:52:04.975347 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:52:04.975311    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:52:20.322602 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:52:20.322561    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:52:20.993663 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:52:20.993630    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:52:21.726684 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:52:21.726651    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:52:31.089245 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:52:31.089204    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:52:40.484598 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:52:40.484562    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:52:49.277974 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:52:49.277924    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:52:58.876376 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:52:58.876344    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:53:52.957440 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:53:52.957404    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:54:47.895209 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:54:47.895128    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:54:58.085884 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:54:58.085850    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:55:08.489858 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:55:08.489817    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:55:19.284163 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:55:19.284125    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:55:20.038748 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:55:20.038719    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:55:20.135524 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:55:20.135495    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:55:23.092045 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:55:23.092016    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 15:55:23.092770 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:55:23.092741    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 15:55:29.084173 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:55:29.084132    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:55:40.179147 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:55:40.179107    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:55:49.716926 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:55:49.716892    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:56:00.391063 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:56:00.391027    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:56:10.386919 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:56:10.386888    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:56:20.493541 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:56:20.493464    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:56:31.284675 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:56:31.284641    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:56:53.405649 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:56:53.405605    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:56:55.492496 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:56:55.492462    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:57:02.682495 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:57:02.682457    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:57:11.788010 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:57:11.787977    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:57:22.699160 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:57:22.699132    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:57:33.685724 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:57:33.685692    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:57:44.986978 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:57:44.986881    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:57:56.286176 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:57:56.286140    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:58:06.974073 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:58:06.974038    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:58:13.987654 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:58:13.987615    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:58:24.486634 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:58:24.486601    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:58:33.987012 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:58:33.986978    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:58:46.989544 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:58:46.989514    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:58:55.585164 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:58:55.585133    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:59:06.596181 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:59:06.596146    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:59:16.482472 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:59:16.482384    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:59:17.255217 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:59:17.255181    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:59:20.394348 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:59:20.394310    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 15:59:28.484956 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:59:28.484922    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:59:36.177353 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:59:36.177317    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 15:59:49.288707 ip-10-0-135-178 kubenswrapper[2583]: I0715 15:59:49.288668    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:00:00.990284 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:00.990251    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:00:13.585960 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:13.585922    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:00:18.842256 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:18.842214    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:23.123468 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:23.123437    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 16:00:23.125711 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:23.125692    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 16:00:23.447532 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:23.447483    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:24.691314 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:24.691287    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:00:28.996700 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:28.996668    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:30.932476 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:30.932431    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:35.081080 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:35.081042    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:00:38.734975 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:38.734921    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:41.990538 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:41.990507    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:42.090035 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:42.090003    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:43.881172 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:43.881140    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:00:45.944393 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:45.944307    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:46.047359 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.047322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:46.188419 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.188389    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"]
Jul 15 16:00:46.191323 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.191306    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.194605 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.194550    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-08a5731c-openshift-default-dockercfg-x8bwg\""
Jul 15 16:00:46.225484 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.225463    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"]
Jul 15 16:00:46.266853 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.266825    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:46.283483 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.283461    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istiod-ca-cert\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.283596 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.283498    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-workload-socket\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.283596 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.283526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwdzm\" (UniqueName: \"kubernetes.io/projected/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-kube-api-access-hwdzm\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.283676 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.283634    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-workload-certs\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.283721 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.283678    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-data\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.283721 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.283699    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-podinfo\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.283791 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.283734    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-credential-socket\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.283791 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.283753    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-envoy\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.283791 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.283781    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-token\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.382297 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.382257    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:46.384726 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.384703    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-token\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.384823 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.384740    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istiod-ca-cert\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.384823 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.384811    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-workload-socket\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.384940 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.384852    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwdzm\" (UniqueName: \"kubernetes.io/projected/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-kube-api-access-hwdzm\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.384940 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.384929    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-workload-certs\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.385027 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.384998    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-data\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.385072 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.385029    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-podinfo\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.385072 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.385055    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-credential-socket\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.385183 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.385076    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-envoy\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.385343 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.385322    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-workload-socket\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.385466 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.385418    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-data\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.385466 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.385433    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-workload-certs\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.385648 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.385598    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-credential-socket\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.385648 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.385602    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istiod-ca-cert\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.387377 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.387357    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-envoy\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.387517 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.387498    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-podinfo\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.394823 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.394785    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwdzm\" (UniqueName: \"kubernetes.io/projected/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-kube-api-access-hwdzm\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.395692 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.395661    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-token\") pod \"e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") " pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.501784 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.501697    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:46.637731 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.637678    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"]
Jul 15 16:00:46.640057 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:00:46.640033    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5d8f14_0ad6_4cb8_ad5a_e2f6d4f02941.slice/crio-765aa49fd148dcb3731fe2d69ab2e1a7a8dccede68239be18ee5d28b32190517 WatchSource:0}: Error finding container 765aa49fd148dcb3731fe2d69ab2e1a7a8dccede68239be18ee5d28b32190517: Status 404 returned error can't find the container with id 765aa49fd148dcb3731fe2d69ab2e1a7a8dccede68239be18ee5d28b32190517
Jul 15 16:00:46.642093 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.642059    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:00:46.642172 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.642127    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:00:46.642172 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:46.642160    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:00:47.402572 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:47.402536    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:47.503168 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:47.503135    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:47.515559 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:47.515526    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp" event={"ID":"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941","Type":"ContainerStarted","Data":"2ea5b23f81fbc0b8c457a4eb9a650194d04a36517eb288cff0c1b2d5e0c2662d"}
Jul 15 16:00:47.515703 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:47.515576    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp" event={"ID":"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941","Type":"ContainerStarted","Data":"765aa49fd148dcb3731fe2d69ab2e1a7a8dccede68239be18ee5d28b32190517"}
Jul 15 16:00:47.538434 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:47.538378    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp" podStartSLOduration=1.5383591989999998 podStartE2EDuration="1.538359199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:00:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:00:47.537145404 +0000 UTC m=+1524.945918619" watchObservedRunningTime="2026-07-15 16:00:47.538359199 +0000 UTC m=+1524.947132390"
Jul 15 16:00:47.602088 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:47.602052    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:47.835481 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:47.835442    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:48.202917 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:48.202887    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:48.304964 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:48.304924    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:48.502359 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:48.502272    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:48.507020 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:48.506998    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:48.520259 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:48.520240    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:48.520874 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:48.520856    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:00:50.920609 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:50.920565    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:00:51.782004 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:51.781960    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:00:59.579629 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:59.579595    2583 generic.go:356] "Generic (PLEG): container finished" podID="8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" containerID="2ea5b23f81fbc0b8c457a4eb9a650194d04a36517eb288cff0c1b2d5e0c2662d" exitCode=0
Jul 15 16:00:59.583989 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:59.583933    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp" event={"ID":"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941","Type":"ContainerDied","Data":"2ea5b23f81fbc0b8c457a4eb9a650194d04a36517eb288cff0c1b2d5e0c2662d"}
Jul 15 16:00:59.584324 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:59.584306    2583 scope.go:117] "RemoveContainer" containerID="2ea5b23f81fbc0b8c457a4eb9a650194d04a36517eb288cff0c1b2d5e0c2662d"
Jul 15 16:00:59.585309 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:59.585281    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:00:59.585411 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:59.585345    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:00:59.585411 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:00:59.585378    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:01:00.586931 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:01:00.586898    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp" event={"ID":"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941","Type":"ContainerStarted","Data":"5d306a4f7a970b9d2e356db6b7e26aaac7936ad9adb04254765d0e5259a2722e"}
Jul 15 16:01:01.502219 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:01:01.502187    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:01:01.503393 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:01:01.503365    2583 patch_prober.go:28] interesting pod/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 15 16:01:01.503512 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:01:01.503425    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp" podUID="8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 15 16:01:02.502914 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:01:02.502871    2583 patch_prober.go:28] interesting pod/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 15 16:01:02.503415 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:01:02.502936    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp" podUID="8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 15 16:01:03.502488 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:01:03.502451    2583 patch_prober.go:28] interesting pod/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 15 16:01:03.502663 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:01:03.502505    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp" podUID="8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 15 16:01:03.520512 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:01:03.520490    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:01:04.502556 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:01:04.502513    2583 patch_prober.go:28] interesting pod/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 15 16:01:04.502758 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:01:04.502574    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp" podUID="8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 15 16:01:05.505622 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:01:05.505596    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:01:05.506485 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:01:05.506465    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:02:02.938259 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:02.938226    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:05.780172 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:05.780135    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:02:07.539228 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:07.539195    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:10.817789 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:10.817751    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:14.046364 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:14.046328    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:14.146045 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:14.146022    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:17.721600 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:17.721529    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"]
Jul 15 16:02:17.722043 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:17.721730    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp" podUID="8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" containerName="istio-proxy" containerID="cri-o://5d306a4f7a970b9d2e356db6b7e26aaac7936ad9adb04254765d0e5259a2722e" gracePeriod=30
Jul 15 16:02:17.753199 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:17.753164    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:18.135084 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.134992    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:18.233317 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.233281    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:18.326517 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.326487    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"]
Jul 15 16:02:18.330269 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.330238    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.335491 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.335467    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-f9b8f1b9-gw-openshift-default-dockercfg-wlvt6\""
Jul 15 16:02:18.353068 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.353041    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"]
Jul 15 16:02:18.392915 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.392842    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:18.498244 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.498210    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-podinfo\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.498428 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.498270    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-token\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.498428 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.498346    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-envoy\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.498428 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.498384    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-credential-socket\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.498428 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.498405    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-workload-certs\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.498428 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.498427    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-data\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.498644 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.498489    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-workload-socket\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.498644 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.498556    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istiod-ca-cert\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.498644 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.498578    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vzn7\" (UniqueName: \"kubernetes.io/projected/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-kube-api-access-6vzn7\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.599910 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.599878    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-podinfo\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.600081 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.599965    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-token\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.600081 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.600005    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-envoy\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.600167 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.600145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-credential-socket\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.600203 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.600193    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-workload-certs\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.600244 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.600229    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-data\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.600281 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.600269    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-workload-socket\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.600346 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.600324    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istiod-ca-cert\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.600400 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.600357    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vzn7\" (UniqueName: \"kubernetes.io/projected/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-kube-api-access-6vzn7\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.600543 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.600519    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-credential-socket\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.600727 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.600676    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-data\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.600834 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.600739    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-workload-certs\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.600834 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.600778    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-workload-socket\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.601008 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.600991    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istiod-ca-cert\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.602760 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.602740    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-envoy\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.602984 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.602967    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-podinfo\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.608614 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.608587    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-token\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.609197 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.609181    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vzn7\" (UniqueName: \"kubernetes.io/projected/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-kube-api-access-6vzn7\") pod \"e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") " pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.640167 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.640148    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:18.775632 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.775604    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"]
Jul 15 16:02:18.777655 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:02:18.777619    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a3975e7_7d9c_47a0_ac7c_b1641990cb18.slice/crio-9d1a99097babad612b3e01f806bccc5fe2d674d5a235ae0c702e25b26c790733 WatchSource:0}: Error finding container 9d1a99097babad612b3e01f806bccc5fe2d674d5a235ae0c702e25b26c790733: Status 404 returned error can't find the container with id 9d1a99097babad612b3e01f806bccc5fe2d674d5a235ae0c702e25b26c790733
Jul 15 16:02:18.779766 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.779733    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:02:18.779872 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.779813    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:02:18.779872 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.779855    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:02:18.963710 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.963676    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk" event={"ID":"4a3975e7-7d9c-47a0-ac7c-b1641990cb18","Type":"ContainerStarted","Data":"3766c3826a823c60daeb3b00271e39159e5dbdf2266bca299d30640d4560930c"}
Jul 15 16:02:18.963873 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.963742    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk" event={"ID":"4a3975e7-7d9c-47a0-ac7c-b1641990cb18","Type":"ContainerStarted","Data":"9d1a99097babad612b3e01f806bccc5fe2d674d5a235ae0c702e25b26c790733"}
Jul 15 16:02:18.985986 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:18.985924    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk" podStartSLOduration=0.985909821 podStartE2EDuration="985.909821ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:02:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:02:18.984713958 +0000 UTC m=+1616.393487186" watchObservedRunningTime="2026-07-15 16:02:18.985909821 +0000 UTC m=+1616.394683015"
Jul 15 16:02:19.641116 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:19.641075    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:19.645586 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:19.645563    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:19.700155 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:19.700120    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:19.866123 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:19.866084    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:19.969027 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:19.969003    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:19.969923 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:19.969906    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:19.986195 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:19.986170    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:20.406935 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:20.406855    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:20.508240 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:20.508209    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:20.509019 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:20.508982    2583 patch_prober.go:28] interesting pod/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 16:02:20.509098 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:20.509055    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp" podUID="8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:02:22.978870 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:22.978850    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:02:22.984334 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:22.984277    2583 generic.go:356] "Generic (PLEG): container finished" podID="8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" containerID="5d306a4f7a970b9d2e356db6b7e26aaac7936ad9adb04254765d0e5259a2722e" exitCode=0
Jul 15 16:02:22.984334 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:22.984316    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"
Jul 15 16:02:22.984334 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:22.984326    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp" event={"ID":"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941","Type":"ContainerDied","Data":"5d306a4f7a970b9d2e356db6b7e26aaac7936ad9adb04254765d0e5259a2722e"}
Jul 15 16:02:22.984541 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:22.984373    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp" event={"ID":"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941","Type":"ContainerDied","Data":"765aa49fd148dcb3731fe2d69ab2e1a7a8dccede68239be18ee5d28b32190517"}
Jul 15 16:02:22.984541 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:22.984398    2583 scope.go:117] "RemoveContainer" containerID="5d306a4f7a970b9d2e356db6b7e26aaac7936ad9adb04254765d0e5259a2722e"
Jul 15 16:02:22.992214 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:22.992193    2583 scope.go:117] "RemoveContainer" containerID="2ea5b23f81fbc0b8c457a4eb9a650194d04a36517eb288cff0c1b2d5e0c2662d"
Jul 15 16:02:22.999987 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:22.999971    2583 scope.go:117] "RemoveContainer" containerID="5d306a4f7a970b9d2e356db6b7e26aaac7936ad9adb04254765d0e5259a2722e"
Jul 15 16:02:23.000224 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:02:23.000203    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d306a4f7a970b9d2e356db6b7e26aaac7936ad9adb04254765d0e5259a2722e\": container with ID starting with 5d306a4f7a970b9d2e356db6b7e26aaac7936ad9adb04254765d0e5259a2722e not found: ID does not exist" containerID="5d306a4f7a970b9d2e356db6b7e26aaac7936ad9adb04254765d0e5259a2722e"
Jul 15 16:02:23.000287 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.000232    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d306a4f7a970b9d2e356db6b7e26aaac7936ad9adb04254765d0e5259a2722e"} err="failed to get container status \"5d306a4f7a970b9d2e356db6b7e26aaac7936ad9adb04254765d0e5259a2722e\": rpc error: code = NotFound desc = could not find container \"5d306a4f7a970b9d2e356db6b7e26aaac7936ad9adb04254765d0e5259a2722e\": container with ID starting with 5d306a4f7a970b9d2e356db6b7e26aaac7936ad9adb04254765d0e5259a2722e not found: ID does not exist"
Jul 15 16:02:23.000287 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.000250    2583 scope.go:117] "RemoveContainer" containerID="2ea5b23f81fbc0b8c457a4eb9a650194d04a36517eb288cff0c1b2d5e0c2662d"
Jul 15 16:02:23.000473 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:02:23.000458    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ea5b23f81fbc0b8c457a4eb9a650194d04a36517eb288cff0c1b2d5e0c2662d\": container with ID starting with 2ea5b23f81fbc0b8c457a4eb9a650194d04a36517eb288cff0c1b2d5e0c2662d not found: ID does not exist" containerID="2ea5b23f81fbc0b8c457a4eb9a650194d04a36517eb288cff0c1b2d5e0c2662d"
Jul 15 16:02:23.000510 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.000480    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ea5b23f81fbc0b8c457a4eb9a650194d04a36517eb288cff0c1b2d5e0c2662d"} err="failed to get container status \"2ea5b23f81fbc0b8c457a4eb9a650194d04a36517eb288cff0c1b2d5e0c2662d\": rpc error: code = NotFound desc = could not find container \"2ea5b23f81fbc0b8c457a4eb9a650194d04a36517eb288cff0c1b2d5e0c2662d\": container with ID starting with 2ea5b23f81fbc0b8c457a4eb9a650194d04a36517eb288cff0c1b2d5e0c2662d not found: ID does not exist"
Jul 15 16:02:23.142810 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.142779    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-envoy\") pod \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") "
Jul 15 16:02:23.142994 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.142814    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istiod-ca-cert\") pod \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") "
Jul 15 16:02:23.142994 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.142835    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-podinfo\") pod \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") "
Jul 15 16:02:23.142994 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.142854    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-workload-socket\") pod \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") "
Jul 15 16:02:23.142994 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.142879    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-workload-certs\") pod \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") "
Jul 15 16:02:23.142994 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.142903    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-token\") pod \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") "
Jul 15 16:02:23.143273 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.143048    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwdzm\" (UniqueName: \"kubernetes.io/projected/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-kube-api-access-hwdzm\") pod \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") "
Jul 15 16:02:23.143273 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.143131    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-data\") pod \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") "
Jul 15 16:02:23.143273 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.143170    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-credential-socket\") pod \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\" (UID: \"8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941\") "
Jul 15 16:02:23.143273 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.143198    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" (UID: "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:02:23.143273 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.143218    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" (UID: "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:02:23.143555 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.143301    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" (UID: "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:02:23.143555 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.143500    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" (UID: "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:02:23.143698 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.143661    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-credential-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:02:23.143698 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.143686    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istiod-ca-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:02:23.143781 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.143700    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-workload-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:02:23.143781 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.143714    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-workload-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:02:23.144152 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.144128    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" (UID: "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:02:23.145109 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.145081    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" (UID: "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:02:23.145235 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.145218    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" (UID: "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:02:23.145549 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.145530    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-kube-api-access-hwdzm" (OuterVolumeSpecName: "kube-api-access-hwdzm") pod "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" (UID: "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941"). InnerVolumeSpecName "kube-api-access-hwdzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:02:23.145622 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.145559    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" (UID: "8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:02:23.245042 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.244992    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-data\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:02:23.245042 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.245013    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-envoy\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:02:23.245042 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.245021    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-podinfo\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:02:23.245042 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.245029    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-istio-token\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:02:23.245042 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.245038    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwdzm\" (UniqueName: \"kubernetes.io/projected/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941-kube-api-access-hwdzm\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:02:23.305501 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.305351    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"]
Jul 15 16:02:23.307327 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.307307    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-08a5731c-openshift-default-6c577945bc-bsvkp"]
Jul 15 16:02:23.586482 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:23.586401    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" path="/var/lib/kubelet/pods/8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941/volumes"
Jul 15 16:02:27.188346 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:27.188307    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:02:29.106113 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:29.106074    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:29.206372 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:29.206332    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:32.376621 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:32.376586    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:02:36.011112 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:36.011071    2583 patch_prober.go:28] interesting pod/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 16:02:36.011505 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:36.011136    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk" podUID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 16:02:37.049054 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:37.049008    2583 generic.go:356] "Generic (PLEG): container finished" podID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" containerID="3766c3826a823c60daeb3b00271e39159e5dbdf2266bca299d30640d4560930c" exitCode=0
Jul 15 16:02:37.049054 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:37.049058    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk" event={"ID":"4a3975e7-7d9c-47a0-ac7c-b1641990cb18","Type":"ContainerDied","Data":"3766c3826a823c60daeb3b00271e39159e5dbdf2266bca299d30640d4560930c"}
Jul 15 16:02:37.049539 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:37.049409    2583 scope.go:117] "RemoveContainer" containerID="3766c3826a823c60daeb3b00271e39159e5dbdf2266bca299d30640d4560930c"
Jul 15 16:02:37.050429 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:37.050396    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:02:37.050551 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:37.050467    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:02:37.050551 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:37.050497    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:02:38.055473 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:38.055439    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk" event={"ID":"4a3975e7-7d9c-47a0-ac7c-b1641990cb18","Type":"ContainerStarted","Data":"1637d244d91506a301a4f0126991d637728a6e07b3d129eec96cb2ba8de981df"}
Jul 15 16:02:38.640387 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:38.640350    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:38.640587 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:38.640551    2583 patch_prober.go:28] interesting pod/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 15 16:02:38.640667 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:38.640625    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk" podUID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 15 16:02:39.641250 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:39.641190    2583 patch_prober.go:28] interesting pod/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 15 16:02:39.641786 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:39.641276    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk" podUID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 15 16:02:40.640994 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:40.640926    2583 patch_prober.go:28] interesting pod/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 15 16:02:40.641198 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:40.641017    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk" podUID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 15 16:02:41.641031 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:41.640994    2583 patch_prober.go:28] interesting pod/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 15 16:02:41.641529 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:41.641070    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk" podUID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 15 16:02:42.641318 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:42.641112    2583 patch_prober.go:28] interesting pod/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 15 16:02:42.641318 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:42.641174    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk" podUID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 15 16:02:43.641308 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:43.641267    2583 patch_prober.go:28] interesting pod/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 15 16:02:43.641491 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:43.641330    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk" podUID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 15 16:02:44.644141 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:44.644111    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:44.644557 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:44.644373    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:02:44.644892 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:02:44.644877    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:03:24.240607 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:24.240565    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"]
Jul 15 16:03:24.241227 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:24.240826    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk" podUID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" containerName="istio-proxy" containerID="cri-o://1637d244d91506a301a4f0126991d637728a6e07b3d129eec96cb2ba8de981df" gracePeriod=30
Jul 15 16:03:24.267474 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:24.267441    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:24.367263 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:24.367202    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:24.762768 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:24.762734    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:26.926799 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:26.926764    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:03:29.497198 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.497175    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:03:29.528285 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.528209    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-data\") pod \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") "
Jul 15 16:03:29.528285 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.528258    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-podinfo\") pod \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") "
Jul 15 16:03:29.528471 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.528305    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vzn7\" (UniqueName: \"kubernetes.io/projected/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-kube-api-access-6vzn7\") pod \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") "
Jul 15 16:03:29.528471 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.528358    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-credential-socket\") pod \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") "
Jul 15 16:03:29.528471 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.528385    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istiod-ca-cert\") pod \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") "
Jul 15 16:03:29.528471 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.528440    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-workload-certs\") pod \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") "
Jul 15 16:03:29.528471 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.528464    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-workload-socket\") pod \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") "
Jul 15 16:03:29.528727 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.528493    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-envoy\") pod \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") "
Jul 15 16:03:29.528727 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.528559    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-token\") pod \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\" (UID: \"4a3975e7-7d9c-47a0-ac7c-b1641990cb18\") "
Jul 15 16:03:29.528727 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.528634    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4a3975e7-7d9c-47a0-ac7c-b1641990cb18" (UID: "4a3975e7-7d9c-47a0-ac7c-b1641990cb18"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:03:29.528869 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.528733    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4a3975e7-7d9c-47a0-ac7c-b1641990cb18" (UID: "4a3975e7-7d9c-47a0-ac7c-b1641990cb18"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:03:29.529087 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.528920    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4a3975e7-7d9c-47a0-ac7c-b1641990cb18" (UID: "4a3975e7-7d9c-47a0-ac7c-b1641990cb18"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:03:29.529087 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.528986    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4a3975e7-7d9c-47a0-ac7c-b1641990cb18" (UID: "4a3975e7-7d9c-47a0-ac7c-b1641990cb18"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:03:29.529087 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.529004    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-workload-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:03:29.529087 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.529024    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-credential-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:03:29.530357 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.530325    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-data" (OuterVolumeSpecName: "istio-data") pod "4a3975e7-7d9c-47a0-ac7c-b1641990cb18" (UID: "4a3975e7-7d9c-47a0-ac7c-b1641990cb18"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:03:29.531532 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.531492    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-kube-api-access-6vzn7" (OuterVolumeSpecName: "kube-api-access-6vzn7") pod "4a3975e7-7d9c-47a0-ac7c-b1641990cb18" (UID: "4a3975e7-7d9c-47a0-ac7c-b1641990cb18"). InnerVolumeSpecName "kube-api-access-6vzn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:03:29.532446 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.532421    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4a3975e7-7d9c-47a0-ac7c-b1641990cb18" (UID: "4a3975e7-7d9c-47a0-ac7c-b1641990cb18"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:03:29.532562 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.532448    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-token" (OuterVolumeSpecName: "istio-token") pod "4a3975e7-7d9c-47a0-ac7c-b1641990cb18" (UID: "4a3975e7-7d9c-47a0-ac7c-b1641990cb18"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:03:29.532562 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.532518    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4a3975e7-7d9c-47a0-ac7c-b1641990cb18" (UID: "4a3975e7-7d9c-47a0-ac7c-b1641990cb18"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:03:29.629649 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.629621    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-token\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:03:29.629649 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.629644    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-data\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:03:29.629649 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.629653    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-podinfo\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:03:29.629825 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.629662    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vzn7\" (UniqueName: \"kubernetes.io/projected/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-kube-api-access-6vzn7\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:03:29.629825 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.629672    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istiod-ca-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:03:29.629825 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.629680    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-workload-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:03:29.629825 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:29.629690    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a3975e7-7d9c-47a0-ac7c-b1641990cb18-istio-envoy\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:03:30.304626 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:30.304593    2583 generic.go:356] "Generic (PLEG): container finished" podID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" containerID="1637d244d91506a301a4f0126991d637728a6e07b3d129eec96cb2ba8de981df" exitCode=0
Jul 15 16:03:30.304813 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:30.304643    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"
Jul 15 16:03:30.304813 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:30.304674    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk" event={"ID":"4a3975e7-7d9c-47a0-ac7c-b1641990cb18","Type":"ContainerDied","Data":"1637d244d91506a301a4f0126991d637728a6e07b3d129eec96cb2ba8de981df"}
Jul 15 16:03:30.304813 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:30.304727    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk" event={"ID":"4a3975e7-7d9c-47a0-ac7c-b1641990cb18","Type":"ContainerDied","Data":"9d1a99097babad612b3e01f806bccc5fe2d674d5a235ae0c702e25b26c790733"}
Jul 15 16:03:30.304813 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:30.304750    2583 scope.go:117] "RemoveContainer" containerID="1637d244d91506a301a4f0126991d637728a6e07b3d129eec96cb2ba8de981df"
Jul 15 16:03:30.312911 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:30.312896    2583 scope.go:117] "RemoveContainer" containerID="3766c3826a823c60daeb3b00271e39159e5dbdf2266bca299d30640d4560930c"
Jul 15 16:03:30.320373 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:30.320357    2583 scope.go:117] "RemoveContainer" containerID="1637d244d91506a301a4f0126991d637728a6e07b3d129eec96cb2ba8de981df"
Jul 15 16:03:30.320655 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:03:30.320638    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1637d244d91506a301a4f0126991d637728a6e07b3d129eec96cb2ba8de981df\": container with ID starting with 1637d244d91506a301a4f0126991d637728a6e07b3d129eec96cb2ba8de981df not found: ID does not exist" containerID="1637d244d91506a301a4f0126991d637728a6e07b3d129eec96cb2ba8de981df"
Jul 15 16:03:30.320706 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:30.320664    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1637d244d91506a301a4f0126991d637728a6e07b3d129eec96cb2ba8de981df"} err="failed to get container status \"1637d244d91506a301a4f0126991d637728a6e07b3d129eec96cb2ba8de981df\": rpc error: code = NotFound desc = could not find container \"1637d244d91506a301a4f0126991d637728a6e07b3d129eec96cb2ba8de981df\": container with ID starting with 1637d244d91506a301a4f0126991d637728a6e07b3d129eec96cb2ba8de981df not found: ID does not exist"
Jul 15 16:03:30.320706 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:30.320680    2583 scope.go:117] "RemoveContainer" containerID="3766c3826a823c60daeb3b00271e39159e5dbdf2266bca299d30640d4560930c"
Jul 15 16:03:30.320972 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:03:30.320939    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3766c3826a823c60daeb3b00271e39159e5dbdf2266bca299d30640d4560930c\": container with ID starting with 3766c3826a823c60daeb3b00271e39159e5dbdf2266bca299d30640d4560930c not found: ID does not exist" containerID="3766c3826a823c60daeb3b00271e39159e5dbdf2266bca299d30640d4560930c"
Jul 15 16:03:30.321026 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:30.320976    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3766c3826a823c60daeb3b00271e39159e5dbdf2266bca299d30640d4560930c"} err="failed to get container status \"3766c3826a823c60daeb3b00271e39159e5dbdf2266bca299d30640d4560930c\": rpc error: code = NotFound desc = could not find container \"3766c3826a823c60daeb3b00271e39159e5dbdf2266bca299d30640d4560930c\": container with ID starting with 3766c3826a823c60daeb3b00271e39159e5dbdf2266bca299d30640d4560930c not found: ID does not exist"
Jul 15 16:03:30.332307 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:30.332285    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"]
Jul 15 16:03:30.357036 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:30.357013    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-f9b8f1b9-gw-openshift-default-77fbd77fff-fm8lk"]
Jul 15 16:03:30.757519 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:30.757481    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:31.008697 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.008597    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:31.119930 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.119897    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:31.236496 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.236464    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"]
Jul 15 16:03:31.236878 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.236865    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" containerName="istio-proxy"
Jul 15 16:03:31.236927 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.236879    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" containerName="istio-proxy"
Jul 15 16:03:31.236927 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.236889    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" containerName="istio-proxy"
Jul 15 16:03:31.236927 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.236895    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" containerName="istio-proxy"
Jul 15 16:03:31.236927 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.236903    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" containerName="istio-proxy"
Jul 15 16:03:31.236927 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.236908    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" containerName="istio-proxy"
Jul 15 16:03:31.236927 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.236923    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" containerName="istio-proxy"
Jul 15 16:03:31.236927 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.236927    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" containerName="istio-proxy"
Jul 15 16:03:31.237194 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.237013    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" containerName="istio-proxy"
Jul 15 16:03:31.237194 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.237023    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b5d8f14-0ad6-4cb8-ad5a-e2f6d4f02941" containerName="istio-proxy"
Jul 15 16:03:31.237194 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.237031    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" containerName="istio-proxy"
Jul 15 16:03:31.237194 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.237037    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" containerName="istio-proxy"
Jul 15 16:03:31.240233 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.240214    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.242896 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.242880    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-18e9c399-openshift-default-dockercfg-ccjcw\""
Jul 15 16:03:31.253612 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.253588    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"]
Jul 15 16:03:31.294196 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.294123    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:31.344794 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.344757    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-envoy\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.345020 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.344818    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istiod-ca-cert\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.345020 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.344859    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-workload-certs\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.345020 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.344914    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-data\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.345236 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.345020    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfw5c\" (UniqueName: \"kubernetes.io/projected/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-kube-api-access-gfw5c\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.345236 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.345071    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-workload-socket\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.345236 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.345146    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-podinfo\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.345236 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.345217    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-credential-socket\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.345407 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.345272    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-token\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.372714 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.372681    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:31.446520 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.446488    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istiod-ca-cert\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.446709 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.446529    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-workload-certs\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.446709 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.446551    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-data\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.446709 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.446577    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfw5c\" (UniqueName: \"kubernetes.io/projected/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-kube-api-access-gfw5c\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.446709 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.446602    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-workload-socket\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.446709 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.446627    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-podinfo\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.446709 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.446652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-credential-socket\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.446709 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.446696    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-token\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.447176 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.446727    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-envoy\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.447176 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.447021    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-workload-certs\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.447176 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.447084    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-workload-socket\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.447294 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.447189    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-credential-socket\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.447294 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.447222    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-data\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.447371 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.447308    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istiod-ca-cert\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.449130 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.449108    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-envoy\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.449247 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.449189    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-podinfo\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.454581 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.454557    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-token\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.455049 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.455033    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfw5c\" (UniqueName: \"kubernetes.io/projected/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-kube-api-access-gfw5c\") pod \"e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") " pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.551686 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.551601    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:31.586731 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.586701    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a3975e7-7d9c-47a0-ac7c-b1641990cb18" path="/var/lib/kubelet/pods/4a3975e7-7d9c-47a0-ac7c-b1641990cb18/volumes"
Jul 15 16:03:31.689073 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.689050    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"]
Jul 15 16:03:31.691074 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:03:31.691042    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a6f6ff9_d0bd_43d2_9c29_4564984c7139.slice/crio-966e6638494f849997454b4f8e085a8a5ece3b08284b13dedf5267c8b67a4971 WatchSource:0}: Error finding container 966e6638494f849997454b4f8e085a8a5ece3b08284b13dedf5267c8b67a4971: Status 404 returned error can't find the container with id 966e6638494f849997454b4f8e085a8a5ece3b08284b13dedf5267c8b67a4971
Jul 15 16:03:31.693653 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.693622    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:03:31.693726 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.693683    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:03:31.693726 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:31.693710    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:03:32.317935 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:32.317896    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2" event={"ID":"8a6f6ff9-d0bd-43d2-9c29-4564984c7139","Type":"ContainerStarted","Data":"d378561dc6827013a2e8f38e241b463fede58d30ab28e131368aede2eb27e1ba"}
Jul 15 16:03:32.318441 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:32.317979    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2" event={"ID":"8a6f6ff9-d0bd-43d2-9c29-4564984c7139","Type":"ContainerStarted","Data":"966e6638494f849997454b4f8e085a8a5ece3b08284b13dedf5267c8b67a4971"}
Jul 15 16:03:32.343940 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:32.343885    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2" podStartSLOduration=1.34386697 podStartE2EDuration="1.34386697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:03:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:03:32.342435953 +0000 UTC m=+1689.751209144" watchObservedRunningTime="2026-07-15 16:03:32.34386697 +0000 UTC m=+1689.752640160"
Jul 15 16:03:32.419860 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:32.419820    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:32.506232 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:32.506197    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:32.552386 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:32.552353    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:32.556874 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:32.556849    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:32.588289 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:32.588178    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:32.729823 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:32.729791    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:33.096908 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:33.096873    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:33.199393 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:33.199364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:33.324139 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:33.324105    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:33.325282 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:33.325264    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:35.168103 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:35.168069    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:38.916581 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:38.916539    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:03:47.395410 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:47.395370    2583 generic.go:356] "Generic (PLEG): container finished" podID="8a6f6ff9-d0bd-43d2-9c29-4564984c7139" containerID="d378561dc6827013a2e8f38e241b463fede58d30ab28e131368aede2eb27e1ba" exitCode=0
Jul 15 16:03:47.395942 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:47.395450    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2" event={"ID":"8a6f6ff9-d0bd-43d2-9c29-4564984c7139","Type":"ContainerDied","Data":"d378561dc6827013a2e8f38e241b463fede58d30ab28e131368aede2eb27e1ba"}
Jul 15 16:03:47.396058 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:47.396041    2583 scope.go:117] "RemoveContainer" containerID="d378561dc6827013a2e8f38e241b463fede58d30ab28e131368aede2eb27e1ba"
Jul 15 16:03:47.397106 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:47.397070    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:03:47.397216 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:47.397140    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:03:47.397216 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:47.397171    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:03:48.324490 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:48.324452    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:48.402067 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:48.402029    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2" event={"ID":"8a6f6ff9-d0bd-43d2-9c29-4564984c7139","Type":"ContainerStarted","Data":"be7c252757aca885cde63d9516faec2cc0f64c05709968018aad80a6400f0885"}
Jul 15 16:03:48.553823 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:48.553782    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:48.554605 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:48.554578    2583 patch_prober.go:28] interesting pod/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 15 16:03:48.554731 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:48.554627    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2" podUID="8a6f6ff9-d0bd-43d2-9c29-4564984c7139" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 15 16:03:49.552187 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:49.552141    2583 patch_prober.go:28] interesting pod/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 15 16:03:49.552662 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:49.552210    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2" podUID="8a6f6ff9-d0bd-43d2-9c29-4564984c7139" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 15 16:03:50.552983 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:50.552923    2583 patch_prober.go:28] interesting pod/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 15 16:03:50.553470 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:50.553016    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2" podUID="8a6f6ff9-d0bd-43d2-9c29-4564984c7139" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 15 16:03:51.552493 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:51.552449    2583 patch_prober.go:28] interesting pod/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 15 16:03:51.552695 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:51.552519    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2" podUID="8a6f6ff9-d0bd-43d2-9c29-4564984c7139" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 15 16:03:52.555565 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:52.555535    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:52.556016 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:52.555800    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:52.556573 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:52.556555    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:03:57.506971 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:57.506898    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:57.608391 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:57.608355    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:58.442627 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:58.442596    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:03:58.545967 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:03:58.545915    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:38.041876 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:38.041837    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:40.693706 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:40.693672    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:04:42.618282 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:42.618245    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:48.779673 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:48.779635    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:48.853707 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:48.853677    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:53.674071 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:53.674025    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"]
Jul 15 16:04:53.674517 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:53.674225    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2" podUID="8a6f6ff9-d0bd-43d2-9c29-4564984c7139" containerName="istio-proxy" containerID="cri-o://be7c252757aca885cde63d9516faec2cc0f64c05709968018aad80a6400f0885" gracePeriod=30
Jul 15 16:04:53.699776 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:53.699744    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:53.980035 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:53.980002    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"]
Jul 15 16:04:53.982677 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:53.982652    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:53.985864 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:53.985843    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-5299c21f-openshift-default-dockercfg-rglfw\""
Jul 15 16:04:53.998543 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:53.998517    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"]
Jul 15 16:04:54.014347 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.014314    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drzpt\" (UniqueName: \"kubernetes.io/projected/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-kube-api-access-drzpt\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.014498 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.014353    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-data\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.014498 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.014434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istiod-ca-cert\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.014498 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.014483    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-credential-socket\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.014600 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.014560    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-workload-certs\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.014600 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.014589    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-podinfo\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.014684 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.014609    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-envoy\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.014684 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.014642    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-workload-socket\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.014684 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.014667    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-token\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.016520 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.016491    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:54.115385 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.115350    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-credential-socket\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.115570 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.115411    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-workload-certs\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.115570 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.115448    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-podinfo\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.115570 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.115476    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-envoy\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.115570 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.115514    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-workload-socket\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.115570 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.115542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-token\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.115827 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.115582    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drzpt\" (UniqueName: \"kubernetes.io/projected/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-kube-api-access-drzpt\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.115827 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.115613    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-data\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.115827 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.115672    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istiod-ca-cert\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.115827 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.115784    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-credential-socket\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.115827 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.115820    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-workload-certs\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.116100 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.115919    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-workload-socket\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.116100 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.116079    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-data\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.116308 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.116282    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istiod-ca-cert\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.117812 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.117790    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-envoy\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.118046 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.118026    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-podinfo\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.125847 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.125817    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-token\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.126293 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.126274    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drzpt\" (UniqueName: \"kubernetes.io/projected/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-kube-api-access-drzpt\") pod \"e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") " pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.293310 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.293227    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:54.429781 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.429754    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"]
Jul 15 16:04:54.431856 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:04:54.431825    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded333eb9_8ee4_4dc0_9e8b_4af79d15c5fd.slice/crio-657fc5365cdfb422a91586e78dec4dc044ae9d4b244622a5c8b3feec5f2b364c WatchSource:0}: Error finding container 657fc5365cdfb422a91586e78dec4dc044ae9d4b244622a5c8b3feec5f2b364c: Status 404 returned error can't find the container with id 657fc5365cdfb422a91586e78dec4dc044ae9d4b244622a5c8b3feec5f2b364c
Jul 15 16:04:54.434449 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.434416    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:04:54.434536 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.434484    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:04:54.434536 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.434511    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:04:54.720434 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.720399    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p" event={"ID":"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd","Type":"ContainerStarted","Data":"720ddf238dc41facf212b9f3fe3562109d51653f15ae4f5523532e4814a5d4ea"}
Jul 15 16:04:54.720800 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.720456    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p" event={"ID":"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd","Type":"ContainerStarted","Data":"657fc5365cdfb422a91586e78dec4dc044ae9d4b244622a5c8b3feec5f2b364c"}
Jul 15 16:04:54.743818 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:54.743764    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p" podStartSLOduration=1.743748925 podStartE2EDuration="1.743748925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:04:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:04:54.742335041 +0000 UTC m=+1772.151108243" watchObservedRunningTime="2026-07-15 16:04:54.743748925 +0000 UTC m=+1772.152522116"
Jul 15 16:04:55.236818 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:55.236786    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:55.293616 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:55.293582    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:55.298131 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:55.298113    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:55.335940 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:55.335915    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:55.472849 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:55.472817    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:55.724898 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:55.724873    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:55.725627 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:55.725610    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:04:55.778172 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:55.778142    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:56.096302 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:56.096226    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:56.194964 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:56.194914    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:04:58.926260 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:58.926236    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:04:59.061620 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.061589    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-envoy\") pod \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") "
Jul 15 16:04:59.061777 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.061633    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-workload-certs\") pod \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") "
Jul 15 16:04:59.061777 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.061680    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-credential-socket\") pod \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") "
Jul 15 16:04:59.061777 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.061714    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfw5c\" (UniqueName: \"kubernetes.io/projected/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-kube-api-access-gfw5c\") pod \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") "
Jul 15 16:04:59.061777 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.061737    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-data\") pod \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") "
Jul 15 16:04:59.062026 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.061818    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istiod-ca-cert\") pod \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") "
Jul 15 16:04:59.062026 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.061846    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-podinfo\") pod \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") "
Jul 15 16:04:59.062026 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.061875    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-workload-socket\") pod \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") "
Jul 15 16:04:59.062026 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.061903    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-token\") pod \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\" (UID: \"8a6f6ff9-d0bd-43d2-9c29-4564984c7139\") "
Jul 15 16:04:59.062212 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.062028    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a6f6ff9-d0bd-43d2-9c29-4564984c7139" (UID: "8a6f6ff9-d0bd-43d2-9c29-4564984c7139"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:04:59.062212 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.062072    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a6f6ff9-d0bd-43d2-9c29-4564984c7139" (UID: "8a6f6ff9-d0bd-43d2-9c29-4564984c7139"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:04:59.062413 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.062248    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-workload-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:04:59.062413 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.062268    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-credential-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:04:59.062413 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.062272    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a6f6ff9-d0bd-43d2-9c29-4564984c7139" (UID: "8a6f6ff9-d0bd-43d2-9c29-4564984c7139"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:04:59.062413 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.062301    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a6f6ff9-d0bd-43d2-9c29-4564984c7139" (UID: "8a6f6ff9-d0bd-43d2-9c29-4564984c7139"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:04:59.062848 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.062821    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a6f6ff9-d0bd-43d2-9c29-4564984c7139" (UID: "8a6f6ff9-d0bd-43d2-9c29-4564984c7139"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:04:59.063723 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.063697    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a6f6ff9-d0bd-43d2-9c29-4564984c7139" (UID: "8a6f6ff9-d0bd-43d2-9c29-4564984c7139"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:04:59.064227 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.064202    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-kube-api-access-gfw5c" (OuterVolumeSpecName: "kube-api-access-gfw5c") pod "8a6f6ff9-d0bd-43d2-9c29-4564984c7139" (UID: "8a6f6ff9-d0bd-43d2-9c29-4564984c7139"). InnerVolumeSpecName "kube-api-access-gfw5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:04:59.064227 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.064220    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a6f6ff9-d0bd-43d2-9c29-4564984c7139" (UID: "8a6f6ff9-d0bd-43d2-9c29-4564984c7139"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:04:59.064354 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.064273    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a6f6ff9-d0bd-43d2-9c29-4564984c7139" (UID: "8a6f6ff9-d0bd-43d2-9c29-4564984c7139"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:04:59.163397 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.163372    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-envoy\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:04:59.163397 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.163396    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfw5c\" (UniqueName: \"kubernetes.io/projected/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-kube-api-access-gfw5c\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:04:59.163559 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.163408    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-data\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:04:59.163559 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.163420    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istiod-ca-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:04:59.163559 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.163430    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-podinfo\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:04:59.163559 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.163443    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-workload-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:04:59.163559 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.163456    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a6f6ff9-d0bd-43d2-9c29-4564984c7139-istio-token\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:04:59.744039 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.744010    2583 generic.go:356] "Generic (PLEG): container finished" podID="8a6f6ff9-d0bd-43d2-9c29-4564984c7139" containerID="be7c252757aca885cde63d9516faec2cc0f64c05709968018aad80a6400f0885" exitCode=0
Jul 15 16:04:59.744179 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.744058    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"
Jul 15 16:04:59.744179 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.744088    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2" event={"ID":"8a6f6ff9-d0bd-43d2-9c29-4564984c7139","Type":"ContainerDied","Data":"be7c252757aca885cde63d9516faec2cc0f64c05709968018aad80a6400f0885"}
Jul 15 16:04:59.744179 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.744146    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2" event={"ID":"8a6f6ff9-d0bd-43d2-9c29-4564984c7139","Type":"ContainerDied","Data":"966e6638494f849997454b4f8e085a8a5ece3b08284b13dedf5267c8b67a4971"}
Jul 15 16:04:59.744179 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.744177    2583 scope.go:117] "RemoveContainer" containerID="be7c252757aca885cde63d9516faec2cc0f64c05709968018aad80a6400f0885"
Jul 15 16:04:59.752649 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.752634    2583 scope.go:117] "RemoveContainer" containerID="d378561dc6827013a2e8f38e241b463fede58d30ab28e131368aede2eb27e1ba"
Jul 15 16:04:59.759885 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.759868    2583 scope.go:117] "RemoveContainer" containerID="be7c252757aca885cde63d9516faec2cc0f64c05709968018aad80a6400f0885"
Jul 15 16:04:59.760145 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:04:59.760127    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be7c252757aca885cde63d9516faec2cc0f64c05709968018aad80a6400f0885\": container with ID starting with be7c252757aca885cde63d9516faec2cc0f64c05709968018aad80a6400f0885 not found: ID does not exist" containerID="be7c252757aca885cde63d9516faec2cc0f64c05709968018aad80a6400f0885"
Jul 15 16:04:59.760227 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.760154    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be7c252757aca885cde63d9516faec2cc0f64c05709968018aad80a6400f0885"} err="failed to get container status \"be7c252757aca885cde63d9516faec2cc0f64c05709968018aad80a6400f0885\": rpc error: code = NotFound desc = could not find container \"be7c252757aca885cde63d9516faec2cc0f64c05709968018aad80a6400f0885\": container with ID starting with be7c252757aca885cde63d9516faec2cc0f64c05709968018aad80a6400f0885 not found: ID does not exist"
Jul 15 16:04:59.760227 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.760170    2583 scope.go:117] "RemoveContainer" containerID="d378561dc6827013a2e8f38e241b463fede58d30ab28e131368aede2eb27e1ba"
Jul 15 16:04:59.760399 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:04:59.760380    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d378561dc6827013a2e8f38e241b463fede58d30ab28e131368aede2eb27e1ba\": container with ID starting with d378561dc6827013a2e8f38e241b463fede58d30ab28e131368aede2eb27e1ba not found: ID does not exist" containerID="d378561dc6827013a2e8f38e241b463fede58d30ab28e131368aede2eb27e1ba"
Jul 15 16:04:59.760452 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.760409    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d378561dc6827013a2e8f38e241b463fede58d30ab28e131368aede2eb27e1ba"} err="failed to get container status \"d378561dc6827013a2e8f38e241b463fede58d30ab28e131368aede2eb27e1ba\": rpc error: code = NotFound desc = could not find container \"d378561dc6827013a2e8f38e241b463fede58d30ab28e131368aede2eb27e1ba\": container with ID starting with d378561dc6827013a2e8f38e241b463fede58d30ab28e131368aede2eb27e1ba not found: ID does not exist"
Jul 15 16:04:59.763089 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.763068    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"]
Jul 15 16:04:59.767374 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:04:59.767357    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-18e9c399-openshift-default-699dbd5649-csmn2"]
Jul 15 16:05:00.544721 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:00.544691    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:05:00.604452 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:00.604418    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:05:01.585004 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:01.584936    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a6f6ff9-d0bd-43d2-9c29-4564984c7139" path="/var/lib/kubelet/pods/8a6f6ff9-d0bd-43d2-9c29-4564984c7139/volumes"
Jul 15 16:05:02.382792 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:02.382761    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:05:04.401961 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:04.401904    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:05:10.726623 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:10.726595    2583 patch_prober.go:28] interesting pod/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 15 16:05:10.726971 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:10.726648    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p" podUID="ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 15 16:05:10.797264 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:10.797235    2583 generic.go:356] "Generic (PLEG): container finished" podID="ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" containerID="720ddf238dc41facf212b9f3fe3562109d51653f15ae4f5523532e4814a5d4ea" exitCode=0
Jul 15 16:05:10.797358 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:10.797308    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p" event={"ID":"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd","Type":"ContainerDied","Data":"720ddf238dc41facf212b9f3fe3562109d51653f15ae4f5523532e4814a5d4ea"}
Jul 15 16:05:10.797713 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:10.797700    2583 scope.go:117] "RemoveContainer" containerID="720ddf238dc41facf212b9f3fe3562109d51653f15ae4f5523532e4814a5d4ea"
Jul 15 16:05:10.798660 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:10.798633    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:05:10.798721 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:10.798703    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:05:10.798763 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:10.798738    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:05:11.803476 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:11.803444    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p" event={"ID":"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd","Type":"ContainerStarted","Data":"e3a17caaf7146ee5c85bd5aeea07cf74871ab190e734f18c19a6003d5751a8e2"}
Jul 15 16:05:12.294395 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:12.294360    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:05:12.294571 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:12.294555    2583 patch_prober.go:28] interesting pod/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 15 16:05:12.294626 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:12.294604    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p" podUID="ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 15 16:05:13.293710 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:13.293673    2583 patch_prober.go:28] interesting pod/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 15 16:05:13.294128 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:13.293730    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p" podUID="ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 15 16:05:14.294112 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:14.294076    2583 patch_prober.go:28] interesting pod/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 15 16:05:14.294498 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:14.294129    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p" podUID="ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 15 16:05:15.294204 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:15.294169    2583 patch_prober.go:28] interesting pod/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 15 16:05:15.294590 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:15.294225    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p" podUID="ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 15 16:05:16.297552 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:16.297521    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:05:16.297916 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:16.297755    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:05:16.298325 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:16.298310    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:05:23.155197 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:23.155164    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 16:05:23.157843 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:05:23.157823    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 16:06:00.134054 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:00.134019    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:03.082071 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:03.082033    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:06:04.664484 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:04.664450    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:10.759850 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:10.759811    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:10.836096 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:10.836066    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:14.838959 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:14.838916    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"]
Jul 15 16:06:14.839354 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:14.839119    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p" podUID="ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" containerName="istio-proxy" containerID="cri-o://e3a17caaf7146ee5c85bd5aeea07cf74871ab190e734f18c19a6003d5751a8e2" gracePeriod=30
Jul 15 16:06:14.867052 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:14.867019    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:15.477761 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:15.477729    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:15.577168 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:15.577130    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:15.677591 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:15.677557    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:16.299615 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:16.299583    2583 patch_prober.go:28] interesting pod/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 16:06:16.300002 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:16.299650    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p" podUID="ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:06:17.310094 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:17.310059    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:20.083503 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.083478    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:06:20.127072 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.126983    2583 generic.go:356] "Generic (PLEG): container finished" podID="ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" containerID="e3a17caaf7146ee5c85bd5aeea07cf74871ab190e734f18c19a6003d5751a8e2" exitCode=0
Jul 15 16:06:20.127072 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.127060    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p" event={"ID":"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd","Type":"ContainerDied","Data":"e3a17caaf7146ee5c85bd5aeea07cf74871ab190e734f18c19a6003d5751a8e2"}
Jul 15 16:06:20.127263 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.127101    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"
Jul 15 16:06:20.127263 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.127122    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p" event={"ID":"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd","Type":"ContainerDied","Data":"657fc5365cdfb422a91586e78dec4dc044ae9d4b244622a5c8b3feec5f2b364c"}
Jul 15 16:06:20.127263 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.127155    2583 scope.go:117] "RemoveContainer" containerID="e3a17caaf7146ee5c85bd5aeea07cf74871ab190e734f18c19a6003d5751a8e2"
Jul 15 16:06:20.136349 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.136323    2583 scope.go:117] "RemoveContainer" containerID="720ddf238dc41facf212b9f3fe3562109d51653f15ae4f5523532e4814a5d4ea"
Jul 15 16:06:20.144182 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.144141    2583 scope.go:117] "RemoveContainer" containerID="e3a17caaf7146ee5c85bd5aeea07cf74871ab190e734f18c19a6003d5751a8e2"
Jul 15 16:06:20.144442 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:06:20.144422    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3a17caaf7146ee5c85bd5aeea07cf74871ab190e734f18c19a6003d5751a8e2\": container with ID starting with e3a17caaf7146ee5c85bd5aeea07cf74871ab190e734f18c19a6003d5751a8e2 not found: ID does not exist" containerID="e3a17caaf7146ee5c85bd5aeea07cf74871ab190e734f18c19a6003d5751a8e2"
Jul 15 16:06:20.144500 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.144455    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3a17caaf7146ee5c85bd5aeea07cf74871ab190e734f18c19a6003d5751a8e2"} err="failed to get container status \"e3a17caaf7146ee5c85bd5aeea07cf74871ab190e734f18c19a6003d5751a8e2\": rpc error: code = NotFound desc = could not find container \"e3a17caaf7146ee5c85bd5aeea07cf74871ab190e734f18c19a6003d5751a8e2\": container with ID starting with e3a17caaf7146ee5c85bd5aeea07cf74871ab190e734f18c19a6003d5751a8e2 not found: ID does not exist"
Jul 15 16:06:20.144500 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.144477    2583 scope.go:117] "RemoveContainer" containerID="720ddf238dc41facf212b9f3fe3562109d51653f15ae4f5523532e4814a5d4ea"
Jul 15 16:06:20.144748 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:06:20.144729    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"720ddf238dc41facf212b9f3fe3562109d51653f15ae4f5523532e4814a5d4ea\": container with ID starting with 720ddf238dc41facf212b9f3fe3562109d51653f15ae4f5523532e4814a5d4ea not found: ID does not exist" containerID="720ddf238dc41facf212b9f3fe3562109d51653f15ae4f5523532e4814a5d4ea"
Jul 15 16:06:20.144818 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.144759    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"720ddf238dc41facf212b9f3fe3562109d51653f15ae4f5523532e4814a5d4ea"} err="failed to get container status \"720ddf238dc41facf212b9f3fe3562109d51653f15ae4f5523532e4814a5d4ea\": rpc error: code = NotFound desc = could not find container \"720ddf238dc41facf212b9f3fe3562109d51653f15ae4f5523532e4814a5d4ea\": container with ID starting with 720ddf238dc41facf212b9f3fe3562109d51653f15ae4f5523532e4814a5d4ea not found: ID does not exist"
Jul 15 16:06:20.177268 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.177244    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-token\") pod \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") "
Jul 15 16:06:20.177363 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.177276    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drzpt\" (UniqueName: \"kubernetes.io/projected/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-kube-api-access-drzpt\") pod \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") "
Jul 15 16:06:20.177363 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.177292    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istiod-ca-cert\") pod \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") "
Jul 15 16:06:20.177476 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.177407    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-envoy\") pod \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") "
Jul 15 16:06:20.177476 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.177454    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-podinfo\") pod \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") "
Jul 15 16:06:20.177581 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.177478    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-workload-socket\") pod \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") "
Jul 15 16:06:20.177581 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.177517    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-workload-certs\") pod \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") "
Jul 15 16:06:20.177581 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.177573    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-data\") pod \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") "
Jul 15 16:06:20.177747 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.177619    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-credential-socket\") pod \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\" (UID: \"ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd\") "
Jul 15 16:06:20.177747 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.177653    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" (UID: "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:06:20.178014 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.177989    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" (UID: "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:06:20.178014 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.178006    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istiod-ca-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:06:20.178158 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.178060    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" (UID: "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:06:20.178220 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.178190    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" (UID: "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:06:20.178671 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.178647    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-data" (OuterVolumeSpecName: "istio-data") pod "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" (UID: "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:06:20.179355 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.179324    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-kube-api-access-drzpt" (OuterVolumeSpecName: "kube-api-access-drzpt") pod "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" (UID: "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd"). InnerVolumeSpecName "kube-api-access-drzpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:06:20.179530 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.179505    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" (UID: "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:06:20.179712 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.179689    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-token" (OuterVolumeSpecName: "istio-token") pod "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" (UID: "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:06:20.179823 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.179722    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" (UID: "ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:06:20.279040 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.279018    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-envoy\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:06:20.279148 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.279044    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-podinfo\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:06:20.279148 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.279054    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-workload-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:06:20.279148 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.279063    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-workload-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:06:20.279148 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.279071    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-data\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:06:20.279148 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.279078    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-credential-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:06:20.279148 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.279085    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-istio-token\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:06:20.279148 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.279093    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drzpt\" (UniqueName: \"kubernetes.io/projected/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd-kube-api-access-drzpt\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:06:20.449922 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.449895    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"]
Jul 15 16:06:20.454247 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:20.454226    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-5299c21f-openshift-default-5b9b4544bc-7z84p"]
Jul 15 16:06:21.281817 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:21.281782    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:21.584680 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:21.584602    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" path="/var/lib/kubelet/pods/ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd/volumes"
Jul 15 16:06:23.828140 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:23.828090    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:23.945786 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:23.945747    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:24.092903 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:24.092821    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:24.211539 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:24.211509    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:24.623913 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:24.623880    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:35.379079 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:35.379046    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:50.582857 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:50.582801    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:57.179817 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:57.179785    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:57.245295 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:57.245268    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:57.327373 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:57.327335    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:06:57.425782 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:06:57.425744    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:13.283054 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:13.283007    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:18.869295 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:18.869256    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:19.470381 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:19.470335    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:19.696850 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:19.696816    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:19.798036 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:19.797923    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:30.177373 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:30.177331    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:30.986080 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:30.986040    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:37.525850 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:37.525813    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:37.631180 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:37.631150    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:37.725661 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:37.725631    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:37.825655 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:37.825560    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:38.588908 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:38.588859    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:38.687261 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:38.687225    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:38.790142 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:38.790109    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:40.245449 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:40.245412    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:07:40.488715 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:40.488675    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:46.828753 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:46.828712    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:47.385466 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:47.385432    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:07:47.496823 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:47.496784    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:47.596517 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:47.596480    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:53.596280 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:53.596249    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:53.697291 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:53.697259    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:53.838814 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:53.838780    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:54.135400 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.135370    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"]
Jul 15 16:07:54.135777 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.135764    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" containerName="istio-proxy"
Jul 15 16:07:54.135826 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.135779    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" containerName="istio-proxy"
Jul 15 16:07:54.135826 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.135797    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a6f6ff9-d0bd-43d2-9c29-4564984c7139" containerName="istio-proxy"
Jul 15 16:07:54.135826 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.135803    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a6f6ff9-d0bd-43d2-9c29-4564984c7139" containerName="istio-proxy"
Jul 15 16:07:54.135826 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.135818    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a6f6ff9-d0bd-43d2-9c29-4564984c7139" containerName="istio-proxy"
Jul 15 16:07:54.135826 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.135825    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a6f6ff9-d0bd-43d2-9c29-4564984c7139" containerName="istio-proxy"
Jul 15 16:07:54.136014 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.135886    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a6f6ff9-d0bd-43d2-9c29-4564984c7139" containerName="istio-proxy"
Jul 15 16:07:54.136014 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.135897    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" containerName="istio-proxy"
Jul 15 16:07:54.136014 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.135905    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a6f6ff9-d0bd-43d2-9c29-4564984c7139" containerName="istio-proxy"
Jul 15 16:07:54.140090 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.140055    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.143873 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.143851    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b2c9c91f-openshift-default-dockercfg-d9v7j\""
Jul 15 16:07:54.161005 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.160975    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"]
Jul 15 16:07:54.162007 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.161977    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:54.225411 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.225380    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-data\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.225619 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.225418    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istiod-ca-cert\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.225619 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.225444    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-workload-socket\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.225619 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.225466    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-envoy\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.225619 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.225569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-podinfo\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.225837 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.225642    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hzkq\" (UniqueName: \"kubernetes.io/projected/07038ba5-cab6-4372-a4c1-fb5c848b3e71-kube-api-access-6hzkq\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.226263 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.226237    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-credential-socket\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.226484 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.226463    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-workload-certs\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.226794 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.226774    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-token\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.328040 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.328005    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hzkq\" (UniqueName: \"kubernetes.io/projected/07038ba5-cab6-4372-a4c1-fb5c848b3e71-kube-api-access-6hzkq\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.328040 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.328049    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-credential-socket\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.328294 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.328064    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-workload-certs\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.328294 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.328096    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-token\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.328294 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.328138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-data\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.328294 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.328162    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istiod-ca-cert\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.328294 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.328193    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-workload-socket\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.328294 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.328226    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-envoy\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.328294 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.328272    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-podinfo\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.328667 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.328477    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-credential-socket\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.328667 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.328538    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-workload-certs\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.328667 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.328625    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-workload-socket\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.328835 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.328706    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-data\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.328979 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.328922    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istiod-ca-cert\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.330517 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.330494    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-envoy\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.331016 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.330998    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-podinfo\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.336965 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.336919    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-token\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.337156 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.337138    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hzkq\" (UniqueName: \"kubernetes.io/projected/07038ba5-cab6-4372-a4c1-fb5c848b3e71-kube-api-access-6hzkq\") pod \"e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") " pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.453150 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.453120    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:54.461145 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.461112    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:54.593921 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.593897    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"]
Jul 15 16:07:54.596235 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:07:54.596206    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07038ba5_cab6_4372_a4c1_fb5c848b3e71.slice/crio-f5d0f87d80ed5844e67fa918f37e188d267d7c96ff290197d026f15cb68e3bf8 WatchSource:0}: Error finding container f5d0f87d80ed5844e67fa918f37e188d267d7c96ff290197d026f15cb68e3bf8: Status 404 returned error can't find the container with id f5d0f87d80ed5844e67fa918f37e188d267d7c96ff290197d026f15cb68e3bf8
Jul 15 16:07:54.598436 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.598403    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:07:54.598709 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.598468    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:07:54.598709 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:54.598497    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:07:55.563352 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:55.563307    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2" event={"ID":"07038ba5-cab6-4372-a4c1-fb5c848b3e71","Type":"ContainerStarted","Data":"9644013d8773b3cbb428c42bf7d468f265d4009d85647c3354bb9a798c695463"}
Jul 15 16:07:55.563553 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:55.563376    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2" event={"ID":"07038ba5-cab6-4372-a4c1-fb5c848b3e71","Type":"ContainerStarted","Data":"f5d0f87d80ed5844e67fa918f37e188d267d7c96ff290197d026f15cb68e3bf8"}
Jul 15 16:07:55.585855 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:55.585800    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2" podStartSLOduration=1.585782076 podStartE2EDuration="1.585782076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:07:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:07:55.58407152 +0000 UTC m=+1952.992844750" watchObservedRunningTime="2026-07-15 16:07:55.585782076 +0000 UTC m=+1952.994555271"
Jul 15 16:07:55.983314 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:55.983280    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:07:56.453626 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:56.453599    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:56.458519 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:56.458493    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:56.568342 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:56.568318    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:56.569207 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:56.569191    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:07:57.565769 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:57.565724    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:57.663627 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:57.663567    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:57.823159 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:57.823081    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:57.923619 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:57.923583    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:58.308424 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:58.308383    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:58.408345 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:58.408315    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:58.511424 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:58.511390    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:07:58.611980 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:07:58.611863    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:02.061763 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:02.061721    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:03.770484 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:03.770451    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:03.828137 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:03.828097    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:04.097709 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:04.097615    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:08:09.265416 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:09.265379    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:09.366429 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:09.366393    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:09.626597 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:09.626570    2583 generic.go:356] "Generic (PLEG): container finished" podID="07038ba5-cab6-4372-a4c1-fb5c848b3e71" containerID="9644013d8773b3cbb428c42bf7d468f265d4009d85647c3354bb9a798c695463" exitCode=0
Jul 15 16:08:09.626742 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:09.626636    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2" event={"ID":"07038ba5-cab6-4372-a4c1-fb5c848b3e71","Type":"ContainerDied","Data":"9644013d8773b3cbb428c42bf7d468f265d4009d85647c3354bb9a798c695463"}
Jul 15 16:08:09.627059 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:09.627044    2583 scope.go:117] "RemoveContainer" containerID="9644013d8773b3cbb428c42bf7d468f265d4009d85647c3354bb9a798c695463"
Jul 15 16:08:09.628057 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:09.628025    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:08:09.628163 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:09.628112    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:08:09.628221 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:09.628164    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:08:10.635729 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:10.635682    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2" event={"ID":"07038ba5-cab6-4372-a4c1-fb5c848b3e71","Type":"ContainerStarted","Data":"ab881a097a3da11ccfe4a649bc4621c30d4302d5e00a538406cee3b56134fe73"}
Jul 15 16:08:11.454374 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:11.454333    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:08:11.455671 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:11.455636    2583 patch_prober.go:28] interesting pod/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 15 16:08:11.455788 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:11.455699    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2" podUID="07038ba5-cab6-4372-a4c1-fb5c848b3e71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 15 16:08:11.568549 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:11.568511    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:08:12.454217 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:12.454174    2583 patch_prober.go:28] interesting pod/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 15 16:08:12.454646 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:12.454247    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2" podUID="07038ba5-cab6-4372-a4c1-fb5c848b3e71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 15 16:08:13.454572 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:13.454533    2583 patch_prober.go:28] interesting pod/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 15 16:08:13.454984 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:13.454602    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2" podUID="07038ba5-cab6-4372-a4c1-fb5c848b3e71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 15 16:08:14.454644 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:14.454605    2583 patch_prober.go:28] interesting pod/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 15 16:08:14.455143 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:14.454689    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2" podUID="07038ba5-cab6-4372-a4c1-fb5c848b3e71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 15 16:08:15.457193 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:15.457154    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:08:15.458252 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:15.458230    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:08:20.042478 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:20.042436    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:22.780742 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:22.780709    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:08:24.729581 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:24.729550    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:30.626763 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:30.626723    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:30.686227 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:30.686195    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:35.378919 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:35.378885    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"]
Jul 15 16:08:35.379473 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:35.379141    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2" podUID="07038ba5-cab6-4372-a4c1-fb5c848b3e71" containerName="istio-proxy" containerID="cri-o://ab881a097a3da11ccfe4a649bc4621c30d4302d5e00a538406cee3b56134fe73" gracePeriod=30
Jul 15 16:08:35.412699 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:35.412667    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:35.639306 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:35.639215    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:35.791609 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:35.791568    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:35.883111 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:35.883077    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:36.027732 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:36.027692    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:40.633931 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.633905    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:08:40.780485 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.780449    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-workload-certs\") pod \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") "
Jul 15 16:08:40.780668 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.780515    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-envoy\") pod \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") "
Jul 15 16:08:40.780668 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.780540    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-credential-socket\") pod \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") "
Jul 15 16:08:40.780668 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.780576    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-token\") pod \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") "
Jul 15 16:08:40.780668 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.780614    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-data\") pod \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") "
Jul 15 16:08:40.780668 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.780643    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-workload-socket\") pod \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") "
Jul 15 16:08:40.780930 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.780703    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-podinfo\") pod \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") "
Jul 15 16:08:40.780930 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.780743    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istiod-ca-cert\") pod \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") "
Jul 15 16:08:40.780930 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.780772    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hzkq\" (UniqueName: \"kubernetes.io/projected/07038ba5-cab6-4372-a4c1-fb5c848b3e71-kube-api-access-6hzkq\") pod \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\" (UID: \"07038ba5-cab6-4372-a4c1-fb5c848b3e71\") "
Jul 15 16:08:40.781151 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.780766    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07038ba5-cab6-4372-a4c1-fb5c848b3e71" (UID: "07038ba5-cab6-4372-a4c1-fb5c848b3e71"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:08:40.781151 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.780890    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07038ba5-cab6-4372-a4c1-fb5c848b3e71" (UID: "07038ba5-cab6-4372-a4c1-fb5c848b3e71"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:08:40.781151 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.781028    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07038ba5-cab6-4372-a4c1-fb5c848b3e71" (UID: "07038ba5-cab6-4372-a4c1-fb5c848b3e71"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:08:40.781320 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.781261    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07038ba5-cab6-4372-a4c1-fb5c848b3e71" (UID: "07038ba5-cab6-4372-a4c1-fb5c848b3e71"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:08:40.781731 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.781701    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-data" (OuterVolumeSpecName: "istio-data") pod "07038ba5-cab6-4372-a4c1-fb5c848b3e71" (UID: "07038ba5-cab6-4372-a4c1-fb5c848b3e71"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:08:40.783207 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.783171    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-token" (OuterVolumeSpecName: "istio-token") pod "07038ba5-cab6-4372-a4c1-fb5c848b3e71" (UID: "07038ba5-cab6-4372-a4c1-fb5c848b3e71"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:08:40.783207 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.783183    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07038ba5-cab6-4372-a4c1-fb5c848b3e71-kube-api-access-6hzkq" (OuterVolumeSpecName: "kube-api-access-6hzkq") pod "07038ba5-cab6-4372-a4c1-fb5c848b3e71" (UID: "07038ba5-cab6-4372-a4c1-fb5c848b3e71"). InnerVolumeSpecName "kube-api-access-6hzkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:08:40.783368 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.783351    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07038ba5-cab6-4372-a4c1-fb5c848b3e71" (UID: "07038ba5-cab6-4372-a4c1-fb5c848b3e71"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:08:40.783425 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.783378    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07038ba5-cab6-4372-a4c1-fb5c848b3e71" (UID: "07038ba5-cab6-4372-a4c1-fb5c848b3e71"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:08:40.785906 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.785882    2583 generic.go:356] "Generic (PLEG): container finished" podID="07038ba5-cab6-4372-a4c1-fb5c848b3e71" containerID="ab881a097a3da11ccfe4a649bc4621c30d4302d5e00a538406cee3b56134fe73" exitCode=0
Jul 15 16:08:40.786034 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.785936    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"
Jul 15 16:08:40.786034 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.785983    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2" event={"ID":"07038ba5-cab6-4372-a4c1-fb5c848b3e71","Type":"ContainerDied","Data":"ab881a097a3da11ccfe4a649bc4621c30d4302d5e00a538406cee3b56134fe73"}
Jul 15 16:08:40.786131 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.786046    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2" event={"ID":"07038ba5-cab6-4372-a4c1-fb5c848b3e71","Type":"ContainerDied","Data":"f5d0f87d80ed5844e67fa918f37e188d267d7c96ff290197d026f15cb68e3bf8"}
Jul 15 16:08:40.786131 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.786079    2583 scope.go:117] "RemoveContainer" containerID="ab881a097a3da11ccfe4a649bc4621c30d4302d5e00a538406cee3b56134fe73"
Jul 15 16:08:40.802702 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.802684    2583 scope.go:117] "RemoveContainer" containerID="9644013d8773b3cbb428c42bf7d468f265d4009d85647c3354bb9a798c695463"
Jul 15 16:08:40.810708 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.810686    2583 scope.go:117] "RemoveContainer" containerID="ab881a097a3da11ccfe4a649bc4621c30d4302d5e00a538406cee3b56134fe73"
Jul 15 16:08:40.810981 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:08:40.810941    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab881a097a3da11ccfe4a649bc4621c30d4302d5e00a538406cee3b56134fe73\": container with ID starting with ab881a097a3da11ccfe4a649bc4621c30d4302d5e00a538406cee3b56134fe73 not found: ID does not exist" containerID="ab881a097a3da11ccfe4a649bc4621c30d4302d5e00a538406cee3b56134fe73"
Jul 15 16:08:40.811087 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.810989    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab881a097a3da11ccfe4a649bc4621c30d4302d5e00a538406cee3b56134fe73"} err="failed to get container status \"ab881a097a3da11ccfe4a649bc4621c30d4302d5e00a538406cee3b56134fe73\": rpc error: code = NotFound desc = could not find container \"ab881a097a3da11ccfe4a649bc4621c30d4302d5e00a538406cee3b56134fe73\": container with ID starting with ab881a097a3da11ccfe4a649bc4621c30d4302d5e00a538406cee3b56134fe73 not found: ID does not exist"
Jul 15 16:08:40.811087 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.811008    2583 scope.go:117] "RemoveContainer" containerID="9644013d8773b3cbb428c42bf7d468f265d4009d85647c3354bb9a798c695463"
Jul 15 16:08:40.811258 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:08:40.811243    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9644013d8773b3cbb428c42bf7d468f265d4009d85647c3354bb9a798c695463\": container with ID starting with 9644013d8773b3cbb428c42bf7d468f265d4009d85647c3354bb9a798c695463 not found: ID does not exist" containerID="9644013d8773b3cbb428c42bf7d468f265d4009d85647c3354bb9a798c695463"
Jul 15 16:08:40.811303 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.811261    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9644013d8773b3cbb428c42bf7d468f265d4009d85647c3354bb9a798c695463"} err="failed to get container status \"9644013d8773b3cbb428c42bf7d468f265d4009d85647c3354bb9a798c695463\": rpc error: code = NotFound desc = could not find container \"9644013d8773b3cbb428c42bf7d468f265d4009d85647c3354bb9a798c695463\": container with ID starting with 9644013d8773b3cbb428c42bf7d468f265d4009d85647c3354bb9a798c695463 not found: ID does not exist"
Jul 15 16:08:40.815059 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.815038    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"]
Jul 15 16:08:40.818772 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.818752    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b2c9c91f-openshift-default-5cbbd6c9ff-wgpp2"]
Jul 15 16:08:40.881869 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.881829    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-data\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:08:40.881869 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.881863    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-workload-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:08:40.881869 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.881872    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-podinfo\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:08:40.881869 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.881882    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istiod-ca-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:08:40.882184 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.881892    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hzkq\" (UniqueName: \"kubernetes.io/projected/07038ba5-cab6-4372-a4c1-fb5c848b3e71-kube-api-access-6hzkq\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:08:40.882184 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.881900    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-workload-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:08:40.882184 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.881908    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-envoy\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:08:40.882184 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.881916    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07038ba5-cab6-4372-a4c1-fb5c848b3e71-credential-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:08:40.882184 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:40.881923    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07038ba5-cab6-4372-a4c1-fb5c848b3e71-istio-token\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:08:41.584959 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:41.584913    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07038ba5-cab6-4372-a4c1-fb5c848b3e71" path="/var/lib/kubelet/pods/07038ba5-cab6-4372-a4c1-fb5c848b3e71/volumes"
Jul 15 16:08:42.226000 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:42.225938    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:43.349050 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:43.348996    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:43.448939 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:43.448910    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:48.618869 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:48.618825    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:48.690493 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:48.690453    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:55.583737 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:55.583702    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:55.822197 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:55.822166    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"]
Jul 15 16:08:55.822551 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:55.822538    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" containerName="istio-proxy"
Jul 15 16:08:55.822594 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:55.822553    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" containerName="istio-proxy"
Jul 15 16:08:55.822594 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:55.822565    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07038ba5-cab6-4372-a4c1-fb5c848b3e71" containerName="istio-proxy"
Jul 15 16:08:55.822594 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:55.822571    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="07038ba5-cab6-4372-a4c1-fb5c848b3e71" containerName="istio-proxy"
Jul 15 16:08:55.822685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:55.822642    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="07038ba5-cab6-4372-a4c1-fb5c848b3e71" containerName="istio-proxy"
Jul 15 16:08:55.822685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:55.822654    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed333eb9-8ee4-4dc0-9e8b-4af79d15c5fd" containerName="istio-proxy"
Jul 15 16:08:55.833897 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:55.833828    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:55.837082 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:55.837055    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b9b40333-openshift-default-dockercfg-l9c5z\""
Jul 15 16:08:55.845585 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:55.845563    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"]
Jul 15 16:08:55.852629 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:55.852605    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:56.013233 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.013197    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-podinfo\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.013233 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.013231    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf6kt\" (UniqueName: \"kubernetes.io/projected/c472b08a-def4-4ce8-86f4-25629c69ef09-kube-api-access-bf6kt\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.013417 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.013257    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-credential-socket\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.013417 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.013328    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-workload-certs\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.013417 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.013371    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-token\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.013417 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.013405    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c472b08a-def4-4ce8-86f4-25629c69ef09-istiod-ca-cert\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.013548 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.013469    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-workload-socket\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.013548 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.013501    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-envoy\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.013548 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.013530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-data\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.114648 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.114571    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-workload-socket\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.114648 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.114612    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-envoy\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.114648 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.114633    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-data\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.114901 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.114661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-podinfo\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.114901 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.114678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf6kt\" (UniqueName: \"kubernetes.io/projected/c472b08a-def4-4ce8-86f4-25629c69ef09-kube-api-access-bf6kt\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.114901 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.114710    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-credential-socket\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.114901 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.114733    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-workload-certs\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.114901 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.114765    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-token\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.114901 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.114807    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c472b08a-def4-4ce8-86f4-25629c69ef09-istiod-ca-cert\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.115201 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.115007    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-workload-socket\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.115201 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.115095    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-credential-socket\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.115201 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.115133    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-data\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.115201 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.115174    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-workload-certs\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.115444 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.115426    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c472b08a-def4-4ce8-86f4-25629c69ef09-istiod-ca-cert\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.117046 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.117025    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-envoy\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.117172 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.117153    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-podinfo\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.123781 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.123752    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-token\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.124055 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.124030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf6kt\" (UniqueName: \"kubernetes.io/projected/c472b08a-def4-4ce8-86f4-25629c69ef09-kube-api-access-bf6kt\") pod \"e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") " pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.144827 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.144808    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:56.284332 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.284308    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"]
Jul 15 16:08:56.286341 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:08:56.286303    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc472b08a_def4_4ce8_86f4_25629c69ef09.slice/crio-5c9e45321f4f23a85f7e0919bccdba7aeb68c0d8dc0c40beede0c7a66e4e97b9 WatchSource:0}: Error finding container 5c9e45321f4f23a85f7e0919bccdba7aeb68c0d8dc0c40beede0c7a66e4e97b9: Status 404 returned error can't find the container with id 5c9e45321f4f23a85f7e0919bccdba7aeb68c0d8dc0c40beede0c7a66e4e97b9
Jul 15 16:08:56.288765 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.288735    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:08:56.288835 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.288801    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:08:56.288835 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.288828    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:08:56.493017 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.492929    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:56.866123 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.866033    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm" event={"ID":"c472b08a-def4-4ce8-86f4-25629c69ef09","Type":"ContainerStarted","Data":"9c55ab5e2a88060be33795fdca7c33d69c60aad277ed1e62d77ecfd99f9800b9"}
Jul 15 16:08:56.866123 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.866089    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm" event={"ID":"c472b08a-def4-4ce8-86f4-25629c69ef09","Type":"ContainerStarted","Data":"5c9e45321f4f23a85f7e0919bccdba7aeb68c0d8dc0c40beede0c7a66e4e97b9"}
Jul 15 16:08:56.893897 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:56.893844    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm" podStartSLOduration=1.893827633 podStartE2EDuration="1.893827633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:08:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:08:56.892935435 +0000 UTC m=+2014.301708642" watchObservedRunningTime="2026-07-15 16:08:56.893827633 +0000 UTC m=+2014.302600824"
Jul 15 16:08:57.145133 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:57.145024    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:57.150242 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:57.150220    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:57.870726 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:57.870696    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:57.871545 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:57.871528    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:08:58.260898 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:58.260859    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:58.359561 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:58.359520    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:58.910545 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:58.910510    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:59.006253 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:59.006221    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:59.082246 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:59.082208    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:59.404448 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:59.404409    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:59.645563 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:59.645529    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:08:59.746831 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:08:59.746803    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:09:03.342375 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:03.342335    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:09:05.098653 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:05.098619    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:09:13.146188 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:13.145451    2583 patch_prober.go:28] interesting pod/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": read tcp 10.133.0.2:33940->10.133.0.38:15021: read: connection reset by peer" start-of-body=
Jul 15 16:09:13.146188 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:13.145516    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm" podUID="c472b08a-def4-4ce8-86f4-25629c69ef09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": read tcp 10.133.0.2:33940->10.133.0.38:15021: read: connection reset by peer"
Jul 15 16:09:13.950288 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:13.950253    2583 generic.go:356] "Generic (PLEG): container finished" podID="c472b08a-def4-4ce8-86f4-25629c69ef09" containerID="9c55ab5e2a88060be33795fdca7c33d69c60aad277ed1e62d77ecfd99f9800b9" exitCode=0
Jul 15 16:09:13.950473 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:13.950327    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm" event={"ID":"c472b08a-def4-4ce8-86f4-25629c69ef09","Type":"ContainerDied","Data":"9c55ab5e2a88060be33795fdca7c33d69c60aad277ed1e62d77ecfd99f9800b9"}
Jul 15 16:09:13.950798 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:13.950781    2583 scope.go:117] "RemoveContainer" containerID="9c55ab5e2a88060be33795fdca7c33d69c60aad277ed1e62d77ecfd99f9800b9"
Jul 15 16:09:13.951778 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:13.951750    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:09:13.951830 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:13.951820    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:09:13.951892 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:13.951879    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:09:14.959120 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:14.959086    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm" event={"ID":"c472b08a-def4-4ce8-86f4-25629c69ef09","Type":"ContainerStarted","Data":"c9b38deb17f2635e17510e6760a2a6fa461f83ffa4c03b6d491ca76c756714ea"}
Jul 15 16:09:15.146001 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:15.145918    2583 patch_prober.go:28] interesting pod/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 15 16:09:15.146212 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:15.146024    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm" podUID="c472b08a-def4-4ce8-86f4-25629c69ef09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 15 16:09:15.146341 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:15.145516    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:09:16.146255 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:16.146212    2583 patch_prober.go:28] interesting pod/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 15 16:09:16.146750 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:16.146275    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm" podUID="c472b08a-def4-4ce8-86f4-25629c69ef09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 15 16:09:17.145581 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:17.145543    2583 patch_prober.go:28] interesting pod/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 15 16:09:17.145886 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:17.145855    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm" podUID="c472b08a-def4-4ce8-86f4-25629c69ef09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 15 16:09:18.145677 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:18.145638    2583 patch_prober.go:28] interesting pod/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 15 16:09:18.146295 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:18.146262    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm" podUID="c472b08a-def4-4ce8-86f4-25629c69ef09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 15 16:09:19.148571 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.148544    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:09:19.149014 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.148795    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:09:19.149521 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.149502    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:09:19.598345 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.598297    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"]
Jul 15 16:09:19.598672 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.598661    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07038ba5-cab6-4372-a4c1-fb5c848b3e71" containerName="istio-proxy"
Jul 15 16:09:19.598721 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.598673    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="07038ba5-cab6-4372-a4c1-fb5c848b3e71" containerName="istio-proxy"
Jul 15 16:09:19.598755 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.598743    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="07038ba5-cab6-4372-a4c1-fb5c848b3e71" containerName="istio-proxy"
Jul 15 16:09:19.601273 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.601252    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.603788 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.603750    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b9b40333\"/\"openshift-service-ca.crt\""
Jul 15 16:09:19.603976 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.603926    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b9b40333\"/\"e2e-lifecycle-model-b9b40333-kserve-self-signed-certs\""
Jul 15 16:09:19.604067 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.603998    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b9b40333\"/\"kube-root-ca.crt\""
Jul 15 16:09:19.604067 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.604002    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b9b40333\"/\"default-dockercfg-vsdpl\""
Jul 15 16:09:19.612031 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.612008    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"]
Jul 15 16:09:19.623390 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.623359    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:09:19.719924 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.719901    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-tmp-dir\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.720058 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.719973    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-home\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.720058 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.720015    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xdwk\" (UniqueName: \"kubernetes.io/projected/d50e4ec4-9892-4eae-8d2e-5907602197f6-kube-api-access-8xdwk\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.720058 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.720036    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d50e4ec4-9892-4eae-8d2e-5907602197f6-tls-certs\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.720058 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.720057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-model-cache\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.720196 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.720094    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-dshm\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.821368 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.821336    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-home\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.821539 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.821472    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xdwk\" (UniqueName: \"kubernetes.io/projected/d50e4ec4-9892-4eae-8d2e-5907602197f6-kube-api-access-8xdwk\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.821539 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.821506    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d50e4ec4-9892-4eae-8d2e-5907602197f6-tls-certs\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.821539 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.821533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-model-cache\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.821714 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.821599    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-dshm\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.821714 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.821625    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-tmp-dir\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.821813 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.821710    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-home\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.821912 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.821891    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-model-cache\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.822048 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.822030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-tmp-dir\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.823765 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.823745    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-dshm\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.824028 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.824013    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d50e4ec4-9892-4eae-8d2e-5907602197f6-tls-certs\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.831267 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.831243    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xdwk\" (UniqueName: \"kubernetes.io/projected/d50e4ec4-9892-4eae-8d2e-5907602197f6-kube-api-access-8xdwk\") pod \"e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") " pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:19.910491 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:19.910439    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:20.041413 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:20.041391    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"]
Jul 15 16:09:20.043030 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:09:20.043004    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd50e4ec4_9892_4eae_8d2e_5907602197f6.slice/crio-3b3f31072b2d4848fc1fc0eff38d5b5f9b422590965d28721a2a61ba1b824a01 WatchSource:0}: Error finding container 3b3f31072b2d4848fc1fc0eff38d5b5f9b422590965d28721a2a61ba1b824a01: Status 404 returned error can't find the container with id 3b3f31072b2d4848fc1fc0eff38d5b5f9b422590965d28721a2a61ba1b824a01
Jul 15 16:09:20.994559 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:20.994522    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw" event={"ID":"d50e4ec4-9892-4eae-8d2e-5907602197f6","Type":"ContainerStarted","Data":"62cb00410bada5d47a53b05cab7183cee91b93abe71e2a0ac0dc7531a44558f7"}
Jul 15 16:09:20.995047 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:20.994571    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw" event={"ID":"d50e4ec4-9892-4eae-8d2e-5907602197f6","Type":"ContainerStarted","Data":"3b3f31072b2d4848fc1fc0eff38d5b5f9b422590965d28721a2a61ba1b824a01"}
Jul 15 16:09:21.013765 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:21.013725    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw" podStartSLOduration=2.013708815 podStartE2EDuration="2.013708815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:09:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:09:21.011822279 +0000 UTC m=+2038.420595470" watchObservedRunningTime="2026-07-15 16:09:21.013708815 +0000 UTC m=+2038.422482007"
Jul 15 16:09:22.979009 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:22.978976    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:09:29.911054 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:29.911019    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:29.911483 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:29.911280    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:29.923255 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:29.923231    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:30.047888 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:30.047860    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:09:50.606057 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:09:50.606016    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:10:07.710226 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:07.710191    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:10:11.400741 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:11.400706    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:10:12.210158 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:12.210117    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:10:17.227317 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:17.227282    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"]
Jul 15 16:10:17.367464 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:17.367427    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:10:23.184897 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:23.184858    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 16:10:23.188011 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:23.187991    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 16:10:32.247328 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.247284    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw" podUID="d50e4ec4-9892-4eae-8d2e-5907602197f6" containerName="main" containerID="cri-o://62cb00410bada5d47a53b05cab7183cee91b93abe71e2a0ac0dc7531a44558f7" gracePeriod=45
Jul 15 16:10:32.507165 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.507110    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:10:32.600319 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.600287    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-model-cache\") pod \"d50e4ec4-9892-4eae-8d2e-5907602197f6\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") "
Jul 15 16:10:32.600319 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.600325    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-tmp-dir\") pod \"d50e4ec4-9892-4eae-8d2e-5907602197f6\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") "
Jul 15 16:10:32.600518 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.600401    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-dshm\") pod \"d50e4ec4-9892-4eae-8d2e-5907602197f6\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") "
Jul 15 16:10:32.600518 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.600431    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d50e4ec4-9892-4eae-8d2e-5907602197f6-tls-certs\") pod \"d50e4ec4-9892-4eae-8d2e-5907602197f6\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") "
Jul 15 16:10:32.600518 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.600477    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xdwk\" (UniqueName: \"kubernetes.io/projected/d50e4ec4-9892-4eae-8d2e-5907602197f6-kube-api-access-8xdwk\") pod \"d50e4ec4-9892-4eae-8d2e-5907602197f6\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") "
Jul 15 16:10:32.600518 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.600514    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-home\") pod \"d50e4ec4-9892-4eae-8d2e-5907602197f6\" (UID: \"d50e4ec4-9892-4eae-8d2e-5907602197f6\") "
Jul 15 16:10:32.600772 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.600572    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "d50e4ec4-9892-4eae-8d2e-5907602197f6" (UID: "d50e4ec4-9892-4eae-8d2e-5907602197f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:10:32.600772 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.600652    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d50e4ec4-9892-4eae-8d2e-5907602197f6" (UID: "d50e4ec4-9892-4eae-8d2e-5907602197f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:10:32.600890 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.600791    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-home" (OuterVolumeSpecName: "home") pod "d50e4ec4-9892-4eae-8d2e-5907602197f6" (UID: "d50e4ec4-9892-4eae-8d2e-5907602197f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:10:32.600890 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.600875    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-home\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:10:32.601042 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.600892    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-model-cache\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:10:32.601042 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.600907    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-tmp-dir\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:10:32.602734 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.602704    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d50e4ec4-9892-4eae-8d2e-5907602197f6-kube-api-access-8xdwk" (OuterVolumeSpecName: "kube-api-access-8xdwk") pod "d50e4ec4-9892-4eae-8d2e-5907602197f6" (UID: "d50e4ec4-9892-4eae-8d2e-5907602197f6"). InnerVolumeSpecName "kube-api-access-8xdwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:10:32.602903 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.602885    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-dshm" (OuterVolumeSpecName: "dshm") pod "d50e4ec4-9892-4eae-8d2e-5907602197f6" (UID: "d50e4ec4-9892-4eae-8d2e-5907602197f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:10:32.602976 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.602922    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d50e4ec4-9892-4eae-8d2e-5907602197f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d50e4ec4-9892-4eae-8d2e-5907602197f6" (UID: "d50e4ec4-9892-4eae-8d2e-5907602197f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:10:32.702116 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.702088    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d50e4ec4-9892-4eae-8d2e-5907602197f6-dshm\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:10:32.702116 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.702108    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d50e4ec4-9892-4eae-8d2e-5907602197f6-tls-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:10:32.702116 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:32.702117    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xdwk\" (UniqueName: \"kubernetes.io/projected/d50e4ec4-9892-4eae-8d2e-5907602197f6-kube-api-access-8xdwk\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:10:33.335531 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:33.335494    2583 generic.go:356] "Generic (PLEG): container finished" podID="d50e4ec4-9892-4eae-8d2e-5907602197f6" containerID="62cb00410bada5d47a53b05cab7183cee91b93abe71e2a0ac0dc7531a44558f7" exitCode=0
Jul 15 16:10:33.336029 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:33.335537    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"
Jul 15 16:10:33.336029 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:33.335579    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw" event={"ID":"d50e4ec4-9892-4eae-8d2e-5907602197f6","Type":"ContainerDied","Data":"62cb00410bada5d47a53b05cab7183cee91b93abe71e2a0ac0dc7531a44558f7"}
Jul 15 16:10:33.336029 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:33.335626    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw" event={"ID":"d50e4ec4-9892-4eae-8d2e-5907602197f6","Type":"ContainerDied","Data":"3b3f31072b2d4848fc1fc0eff38d5b5f9b422590965d28721a2a61ba1b824a01"}
Jul 15 16:10:33.336029 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:33.335644    2583 scope.go:117] "RemoveContainer" containerID="62cb00410bada5d47a53b05cab7183cee91b93abe71e2a0ac0dc7531a44558f7"
Jul 15 16:10:33.344422 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:33.344406    2583 scope.go:117] "RemoveContainer" containerID="62cb00410bada5d47a53b05cab7183cee91b93abe71e2a0ac0dc7531a44558f7"
Jul 15 16:10:33.344673 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:10:33.344656    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62cb00410bada5d47a53b05cab7183cee91b93abe71e2a0ac0dc7531a44558f7\": container with ID starting with 62cb00410bada5d47a53b05cab7183cee91b93abe71e2a0ac0dc7531a44558f7 not found: ID does not exist" containerID="62cb00410bada5d47a53b05cab7183cee91b93abe71e2a0ac0dc7531a44558f7"
Jul 15 16:10:33.344738 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:33.344680    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62cb00410bada5d47a53b05cab7183cee91b93abe71e2a0ac0dc7531a44558f7"} err="failed to get container status \"62cb00410bada5d47a53b05cab7183cee91b93abe71e2a0ac0dc7531a44558f7\": rpc error: code = NotFound desc = could not find container \"62cb00410bada5d47a53b05cab7183cee91b93abe71e2a0ac0dc7531a44558f7\": container with ID starting with 62cb00410bada5d47a53b05cab7183cee91b93abe71e2a0ac0dc7531a44558f7 not found: ID does not exist"
Jul 15 16:10:33.364120 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:33.364099    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"]
Jul 15 16:10:33.380161 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:33.380131    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-b9b40333/e2e-lifecycle-model-b9b40333-kserve-547cf7648c-fk2bw"]
Jul 15 16:10:33.585679 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:33.585599    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d50e4ec4-9892-4eae-8d2e-5907602197f6" path="/var/lib/kubelet/pods/d50e4ec4-9892-4eae-8d2e-5907602197f6/volumes"
Jul 15 16:10:54.675623 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:54.675584    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:10:55.517656 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:10:55.517624    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:01.734056 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:01.734019    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:03.713578 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:03.713544    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:04.931648 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:04.931611    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"]
Jul 15 16:11:04.932141 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:04.931900    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm" podUID="c472b08a-def4-4ce8-86f4-25629c69ef09" containerName="istio-proxy" containerID="cri-o://c9b38deb17f2635e17510e6760a2a6fa461f83ffa4c03b6d491ca76c756714ea" gracePeriod=30
Jul 15 16:11:04.949982 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:04.949916    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:05.208429 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:05.208396    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:06.292855 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:06.292822    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:06.386613 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:06.386574    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:06.498801 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:06.498769    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:07.341487 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:07.341445    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:07.436103 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:07.436072    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:07.543268 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:07.543241    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:09.059402 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:09.059355    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:10.182379 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.182354    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:11:10.246001 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.245912    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf6kt\" (UniqueName: \"kubernetes.io/projected/c472b08a-def4-4ce8-86f4-25629c69ef09-kube-api-access-bf6kt\") pod \"c472b08a-def4-4ce8-86f4-25629c69ef09\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") "
Jul 15 16:11:10.246001 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.245972    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-envoy\") pod \"c472b08a-def4-4ce8-86f4-25629c69ef09\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") "
Jul 15 16:11:10.246203 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.246097    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-token\") pod \"c472b08a-def4-4ce8-86f4-25629c69ef09\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") "
Jul 15 16:11:10.246203 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.246150    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-workload-socket\") pod \"c472b08a-def4-4ce8-86f4-25629c69ef09\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") "
Jul 15 16:11:10.246324 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.246227    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-podinfo\") pod \"c472b08a-def4-4ce8-86f4-25629c69ef09\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") "
Jul 15 16:11:10.246324 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.246259    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-workload-certs\") pod \"c472b08a-def4-4ce8-86f4-25629c69ef09\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") "
Jul 15 16:11:10.246324 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.246283    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-data\") pod \"c472b08a-def4-4ce8-86f4-25629c69ef09\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") "
Jul 15 16:11:10.246478 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.246329    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-credential-socket\") pod \"c472b08a-def4-4ce8-86f4-25629c69ef09\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") "
Jul 15 16:11:10.246478 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.246388    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c472b08a-def4-4ce8-86f4-25629c69ef09-istiod-ca-cert\") pod \"c472b08a-def4-4ce8-86f4-25629c69ef09\" (UID: \"c472b08a-def4-4ce8-86f4-25629c69ef09\") "
Jul 15 16:11:10.247073 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.246786    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c472b08a-def4-4ce8-86f4-25629c69ef09" (UID: "c472b08a-def4-4ce8-86f4-25629c69ef09"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:11:10.247073 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.247018    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c472b08a-def4-4ce8-86f4-25629c69ef09" (UID: "c472b08a-def4-4ce8-86f4-25629c69ef09"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:11:10.247073 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.247039    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c472b08a-def4-4ce8-86f4-25629c69ef09-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c472b08a-def4-4ce8-86f4-25629c69ef09" (UID: "c472b08a-def4-4ce8-86f4-25629c69ef09"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:11:10.247299 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.247169    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-data" (OuterVolumeSpecName: "istio-data") pod "c472b08a-def4-4ce8-86f4-25629c69ef09" (UID: "c472b08a-def4-4ce8-86f4-25629c69ef09"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:11:10.247299 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.247242    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c472b08a-def4-4ce8-86f4-25629c69ef09" (UID: "c472b08a-def4-4ce8-86f4-25629c69ef09"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:11:10.248244 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.248218    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c472b08a-def4-4ce8-86f4-25629c69ef09-kube-api-access-bf6kt" (OuterVolumeSpecName: "kube-api-access-bf6kt") pod "c472b08a-def4-4ce8-86f4-25629c69ef09" (UID: "c472b08a-def4-4ce8-86f4-25629c69ef09"). InnerVolumeSpecName "kube-api-access-bf6kt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:11:10.248388 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.248323    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-token" (OuterVolumeSpecName: "istio-token") pod "c472b08a-def4-4ce8-86f4-25629c69ef09" (UID: "c472b08a-def4-4ce8-86f4-25629c69ef09"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:11:10.248388 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.248369    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c472b08a-def4-4ce8-86f4-25629c69ef09" (UID: "c472b08a-def4-4ce8-86f4-25629c69ef09"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:11:10.248580 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.248562    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c472b08a-def4-4ce8-86f4-25629c69ef09" (UID: "c472b08a-def4-4ce8-86f4-25629c69ef09"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:11:10.347832 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.347806    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-token\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:11:10.347832 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.347830    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-workload-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:11:10.347832 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.347838    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-podinfo\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:11:10.348061 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.347847    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-workload-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:11:10.348061 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.347854    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-data\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:11:10.348061 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.347862    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-credential-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:11:10.348061 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.347869    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c472b08a-def4-4ce8-86f4-25629c69ef09-istiod-ca-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:11:10.348061 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.347877    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf6kt\" (UniqueName: \"kubernetes.io/projected/c472b08a-def4-4ce8-86f4-25629c69ef09-kube-api-access-bf6kt\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:11:10.348061 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.347884    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c472b08a-def4-4ce8-86f4-25629c69ef09-istio-envoy\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:11:10.506029 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.505928    2583 generic.go:356] "Generic (PLEG): container finished" podID="c472b08a-def4-4ce8-86f4-25629c69ef09" containerID="c9b38deb17f2635e17510e6760a2a6fa461f83ffa4c03b6d491ca76c756714ea" exitCode=0
Jul 15 16:11:10.506029 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.506000    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"
Jul 15 16:11:10.506029 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.506018    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm" event={"ID":"c472b08a-def4-4ce8-86f4-25629c69ef09","Type":"ContainerDied","Data":"c9b38deb17f2635e17510e6760a2a6fa461f83ffa4c03b6d491ca76c756714ea"}
Jul 15 16:11:10.506226 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.506074    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm" event={"ID":"c472b08a-def4-4ce8-86f4-25629c69ef09","Type":"ContainerDied","Data":"5c9e45321f4f23a85f7e0919bccdba7aeb68c0d8dc0c40beede0c7a66e4e97b9"}
Jul 15 16:11:10.506226 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.506099    2583 scope.go:117] "RemoveContainer" containerID="c9b38deb17f2635e17510e6760a2a6fa461f83ffa4c03b6d491ca76c756714ea"
Jul 15 16:11:10.515346 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.515331    2583 scope.go:117] "RemoveContainer" containerID="9c55ab5e2a88060be33795fdca7c33d69c60aad277ed1e62d77ecfd99f9800b9"
Jul 15 16:11:10.523658 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.523642    2583 scope.go:117] "RemoveContainer" containerID="c9b38deb17f2635e17510e6760a2a6fa461f83ffa4c03b6d491ca76c756714ea"
Jul 15 16:11:10.523898 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:11:10.523880    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9b38deb17f2635e17510e6760a2a6fa461f83ffa4c03b6d491ca76c756714ea\": container with ID starting with c9b38deb17f2635e17510e6760a2a6fa461f83ffa4c03b6d491ca76c756714ea not found: ID does not exist" containerID="c9b38deb17f2635e17510e6760a2a6fa461f83ffa4c03b6d491ca76c756714ea"
Jul 15 16:11:10.523985 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.523909    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b38deb17f2635e17510e6760a2a6fa461f83ffa4c03b6d491ca76c756714ea"} err="failed to get container status \"c9b38deb17f2635e17510e6760a2a6fa461f83ffa4c03b6d491ca76c756714ea\": rpc error: code = NotFound desc = could not find container \"c9b38deb17f2635e17510e6760a2a6fa461f83ffa4c03b6d491ca76c756714ea\": container with ID starting with c9b38deb17f2635e17510e6760a2a6fa461f83ffa4c03b6d491ca76c756714ea not found: ID does not exist"
Jul 15 16:11:10.523985 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.523934    2583 scope.go:117] "RemoveContainer" containerID="9c55ab5e2a88060be33795fdca7c33d69c60aad277ed1e62d77ecfd99f9800b9"
Jul 15 16:11:10.524294 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:11:10.524278    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c55ab5e2a88060be33795fdca7c33d69c60aad277ed1e62d77ecfd99f9800b9\": container with ID starting with 9c55ab5e2a88060be33795fdca7c33d69c60aad277ed1e62d77ecfd99f9800b9 not found: ID does not exist" containerID="9c55ab5e2a88060be33795fdca7c33d69c60aad277ed1e62d77ecfd99f9800b9"
Jul 15 16:11:10.524339 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.524300    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c55ab5e2a88060be33795fdca7c33d69c60aad277ed1e62d77ecfd99f9800b9"} err="failed to get container status \"9c55ab5e2a88060be33795fdca7c33d69c60aad277ed1e62d77ecfd99f9800b9\": rpc error: code = NotFound desc = could not find container \"9c55ab5e2a88060be33795fdca7c33d69c60aad277ed1e62d77ecfd99f9800b9\": container with ID starting with 9c55ab5e2a88060be33795fdca7c33d69c60aad277ed1e62d77ecfd99f9800b9 not found: ID does not exist"
Jul 15 16:11:10.528816 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.528796    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"]
Jul 15 16:11:10.535885 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:10.535867    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b9b40333-openshift-default-69b8f9b78c-ss9xm"]
Jul 15 16:11:11.584132 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:11.584098    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c472b08a-def4-4ce8-86f4-25629c69ef09" path="/var/lib/kubelet/pods/c472b08a-def4-4ce8-86f4-25629c69ef09/volumes"
Jul 15 16:11:15.182964 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:15.182867    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:15.285622 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:15.285585    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:15.384453 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:15.384422    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:11:15.883933 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:15.883899    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:21.964968 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:21.964913    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:22.080675 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:22.080637    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:22.197485 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:22.197455    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:24.486631 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:24.486589    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:11:32.711801 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:32.711764    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:33.055632 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:33.055539    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:54.047566 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:54.047530    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:11:59.960074 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:11:59.960032    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:00.059910 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.059877    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:00.316092 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.315985    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:00.631315 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.631236    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"]
Jul 15 16:12:00.631649 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.631635    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c472b08a-def4-4ce8-86f4-25629c69ef09" containerName="istio-proxy"
Jul 15 16:12:00.631695 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.631651    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c472b08a-def4-4ce8-86f4-25629c69ef09" containerName="istio-proxy"
Jul 15 16:12:00.631695 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.631670    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d50e4ec4-9892-4eae-8d2e-5907602197f6" containerName="main"
Jul 15 16:12:00.631695 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.631676    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d50e4ec4-9892-4eae-8d2e-5907602197f6" containerName="main"
Jul 15 16:12:00.631695 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.631684    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c472b08a-def4-4ce8-86f4-25629c69ef09" containerName="istio-proxy"
Jul 15 16:12:00.631695 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.631690    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c472b08a-def4-4ce8-86f4-25629c69ef09" containerName="istio-proxy"
Jul 15 16:12:00.631853 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.631745    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c472b08a-def4-4ce8-86f4-25629c69ef09" containerName="istio-proxy"
Jul 15 16:12:00.631853 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.631754    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c472b08a-def4-4ce8-86f4-25629c69ef09" containerName="istio-proxy"
Jul 15 16:12:00.631853 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.631761    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d50e4ec4-9892-4eae-8d2e-5907602197f6" containerName="main"
Jul 15 16:12:00.634689 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.634668    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.637178 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.637152    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-24e47f-openshift-default-dockercfg-6zhxp\""
Jul 15 16:12:00.647114 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.647089    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"]
Jul 15 16:12:00.664925 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.664890    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:00.700923 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.700885    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-envoy\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.701190 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.700984    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-workload-socket\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.701190 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.701028    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-workload-certs\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.701190 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.701080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-credential-socket\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.701190 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.701116    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-token\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.701190 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.701155    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-data\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.701363 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.701214    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istiod-ca-cert\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.701363 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.701249    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-podinfo\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.701363 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.701265    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmq8s\" (UniqueName: \"kubernetes.io/projected/8b1e1cff-f5c9-4557-b4d6-874462f67c73-kube-api-access-gmq8s\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.802254 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.802199    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-workload-socket\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.802254 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.802257    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-workload-certs\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.802521 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.802298    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-credential-socket\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.802521 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.802336    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-token\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.802521 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.802370    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-data\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.802521 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.802388    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istiod-ca-cert\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.802521 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.802419    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-podinfo\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.802521 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.802435    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmq8s\" (UniqueName: \"kubernetes.io/projected/8b1e1cff-f5c9-4557-b4d6-874462f67c73-kube-api-access-gmq8s\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.802521 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.802469    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-envoy\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.802892 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.802662    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-workload-socket\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.802892 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.802713    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-workload-certs\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.802892 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.802842    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-data\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.803097 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.803080    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-credential-socket\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.803195 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.803177    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istiod-ca-cert\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.804765 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.804747    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-envoy\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.804904 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.804884    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-podinfo\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.812988 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.812942    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-token\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.813131 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.813071    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmq8s\" (UniqueName: \"kubernetes.io/projected/8b1e1cff-f5c9-4557-b4d6-874462f67c73-kube-api-access-gmq8s\") pod \"e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") " pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:00.945539 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:00.945507    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:01.088446 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:01.088420    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"]
Jul 15 16:12:01.090326 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:12:01.090291    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1e1cff_f5c9_4557_b4d6_874462f67c73.slice/crio-4ff85aa602b10dc006c86e6787555371c2f921ab421db44b54521c0c96c7d36e WatchSource:0}: Error finding container 4ff85aa602b10dc006c86e6787555371c2f921ab421db44b54521c0c96c7d36e: Status 404 returned error can't find the container with id 4ff85aa602b10dc006c86e6787555371c2f921ab421db44b54521c0c96c7d36e
Jul 15 16:12:01.092588 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:01.092550    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:12:01.092694 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:01.092644    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:12:01.092749 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:01.092694    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:12:01.163650 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:01.163620    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:01.749205 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:01.749163    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62" event={"ID":"8b1e1cff-f5c9-4557-b4d6-874462f67c73","Type":"ContainerStarted","Data":"a38e9fcd442b7d7bb15777ee8f28fae7f958809d078bd0f978db0a720321c94a"}
Jul 15 16:12:01.749421 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:01.749218    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62" event={"ID":"8b1e1cff-f5c9-4557-b4d6-874462f67c73","Type":"ContainerStarted","Data":"4ff85aa602b10dc006c86e6787555371c2f921ab421db44b54521c0c96c7d36e"}
Jul 15 16:12:01.771090 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:01.770916    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62" podStartSLOduration=1.770896074 podStartE2EDuration="1.770896074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:12:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:12:01.770609192 +0000 UTC m=+2199.179382402" watchObservedRunningTime="2026-07-15 16:12:01.770896074 +0000 UTC m=+2199.179669266"
Jul 15 16:12:01.946357 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:01.946308    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:02.951223 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:02.951188    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:03.759185 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:03.759153    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:03.760016 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:03.759998    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:03.764415 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:03.764374    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:03.868904 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:03.868866    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:04.002896 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:04.002845    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:04.202337 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:04.202302    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:04.485530 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:04.485438    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:04.585355 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:04.585322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:08.518516 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.518475    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:08.582652 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.582614    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:08.852126 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.852044    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"]
Jul 15 16:12:08.855717 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.855696    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.858865 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.858840    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a84db0-openshift-default-dockercfg-659jx\""
Jul 15 16:12:08.878656 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.878628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr8cx\" (UniqueName: \"kubernetes.io/projected/65353b87-f24f-468e-8346-6d1ae5b7a8c0-kube-api-access-qr8cx\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.878829 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.878660    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istiod-ca-cert\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.878829 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.878693    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-workload-socket\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.878829 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.878720    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-token\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.878829 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.878747    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-workload-certs\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.878829 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.878806    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-envoy\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.879136 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.878855    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-data\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.879136 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.878870    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-podinfo\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.879136 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.878886    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-credential-socket\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.879241 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.879193    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"]
Jul 15 16:12:08.906512 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.906474    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:08.979513 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.979475    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-data\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.979513 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.979510    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-podinfo\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.979742 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.979530    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-credential-socket\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.979811 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.979786    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr8cx\" (UniqueName: \"kubernetes.io/projected/65353b87-f24f-468e-8346-6d1ae5b7a8c0-kube-api-access-qr8cx\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.979872 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.979838    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istiod-ca-cert\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.979872 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.979860    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-credential-socket\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.980026 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.979877    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-workload-socket\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.980026 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.979909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-token\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.980026 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.979930    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-data\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.980026 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.980008    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-workload-certs\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.980235 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.980070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-envoy\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.980235 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.980182    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-workload-socket\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.980409 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.980388    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-workload-certs\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.980550 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.980526    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istiod-ca-cert\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.982094 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.982077    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-envoy\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.982236 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.982219    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-podinfo\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.988991 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.988923    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-token\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:08.989113 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:08.989041    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr8cx\" (UniqueName: \"kubernetes.io/projected/65353b87-f24f-468e-8346-6d1ae5b7a8c0-kube-api-access-qr8cx\") pod \"e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") " pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:09.075830 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:09.075792    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:09.166994 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:09.166877    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:09.311831 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:09.311802    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"]
Jul 15 16:12:09.313679 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:12:09.313645    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65353b87_f24f_468e_8346_6d1ae5b7a8c0.slice/crio-b373f85e7c4d04c83117df34fbe8855088470bf57ba14afd3d219694253f40b7 WatchSource:0}: Error finding container b373f85e7c4d04c83117df34fbe8855088470bf57ba14afd3d219694253f40b7: Status 404 returned error can't find the container with id b373f85e7c4d04c83117df34fbe8855088470bf57ba14afd3d219694253f40b7
Jul 15 16:12:09.316038 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:09.315993    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:12:09.316117 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:09.316091    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:12:09.316155 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:09.316137    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:12:09.790750 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:09.790708    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf" event={"ID":"65353b87-f24f-468e-8346-6d1ae5b7a8c0","Type":"ContainerStarted","Data":"e9028ed266f6f3f9a1ee116b13d9ca3c10f497bbe218165bc69c5534bd7455ab"}
Jul 15 16:12:09.791187 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:09.790770    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf" event={"ID":"65353b87-f24f-468e-8346-6d1ae5b7a8c0","Type":"ContainerStarted","Data":"b373f85e7c4d04c83117df34fbe8855088470bf57ba14afd3d219694253f40b7"}
Jul 15 16:12:09.818446 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:09.818385    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf" podStartSLOduration=1.8183673809999998 podStartE2EDuration="1.818367381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:12:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:12:09.815662642 +0000 UTC m=+2207.224435852" watchObservedRunningTime="2026-07-15 16:12:09.818367381 +0000 UTC m=+2207.227140566"
Jul 15 16:12:10.168080 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:10.167982    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:10.172971 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:10.172924    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:10.796382 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:10.796354    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:10.797204 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:10.797187    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:11.283655 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:11.283620    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:12:11.739483 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:11.739423    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:11.879281 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:11.879243    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:12.044562 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:12.044454    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:12.204398 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:12.204364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:12.572838 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:12.572803    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:12.670203 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:12.670153    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:16.255547 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:16.255508    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:19.800163 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:19.800123    2583 patch_prober.go:28] interesting pod/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 16:12:19.800561 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:19.800183    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62" podUID="8b1e1cff-f5c9-4557-b4d6-874462f67c73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 16:12:20.857720 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:20.857661    2583 generic.go:356] "Generic (PLEG): container finished" podID="8b1e1cff-f5c9-4557-b4d6-874462f67c73" containerID="a38e9fcd442b7d7bb15777ee8f28fae7f958809d078bd0f978db0a720321c94a" exitCode=0
Jul 15 16:12:20.858322 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:20.857755    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62" event={"ID":"8b1e1cff-f5c9-4557-b4d6-874462f67c73","Type":"ContainerDied","Data":"a38e9fcd442b7d7bb15777ee8f28fae7f958809d078bd0f978db0a720321c94a"}
Jul 15 16:12:20.858322 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:20.858261    2583 scope.go:117] "RemoveContainer" containerID="a38e9fcd442b7d7bb15777ee8f28fae7f958809d078bd0f978db0a720321c94a"
Jul 15 16:12:20.859555 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:20.859507    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:12:20.859679 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:20.859593    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:12:20.859679 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:20.859642    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:12:21.869239 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:21.869189    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62" event={"ID":"8b1e1cff-f5c9-4557-b4d6-874462f67c73","Type":"ContainerStarted","Data":"4097746b01c7ef4418c1547834fd35fc6dad1644d894baf16e684d3d92f1cdc2"}
Jul 15 16:12:21.946804 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:21.946768    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:21.947199 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:21.947118    2583 patch_prober.go:28] interesting pod/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 15 16:12:21.947354 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:21.947330    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62" podUID="8b1e1cff-f5c9-4557-b4d6-874462f67c73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 15 16:12:22.205292 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:22.205248    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:12:22.946722 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:22.946247    2583 patch_prober.go:28] interesting pod/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 15 16:12:22.946722 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:22.946319    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62" podUID="8b1e1cff-f5c9-4557-b4d6-874462f67c73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 15 16:12:23.946183 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:23.946136    2583 patch_prober.go:28] interesting pod/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 15 16:12:23.946402 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:23.946220    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62" podUID="8b1e1cff-f5c9-4557-b4d6-874462f67c73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 15 16:12:24.946962 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:24.946905    2583 patch_prober.go:28] interesting pod/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 15 16:12:24.947452 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:24.947012    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62" podUID="8b1e1cff-f5c9-4557-b4d6-874462f67c73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 15 16:12:25.932459 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:25.931928    2583 patch_prober.go:28] interesting pod/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": read tcp 10.133.0.2:57288->10.133.0.41:15021: read: connection reset by peer" start-of-body=
Jul 15 16:12:25.932459 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:25.932007    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf" podUID="65353b87-f24f-468e-8346-6d1ae5b7a8c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": read tcp 10.133.0.2:57288->10.133.0.41:15021: read: connection reset by peer"
Jul 15 16:12:25.949908 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:25.949882    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:25.950346 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:25.950306    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:25.951016 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:25.950989    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:12:26.897572 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:26.897539    2583 generic.go:356] "Generic (PLEG): container finished" podID="65353b87-f24f-468e-8346-6d1ae5b7a8c0" containerID="e9028ed266f6f3f9a1ee116b13d9ca3c10f497bbe218165bc69c5534bd7455ab" exitCode=0
Jul 15 16:12:26.897741 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:26.897620    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf" event={"ID":"65353b87-f24f-468e-8346-6d1ae5b7a8c0","Type":"ContainerDied","Data":"e9028ed266f6f3f9a1ee116b13d9ca3c10f497bbe218165bc69c5534bd7455ab"}
Jul 15 16:12:26.898180 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:26.898158    2583 scope.go:117] "RemoveContainer" containerID="e9028ed266f6f3f9a1ee116b13d9ca3c10f497bbe218165bc69c5534bd7455ab"
Jul 15 16:12:26.899155 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:26.899128    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:12:26.899238 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:26.899194    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:12:26.899238 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:26.899225    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:12:27.904007 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:27.903969    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf" event={"ID":"65353b87-f24f-468e-8346-6d1ae5b7a8c0","Type":"ContainerStarted","Data":"e2eabb53480179f0693daf28eb0c5a147b5382ccc328ed3c4058a4c78b3a0cb4"}
Jul 15 16:12:28.167181 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:28.167083    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:28.167336 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:28.167280    2583 patch_prober.go:28] interesting pod/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 15 16:12:28.167379 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:28.167326    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf" podUID="65353b87-f24f-468e-8346-6d1ae5b7a8c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 15 16:12:28.278038 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:28.278002    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:28.379575 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:28.379533    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:29.167744 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:29.167701    2583 patch_prober.go:28] interesting pod/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 15 16:12:29.168259 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:29.167770    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf" podUID="65353b87-f24f-468e-8346-6d1ae5b7a8c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 15 16:12:30.168308 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:30.168272    2583 patch_prober.go:28] interesting pod/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 15 16:12:30.168756 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:30.168331    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf" podUID="65353b87-f24f-468e-8346-6d1ae5b7a8c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 15 16:12:31.168213 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:31.168174    2583 patch_prober.go:28] interesting pod/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 15 16:12:31.168473 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:31.168232    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf" podUID="65353b87-f24f-468e-8346-6d1ae5b7a8c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 15 16:12:32.171550 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:32.171513    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:32.172042 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:32.171909    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:32.172729 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:32.172710    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:12:33.355298 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.355257    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:33.453994 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.453940    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:33.698309 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.698272    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"]
Jul 15 16:12:33.701883 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.701865    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.704864 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.704833    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-24e47f\"/\"default-dockercfg-72xjd\""
Jul 15 16:12:33.705869 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.705839    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-24e47f\"/\"openshift-service-ca.crt\""
Jul 15 16:12:33.706004 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.705840    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-24e47f\"/\"test-model-24e47f-kserve-self-signed-certs\""
Jul 15 16:12:33.706004 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.705844    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-24e47f\"/\"kube-root-ca.crt\""
Jul 15 16:12:33.712670 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.712641    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"]
Jul 15 16:12:33.730786 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.730751    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:33.847160 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.847118    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-tmp-dir\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.847160 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.847164    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7vqc\" (UniqueName: \"kubernetes.io/projected/324abf6b-9e04-4066-be5e-9714d9f3e98c-kube-api-access-s7vqc\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.847397 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.847187    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-model-cache\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.847397 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.847273    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/324abf6b-9e04-4066-be5e-9714d9f3e98c-tls-certs\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.847397 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.847322    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-dshm\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.847397 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.847349    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-home\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.948849 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.948758    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-home\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.948849 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.948835    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-tmp-dir\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.949095 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.948860    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vqc\" (UniqueName: \"kubernetes.io/projected/324abf6b-9e04-4066-be5e-9714d9f3e98c-kube-api-access-s7vqc\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.949095 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.948880    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-model-cache\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.949095 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.948915    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/324abf6b-9e04-4066-be5e-9714d9f3e98c-tls-certs\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.949095 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.948987    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-dshm\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.949272 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.949250    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-home\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.949318 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.949301    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-model-cache\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.949374 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.949332    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-tmp-dir\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.951326 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.951302    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-dshm\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.951496 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.951482    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/324abf6b-9e04-4066-be5e-9714d9f3e98c-tls-certs\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:33.957898 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:33.957868    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7vqc\" (UniqueName: \"kubernetes.io/projected/324abf6b-9e04-4066-be5e-9714d9f3e98c-kube-api-access-s7vqc\") pod \"test-model-24e47f-kserve-75b7bd4845-4g7zc\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") " pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:34.012738 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:34.012695    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:34.149884 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:34.149851    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"]
Jul 15 16:12:34.150893 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:12:34.150865    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod324abf6b_9e04_4066_be5e_9714d9f3e98c.slice/crio-b6252e332ac09d198332d1ece78f6abb5429d9a74a0b3fd7ba2ac51f1f971874 WatchSource:0}: Error finding container b6252e332ac09d198332d1ece78f6abb5429d9a74a0b3fd7ba2ac51f1f971874: Status 404 returned error can't find the container with id b6252e332ac09d198332d1ece78f6abb5429d9a74a0b3fd7ba2ac51f1f971874
Jul 15 16:12:34.940020 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:34.939981    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc" event={"ID":"324abf6b-9e04-4066-be5e-9714d9f3e98c","Type":"ContainerStarted","Data":"36cd92460263885a11dfb8ba907e371b08793226e6a0601fd6b8cc108370b962"}
Jul 15 16:12:34.940446 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:34.940029    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc" event={"ID":"324abf6b-9e04-4066-be5e-9714d9f3e98c","Type":"ContainerStarted","Data":"b6252e332ac09d198332d1ece78f6abb5429d9a74a0b3fd7ba2ac51f1f971874"}
Jul 15 16:12:34.960143 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:34.960094    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc" podStartSLOduration=1.960077637 podStartE2EDuration="1.960077637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:12:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:12:34.959094181 +0000 UTC m=+2232.367867373" watchObservedRunningTime="2026-07-15 16:12:34.960077637 +0000 UTC m=+2232.368850827"
Jul 15 16:12:36.887430 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:36.887381    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:12:44.013359 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:44.013324    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:44.013780 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:44.013372    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:44.026130 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:44.026107    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:45.000091 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:45.000004    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:12:47.292251 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:47.292216    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:12:50.181830 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:50.181792    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:12:57.982228 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:12:57.982188    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:13:19.873248 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:19.873209    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"]
Jul 15 16:13:19.896330 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:19.896291    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:13:20.755554 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:20.755516    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:13:24.083841 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:24.083805    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:13:24.369455 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:24.369368    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:13:24.424491 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:24.424453    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:13:31.490487 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:31.490450    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:13:34.894070 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:34.894028    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc" podUID="324abf6b-9e04-4066-be5e-9714d9f3e98c" containerName="main" containerID="cri-o://36cd92460263885a11dfb8ba907e371b08793226e6a0601fd6b8cc108370b962" gracePeriod=45
Jul 15 16:13:34.988981 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:34.988924    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc" podUID="324abf6b-9e04-4066-be5e-9714d9f3e98c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": dial tcp 10.133.0.42:8000: connect: connection refused"
Jul 15 16:13:35.137738 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.137714    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:13:35.235101 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.235064    2583 generic.go:356] "Generic (PLEG): container finished" podID="324abf6b-9e04-4066-be5e-9714d9f3e98c" containerID="36cd92460263885a11dfb8ba907e371b08793226e6a0601fd6b8cc108370b962" exitCode=0
Jul 15 16:13:35.235289 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.235113    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"
Jul 15 16:13:35.235289 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.235133    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc" event={"ID":"324abf6b-9e04-4066-be5e-9714d9f3e98c","Type":"ContainerDied","Data":"36cd92460263885a11dfb8ba907e371b08793226e6a0601fd6b8cc108370b962"}
Jul 15 16:13:35.235289 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.235174    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc" event={"ID":"324abf6b-9e04-4066-be5e-9714d9f3e98c","Type":"ContainerDied","Data":"b6252e332ac09d198332d1ece78f6abb5429d9a74a0b3fd7ba2ac51f1f971874"}
Jul 15 16:13:35.235289 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.235196    2583 scope.go:117] "RemoveContainer" containerID="36cd92460263885a11dfb8ba907e371b08793226e6a0601fd6b8cc108370b962"
Jul 15 16:13:35.243826 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.243805    2583 scope.go:117] "RemoveContainer" containerID="36cd92460263885a11dfb8ba907e371b08793226e6a0601fd6b8cc108370b962"
Jul 15 16:13:35.244143 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:13:35.244124    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36cd92460263885a11dfb8ba907e371b08793226e6a0601fd6b8cc108370b962\": container with ID starting with 36cd92460263885a11dfb8ba907e371b08793226e6a0601fd6b8cc108370b962 not found: ID does not exist" containerID="36cd92460263885a11dfb8ba907e371b08793226e6a0601fd6b8cc108370b962"
Jul 15 16:13:35.244206 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.244152    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36cd92460263885a11dfb8ba907e371b08793226e6a0601fd6b8cc108370b962"} err="failed to get container status \"36cd92460263885a11dfb8ba907e371b08793226e6a0601fd6b8cc108370b962\": rpc error: code = NotFound desc = could not find container \"36cd92460263885a11dfb8ba907e371b08793226e6a0601fd6b8cc108370b962\": container with ID starting with 36cd92460263885a11dfb8ba907e371b08793226e6a0601fd6b8cc108370b962 not found: ID does not exist"
Jul 15 16:13:35.250482 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.250453    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-tmp-dir\") pod \"324abf6b-9e04-4066-be5e-9714d9f3e98c\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") "
Jul 15 16:13:35.250605 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.250490    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7vqc\" (UniqueName: \"kubernetes.io/projected/324abf6b-9e04-4066-be5e-9714d9f3e98c-kube-api-access-s7vqc\") pod \"324abf6b-9e04-4066-be5e-9714d9f3e98c\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") "
Jul 15 16:13:35.250605 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.250513    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-home\") pod \"324abf6b-9e04-4066-be5e-9714d9f3e98c\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") "
Jul 15 16:13:35.250727 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.250621    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-model-cache\") pod \"324abf6b-9e04-4066-be5e-9714d9f3e98c\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") "
Jul 15 16:13:35.250727 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.250667    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-dshm\") pod \"324abf6b-9e04-4066-be5e-9714d9f3e98c\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") "
Jul 15 16:13:35.250727 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.250694    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/324abf6b-9e04-4066-be5e-9714d9f3e98c-tls-certs\") pod \"324abf6b-9e04-4066-be5e-9714d9f3e98c\" (UID: \"324abf6b-9e04-4066-be5e-9714d9f3e98c\") "
Jul 15 16:13:35.250870 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.250732    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "324abf6b-9e04-4066-be5e-9714d9f3e98c" (UID: "324abf6b-9e04-4066-be5e-9714d9f3e98c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:13:35.250918 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.250855    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-home" (OuterVolumeSpecName: "home") pod "324abf6b-9e04-4066-be5e-9714d9f3e98c" (UID: "324abf6b-9e04-4066-be5e-9714d9f3e98c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:13:35.250992 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.250925    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-model-cache" (OuterVolumeSpecName: "model-cache") pod "324abf6b-9e04-4066-be5e-9714d9f3e98c" (UID: "324abf6b-9e04-4066-be5e-9714d9f3e98c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:13:35.251162 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.251140    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-tmp-dir\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:13:35.251244 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.251170    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-home\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:13:35.251244 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.251186    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-model-cache\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:13:35.252816 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.252791    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/324abf6b-9e04-4066-be5e-9714d9f3e98c-kube-api-access-s7vqc" (OuterVolumeSpecName: "kube-api-access-s7vqc") pod "324abf6b-9e04-4066-be5e-9714d9f3e98c" (UID: "324abf6b-9e04-4066-be5e-9714d9f3e98c"). InnerVolumeSpecName "kube-api-access-s7vqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:13:35.252936 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.252858    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-dshm" (OuterVolumeSpecName: "dshm") pod "324abf6b-9e04-4066-be5e-9714d9f3e98c" (UID: "324abf6b-9e04-4066-be5e-9714d9f3e98c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:13:35.252936 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.252903    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/324abf6b-9e04-4066-be5e-9714d9f3e98c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "324abf6b-9e04-4066-be5e-9714d9f3e98c" (UID: "324abf6b-9e04-4066-be5e-9714d9f3e98c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:13:35.352432 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.352392    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7vqc\" (UniqueName: \"kubernetes.io/projected/324abf6b-9e04-4066-be5e-9714d9f3e98c-kube-api-access-s7vqc\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:13:35.352432 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.352427    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/324abf6b-9e04-4066-be5e-9714d9f3e98c-dshm\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:13:35.352432 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.352438    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/324abf6b-9e04-4066-be5e-9714d9f3e98c-tls-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:13:35.557991 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.557942    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"]
Jul 15 16:13:35.565625 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.565597    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-24e47f/test-model-24e47f-kserve-75b7bd4845-4g7zc"]
Jul 15 16:13:35.585094 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:35.585046    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="324abf6b-9e04-4066-be5e-9714d9f3e98c" path="/var/lib/kubelet/pods/324abf6b-9e04-4066-be5e-9714d9f3e98c/volumes"
Jul 15 16:13:36.046403 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:36.046369    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:13:36.985793 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:36.985755    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:13:40.786388 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:40.786351    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:13:42.463600 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:42.463559    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:13:42.563416 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:42.563384    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:13:46.717985 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:46.717930    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"]
Jul 15 16:13:46.718459 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:46.718169    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62" podUID="8b1e1cff-f5c9-4557-b4d6-874462f67c73" containerName="istio-proxy" containerID="cri-o://4097746b01c7ef4418c1547834fd35fc6dad1644d894baf16e684d3d92f1cdc2" gracePeriod=30
Jul 15 16:13:46.907123 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:46.907087    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:13:47.009480 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:47.009382    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:13:47.662595 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:47.662549    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:13:47.763352 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:47.763310    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:13:51.972247 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:51.972220    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:13:52.017046 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.016973    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-credential-socket\") pod \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") "
Jul 15 16:13:52.017046 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.017036    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-workload-certs\") pod \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") "
Jul 15 16:13:52.017268 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.017077    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-envoy\") pod \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") "
Jul 15 16:13:52.017268 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.017101    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-data\") pod \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") "
Jul 15 16:13:52.017268 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.017136    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istiod-ca-cert\") pod \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") "
Jul 15 16:13:52.017268 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.017161    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmq8s\" (UniqueName: \"kubernetes.io/projected/8b1e1cff-f5c9-4557-b4d6-874462f67c73-kube-api-access-gmq8s\") pod \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") "
Jul 15 16:13:52.017268 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.017201    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-token\") pod \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") "
Jul 15 16:13:52.017268 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.017234    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-workload-socket\") pod \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") "
Jul 15 16:13:52.017268 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.017257    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-podinfo\") pod \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\" (UID: \"8b1e1cff-f5c9-4557-b4d6-874462f67c73\") "
Jul 15 16:13:52.017627 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.017260    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b1e1cff-f5c9-4557-b4d6-874462f67c73" (UID: "8b1e1cff-f5c9-4557-b4d6-874462f67c73"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:13:52.017627 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.017410    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b1e1cff-f5c9-4557-b4d6-874462f67c73" (UID: "8b1e1cff-f5c9-4557-b4d6-874462f67c73"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:13:52.017730 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.017677    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-workload-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:13:52.017730 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.017697    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-credential-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:13:52.017867 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.017837    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b1e1cff-f5c9-4557-b4d6-874462f67c73" (UID: "8b1e1cff-f5c9-4557-b4d6-874462f67c73"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:13:52.018043 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.017881    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b1e1cff-f5c9-4557-b4d6-874462f67c73" (UID: "8b1e1cff-f5c9-4557-b4d6-874462f67c73"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:13:52.018571 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.018484    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b1e1cff-f5c9-4557-b4d6-874462f67c73" (UID: "8b1e1cff-f5c9-4557-b4d6-874462f67c73"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:13:52.019729 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.019702    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b1e1cff-f5c9-4557-b4d6-874462f67c73" (UID: "8b1e1cff-f5c9-4557-b4d6-874462f67c73"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:13:52.020303 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.020273    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b1e1cff-f5c9-4557-b4d6-874462f67c73" (UID: "8b1e1cff-f5c9-4557-b4d6-874462f67c73"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:13:52.023123 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.023086    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b1e1cff-f5c9-4557-b4d6-874462f67c73" (UID: "8b1e1cff-f5c9-4557-b4d6-874462f67c73"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:13:52.023222 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.023175    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b1e1cff-f5c9-4557-b4d6-874462f67c73-kube-api-access-gmq8s" (OuterVolumeSpecName: "kube-api-access-gmq8s") pod "8b1e1cff-f5c9-4557-b4d6-874462f67c73" (UID: "8b1e1cff-f5c9-4557-b4d6-874462f67c73"). InnerVolumeSpecName "kube-api-access-gmq8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:13:52.118425 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.118375    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-token\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:13:52.118425 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.118417    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-workload-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:13:52.118425 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.118427    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-podinfo\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:13:52.118425 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.118436    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-envoy\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:13:52.118425 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.118444    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istio-data\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:13:52.118725 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.118470    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b1e1cff-f5c9-4557-b4d6-874462f67c73-istiod-ca-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:13:52.118725 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.118481    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmq8s\" (UniqueName: \"kubernetes.io/projected/8b1e1cff-f5c9-4557-b4d6-874462f67c73-kube-api-access-gmq8s\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:13:52.320758 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.320330    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62" event={"ID":"8b1e1cff-f5c9-4557-b4d6-874462f67c73","Type":"ContainerDied","Data":"4097746b01c7ef4418c1547834fd35fc6dad1644d894baf16e684d3d92f1cdc2"}
Jul 15 16:13:52.320758 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.320500    2583 scope.go:117] "RemoveContainer" containerID="4097746b01c7ef4418c1547834fd35fc6dad1644d894baf16e684d3d92f1cdc2"
Jul 15 16:13:52.320758 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.320344    2583 generic.go:356] "Generic (PLEG): container finished" podID="8b1e1cff-f5c9-4557-b4d6-874462f67c73" containerID="4097746b01c7ef4418c1547834fd35fc6dad1644d894baf16e684d3d92f1cdc2" exitCode=0
Jul 15 16:13:52.320758 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.320450    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"
Jul 15 16:13:52.320758 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.320755    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62" event={"ID":"8b1e1cff-f5c9-4557-b4d6-874462f67c73","Type":"ContainerDied","Data":"4ff85aa602b10dc006c86e6787555371c2f921ab421db44b54521c0c96c7d36e"}
Jul 15 16:13:52.335372 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.335352    2583 scope.go:117] "RemoveContainer" containerID="a38e9fcd442b7d7bb15777ee8f28fae7f958809d078bd0f978db0a720321c94a"
Jul 15 16:13:52.343408 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.343393    2583 scope.go:117] "RemoveContainer" containerID="4097746b01c7ef4418c1547834fd35fc6dad1644d894baf16e684d3d92f1cdc2"
Jul 15 16:13:52.343644 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:13:52.343625    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4097746b01c7ef4418c1547834fd35fc6dad1644d894baf16e684d3d92f1cdc2\": container with ID starting with 4097746b01c7ef4418c1547834fd35fc6dad1644d894baf16e684d3d92f1cdc2 not found: ID does not exist" containerID="4097746b01c7ef4418c1547834fd35fc6dad1644d894baf16e684d3d92f1cdc2"
Jul 15 16:13:52.343684 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.343652    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4097746b01c7ef4418c1547834fd35fc6dad1644d894baf16e684d3d92f1cdc2"} err="failed to get container status \"4097746b01c7ef4418c1547834fd35fc6dad1644d894baf16e684d3d92f1cdc2\": rpc error: code = NotFound desc = could not find container \"4097746b01c7ef4418c1547834fd35fc6dad1644d894baf16e684d3d92f1cdc2\": container with ID starting with 4097746b01c7ef4418c1547834fd35fc6dad1644d894baf16e684d3d92f1cdc2 not found: ID does not exist"
Jul 15 16:13:52.343684 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.343668    2583 scope.go:117] "RemoveContainer" containerID="a38e9fcd442b7d7bb15777ee8f28fae7f958809d078bd0f978db0a720321c94a"
Jul 15 16:13:52.343897 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:13:52.343881    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a38e9fcd442b7d7bb15777ee8f28fae7f958809d078bd0f978db0a720321c94a\": container with ID starting with a38e9fcd442b7d7bb15777ee8f28fae7f958809d078bd0f978db0a720321c94a not found: ID does not exist" containerID="a38e9fcd442b7d7bb15777ee8f28fae7f958809d078bd0f978db0a720321c94a"
Jul 15 16:13:52.343934 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.343902    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a38e9fcd442b7d7bb15777ee8f28fae7f958809d078bd0f978db0a720321c94a"} err="failed to get container status \"a38e9fcd442b7d7bb15777ee8f28fae7f958809d078bd0f978db0a720321c94a\": rpc error: code = NotFound desc = could not find container \"a38e9fcd442b7d7bb15777ee8f28fae7f958809d078bd0f978db0a720321c94a\": container with ID starting with a38e9fcd442b7d7bb15777ee8f28fae7f958809d078bd0f978db0a720321c94a not found: ID does not exist"
Jul 15 16:13:52.347453 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.347430    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"]
Jul 15 16:13:52.351867 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:52.351845    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-24e47f-openshift-default-5c55b5968f-qhl62"]
Jul 15 16:13:53.586604 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:53.586571    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b1e1cff-f5c9-4557-b4d6-874462f67c73" path="/var/lib/kubelet/pods/8b1e1cff-f5c9-4557-b4d6-874462f67c73/volumes"
Jul 15 16:13:57.746492 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:57.746456    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:13:59.010188 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:59.010137    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:13:59.111480 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:13:59.111444    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:00.883613 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:00.883576    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:14:02.212893 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:02.212854    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:08.512829 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:08.512798    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:08.602619 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:08.602582    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:12.904603 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:12.904569    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"]
Jul 15 16:14:12.905128 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:12.904862    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf" podUID="65353b87-f24f-468e-8346-6d1ae5b7a8c0" containerName="istio-proxy" containerID="cri-o://e2eabb53480179f0693daf28eb0c5a147b5382ccc328ed3c4058a4c78b3a0cb4" gracePeriod=30
Jul 15 16:14:12.943279 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:12.943251    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:13.197400 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.197339    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:13.498140 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.498046    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:13.799684 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.799600    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"]
Jul 15 16:14:13.800030 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.800015    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1e1cff-f5c9-4557-b4d6-874462f67c73" containerName="istio-proxy"
Jul 15 16:14:13.800030 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.800031    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1e1cff-f5c9-4557-b4d6-874462f67c73" containerName="istio-proxy"
Jul 15 16:14:13.800147 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.800043    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="324abf6b-9e04-4066-be5e-9714d9f3e98c" containerName="main"
Jul 15 16:14:13.800147 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.800048    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="324abf6b-9e04-4066-be5e-9714d9f3e98c" containerName="main"
Jul 15 16:14:13.800147 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.800105    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b1e1cff-f5c9-4557-b4d6-874462f67c73" containerName="istio-proxy"
Jul 15 16:14:13.800147 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.800116    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="324abf6b-9e04-4066-be5e-9714d9f3e98c" containerName="main"
Jul 15 16:14:13.803410 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.803389    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:13.806231 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.806212    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b896e0-openshift-default-dockercfg-rmqgd\""
Jul 15 16:14:13.814142 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.814119    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"]
Jul 15 16:14:13.831690 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.831662    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:13.925756 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.925720    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-envoy\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:13.926254 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.925773    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-data\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:13.926254 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.925890    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-workload-certs\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:13.926254 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.925929    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-token\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:13.926254 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.926003    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-podinfo\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:13.926254 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.926059    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-workload-socket\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:13.926254 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.926095    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-credential-socket\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:13.926254 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.926147    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdk9h\" (UniqueName: \"kubernetes.io/projected/0f9e4bf5-e327-4578-a904-6b618fec97a8-kube-api-access-sdk9h\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:13.926254 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.926189    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f9e4bf5-e327-4578-a904-6b618fec97a8-istiod-ca-cert\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:13.957156 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:13.957109    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:14.026730 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.026684    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-workload-socket\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.026730 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.026734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-credential-socket\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.027035 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.026762    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdk9h\" (UniqueName: \"kubernetes.io/projected/0f9e4bf5-e327-4578-a904-6b618fec97a8-kube-api-access-sdk9h\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.027035 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.026791    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f9e4bf5-e327-4578-a904-6b618fec97a8-istiod-ca-cert\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.027035 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.026830    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-envoy\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.027035 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.026885    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-data\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.027035 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.026982    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-workload-certs\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.027035 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.027010    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-token\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.027382 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.027050    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-podinfo\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.027382 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.027147    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-workload-socket\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.027382 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.027191    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-credential-socket\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.027382 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.027311    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-data\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.027547 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.027445    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-workload-certs\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.027547 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.027525    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f9e4bf5-e327-4578-a904-6b618fec97a8-istiod-ca-cert\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.029040 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.029023    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-envoy\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.029502 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.029481    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-podinfo\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.042964 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.042920    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-token\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.047844 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.047822    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdk9h\" (UniqueName: \"kubernetes.io/projected/0f9e4bf5-e327-4578-a904-6b618fec97a8-kube-api-access-sdk9h\") pod \"e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") " pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.114075 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.114012    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:14.264989 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.264962    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"]
Jul 15 16:14:14.267469 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:14:14.267441    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f9e4bf5_e327_4578_a904_6b618fec97a8.slice/crio-cb9b085c154f3b39e29b6e805c207572ea2f56b8acd770b0a86984de82c44145 WatchSource:0}: Error finding container cb9b085c154f3b39e29b6e805c207572ea2f56b8acd770b0a86984de82c44145: Status 404 returned error can't find the container with id cb9b085c154f3b39e29b6e805c207572ea2f56b8acd770b0a86984de82c44145
Jul 15 16:14:14.269582 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.269550    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:14:14.269656 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.269611    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:14:14.269656 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.269644    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:14:14.430717 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.430624    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2" event={"ID":"0f9e4bf5-e327-4578-a904-6b618fec97a8","Type":"ContainerStarted","Data":"5c4267bc48c8e8151acca3919dd0b44019b2b7cbaf3bbd6b57a1c18e9c25492c"}
Jul 15 16:14:14.430717 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.430688    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2" event={"ID":"0f9e4bf5-e327-4578-a904-6b618fec97a8","Type":"ContainerStarted","Data":"cb9b085c154f3b39e29b6e805c207572ea2f56b8acd770b0a86984de82c44145"}
Jul 15 16:14:14.453669 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:14.453615    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2" podStartSLOduration=1.453595097 podStartE2EDuration="1.453595097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:14:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:14:14.452095757 +0000 UTC m=+2331.860868952" watchObservedRunningTime="2026-07-15 16:14:14.453595097 +0000 UTC m=+2331.862368289"
Jul 15 16:14:15.115126 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:15.115096    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:15.120114 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:15.120088    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:15.436859 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:15.436779    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:15.437587 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:15.437566    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:16.394982 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:16.394927    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:16.493843 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:16.493809    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:16.591974 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:16.591925    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:17.110430 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:17.110392    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:17.174066 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:17.174031    2583 patch_prober.go:28] interesting pod/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 16:14:17.174235 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:17.174085    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf" podUID="65353b87-f24f-468e-8346-6d1ae5b7a8c0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:14:17.222361 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:17.222328    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:18.161615 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.161593    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:14:18.270076 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.270043    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-credential-socket\") pod \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") "
Jul 15 16:14:18.270076 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.270079    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr8cx\" (UniqueName: \"kubernetes.io/projected/65353b87-f24f-468e-8346-6d1ae5b7a8c0-kube-api-access-qr8cx\") pod \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") "
Jul 15 16:14:18.270312 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.270119    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-envoy\") pod \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") "
Jul 15 16:14:18.270312 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.270145    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-data\") pod \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") "
Jul 15 16:14:18.270312 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.270176    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istiod-ca-cert\") pod \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") "
Jul 15 16:14:18.270312 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.270206    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-workload-socket\") pod \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") "
Jul 15 16:14:18.270312 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.270245    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-podinfo\") pod \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") "
Jul 15 16:14:18.270312 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.270281    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-token\") pod \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") "
Jul 15 16:14:18.270312 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.270313    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-workload-certs\") pod \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\" (UID: \"65353b87-f24f-468e-8346-6d1ae5b7a8c0\") "
Jul 15 16:14:18.270666 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.270384    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65353b87-f24f-468e-8346-6d1ae5b7a8c0" (UID: "65353b87-f24f-468e-8346-6d1ae5b7a8c0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:14:18.270666 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.270580    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65353b87-f24f-468e-8346-6d1ae5b7a8c0" (UID: "65353b87-f24f-468e-8346-6d1ae5b7a8c0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:14:18.270773 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.270689    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istiod-ca-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:14:18.270773 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.270710    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-credential-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:14:18.270860 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.270771    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65353b87-f24f-468e-8346-6d1ae5b7a8c0" (UID: "65353b87-f24f-468e-8346-6d1ae5b7a8c0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:14:18.270860 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.270785    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65353b87-f24f-468e-8346-6d1ae5b7a8c0" (UID: "65353b87-f24f-468e-8346-6d1ae5b7a8c0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:14:18.271208 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.271183    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-data" (OuterVolumeSpecName: "istio-data") pod "65353b87-f24f-468e-8346-6d1ae5b7a8c0" (UID: "65353b87-f24f-468e-8346-6d1ae5b7a8c0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:14:18.272430 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.272401    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65353b87-f24f-468e-8346-6d1ae5b7a8c0" (UID: "65353b87-f24f-468e-8346-6d1ae5b7a8c0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:14:18.272430 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.272405    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65353b87-f24f-468e-8346-6d1ae5b7a8c0" (UID: "65353b87-f24f-468e-8346-6d1ae5b7a8c0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:14:18.272754 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.272730    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65353b87-f24f-468e-8346-6d1ae5b7a8c0-kube-api-access-qr8cx" (OuterVolumeSpecName: "kube-api-access-qr8cx") pod "65353b87-f24f-468e-8346-6d1ae5b7a8c0" (UID: "65353b87-f24f-468e-8346-6d1ae5b7a8c0"). InnerVolumeSpecName "kube-api-access-qr8cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:14:18.272754 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.272741    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-token" (OuterVolumeSpecName: "istio-token") pod "65353b87-f24f-468e-8346-6d1ae5b7a8c0" (UID: "65353b87-f24f-468e-8346-6d1ae5b7a8c0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:14:18.372039 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.372007    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-workload-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:14:18.372039 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.372035    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-podinfo\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:14:18.372039 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.372045    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-token\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:14:18.372269 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.372054    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-workload-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:14:18.372269 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.372063    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr8cx\" (UniqueName: \"kubernetes.io/projected/65353b87-f24f-468e-8346-6d1ae5b7a8c0-kube-api-access-qr8cx\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:14:18.372269 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.372072    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-envoy\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:14:18.372269 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.372080    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65353b87-f24f-468e-8346-6d1ae5b7a8c0-istio-data\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:14:18.452631 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.452598    2583 generic.go:356] "Generic (PLEG): container finished" podID="65353b87-f24f-468e-8346-6d1ae5b7a8c0" containerID="e2eabb53480179f0693daf28eb0c5a147b5382ccc328ed3c4058a4c78b3a0cb4" exitCode=0
Jul 15 16:14:18.452789 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.452648    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"
Jul 15 16:14:18.452789 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.452682    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf" event={"ID":"65353b87-f24f-468e-8346-6d1ae5b7a8c0","Type":"ContainerDied","Data":"e2eabb53480179f0693daf28eb0c5a147b5382ccc328ed3c4058a4c78b3a0cb4"}
Jul 15 16:14:18.452789 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.452736    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf" event={"ID":"65353b87-f24f-468e-8346-6d1ae5b7a8c0","Type":"ContainerDied","Data":"b373f85e7c4d04c83117df34fbe8855088470bf57ba14afd3d219694253f40b7"}
Jul 15 16:14:18.452789 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.452757    2583 scope.go:117] "RemoveContainer" containerID="e2eabb53480179f0693daf28eb0c5a147b5382ccc328ed3c4058a4c78b3a0cb4"
Jul 15 16:14:18.462080 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.462065    2583 scope.go:117] "RemoveContainer" containerID="e9028ed266f6f3f9a1ee116b13d9ca3c10f497bbe218165bc69c5534bd7455ab"
Jul 15 16:14:18.470223 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.470209    2583 scope.go:117] "RemoveContainer" containerID="e2eabb53480179f0693daf28eb0c5a147b5382ccc328ed3c4058a4c78b3a0cb4"
Jul 15 16:14:18.470483 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:14:18.470465    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2eabb53480179f0693daf28eb0c5a147b5382ccc328ed3c4058a4c78b3a0cb4\": container with ID starting with e2eabb53480179f0693daf28eb0c5a147b5382ccc328ed3c4058a4c78b3a0cb4 not found: ID does not exist" containerID="e2eabb53480179f0693daf28eb0c5a147b5382ccc328ed3c4058a4c78b3a0cb4"
Jul 15 16:14:18.470519 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.470493    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2eabb53480179f0693daf28eb0c5a147b5382ccc328ed3c4058a4c78b3a0cb4"} err="failed to get container status \"e2eabb53480179f0693daf28eb0c5a147b5382ccc328ed3c4058a4c78b3a0cb4\": rpc error: code = NotFound desc = could not find container \"e2eabb53480179f0693daf28eb0c5a147b5382ccc328ed3c4058a4c78b3a0cb4\": container with ID starting with e2eabb53480179f0693daf28eb0c5a147b5382ccc328ed3c4058a4c78b3a0cb4 not found: ID does not exist"
Jul 15 16:14:18.470519 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.470510    2583 scope.go:117] "RemoveContainer" containerID="e9028ed266f6f3f9a1ee116b13d9ca3c10f497bbe218165bc69c5534bd7455ab"
Jul 15 16:14:18.470731 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:14:18.470711    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9028ed266f6f3f9a1ee116b13d9ca3c10f497bbe218165bc69c5534bd7455ab\": container with ID starting with e9028ed266f6f3f9a1ee116b13d9ca3c10f497bbe218165bc69c5534bd7455ab not found: ID does not exist" containerID="e9028ed266f6f3f9a1ee116b13d9ca3c10f497bbe218165bc69c5534bd7455ab"
Jul 15 16:14:18.470828 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.470734    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9028ed266f6f3f9a1ee116b13d9ca3c10f497bbe218165bc69c5534bd7455ab"} err="failed to get container status \"e9028ed266f6f3f9a1ee116b13d9ca3c10f497bbe218165bc69c5534bd7455ab\": rpc error: code = NotFound desc = could not find container \"e9028ed266f6f3f9a1ee116b13d9ca3c10f497bbe218165bc69c5534bd7455ab\": container with ID starting with e9028ed266f6f3f9a1ee116b13d9ca3c10f497bbe218165bc69c5534bd7455ab not found: ID does not exist"
Jul 15 16:14:18.474663 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.474642    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"]
Jul 15 16:14:18.481372 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:18.481351    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a84db0-openshift-default-65c66c454f-n65lf"]
Jul 15 16:14:19.585116 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:19.585084    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65353b87-f24f-468e-8346-6d1ae5b7a8c0" path="/var/lib/kubelet/pods/65353b87-f24f-468e-8346-6d1ae5b7a8c0/volumes"
Jul 15 16:14:19.721555 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:19.721526    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:20.896436 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:20.896405    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:21.348263 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.348226    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:14:21.416152 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.416110    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:21.684088 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.684007    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"]
Jul 15 16:14:21.684447 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.684431    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65353b87-f24f-468e-8346-6d1ae5b7a8c0" containerName="istio-proxy"
Jul 15 16:14:21.684505 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.684452    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="65353b87-f24f-468e-8346-6d1ae5b7a8c0" containerName="istio-proxy"
Jul 15 16:14:21.684505 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.684472    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1e1cff-f5c9-4557-b4d6-874462f67c73" containerName="istio-proxy"
Jul 15 16:14:21.684505 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.684477    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1e1cff-f5c9-4557-b4d6-874462f67c73" containerName="istio-proxy"
Jul 15 16:14:21.684505 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.684496    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65353b87-f24f-468e-8346-6d1ae5b7a8c0" containerName="istio-proxy"
Jul 15 16:14:21.684505 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.684501    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="65353b87-f24f-468e-8346-6d1ae5b7a8c0" containerName="istio-proxy"
Jul 15 16:14:21.684685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.684578    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b1e1cff-f5c9-4557-b4d6-874462f67c73" containerName="istio-proxy"
Jul 15 16:14:21.684685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.684588    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="65353b87-f24f-468e-8346-6d1ae5b7a8c0" containerName="istio-proxy"
Jul 15 16:14:21.684685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.684595    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="65353b87-f24f-468e-8346-6d1ae5b7a8c0" containerName="istio-proxy"
Jul 15 16:14:21.689171 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.689152    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.691986 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.691967    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-652d3f-openshift-default-dockercfg-7822k\""
Jul 15 16:14:21.700180 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.700157    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"]
Jul 15 16:14:21.714435 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.714402    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:21.807219 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.807187    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-workload-certs\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.807411 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.807242    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-workload-socket\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.807411 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.807277    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-podinfo\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.807411 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.807332    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1769ac7f-01e0-42f5-bc71-f283252edda8-istiod-ca-cert\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.807411 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.807355    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-envoy\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.807411 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.807369    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-data\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.807411 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.807385    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-credential-socket\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.807411 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.807409    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdg62\" (UniqueName: \"kubernetes.io/projected/1769ac7f-01e0-42f5-bc71-f283252edda8-kube-api-access-vdg62\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.807655 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.807481    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-token\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.810907 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.810882    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:21.908728 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.908686    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-workload-socket\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.908728 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.908731    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-podinfo\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.909237 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.908843    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1769ac7f-01e0-42f5-bc71-f283252edda8-istiod-ca-cert\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.909237 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.908884    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-envoy\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.909237 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.908900    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-data\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.909237 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.908927    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-credential-socket\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.909237 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.908986    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdg62\" (UniqueName: \"kubernetes.io/projected/1769ac7f-01e0-42f5-bc71-f283252edda8-kube-api-access-vdg62\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.909237 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.909017    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-token\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.909237 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.909148    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-workload-socket\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.909571 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.909151    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-workload-certs\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.909571 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.909328    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-data\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.909571 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.909463    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-credential-socket\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.909716 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.909612    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-workload-certs\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.909716 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.909632    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1769ac7f-01e0-42f5-bc71-f283252edda8-istiod-ca-cert\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.911409 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.911380    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-envoy\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.911597 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.911582    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-podinfo\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.926406 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.926386    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdg62\" (UniqueName: \"kubernetes.io/projected/1769ac7f-01e0-42f5-bc71-f283252edda8-kube-api-access-vdg62\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.928212 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.928189    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-token\") pod \"e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") " pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:21.999778 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:21.999746    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:22.142278 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:22.142254    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"]
Jul 15 16:14:22.144236 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:14:22.144209    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1769ac7f_01e0_42f5_bc71_f283252edda8.slice/crio-e3949995fbd2f9b970b2412931f88714d8bad7d06db25dab80c39b586de77aea WatchSource:0}: Error finding container e3949995fbd2f9b970b2412931f88714d8bad7d06db25dab80c39b586de77aea: Status 404 returned error can't find the container with id e3949995fbd2f9b970b2412931f88714d8bad7d06db25dab80c39b586de77aea
Jul 15 16:14:22.146324 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:22.146291    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:14:22.146414 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:22.146358    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:14:22.146414 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:22.146396    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:14:22.475348 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:22.475314    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv" event={"ID":"1769ac7f-01e0-42f5-bc71-f283252edda8","Type":"ContainerStarted","Data":"77b701f068bbe6715e5364c4bb835ae9dfb8c418be1e31761e597e37bc1b3164"}
Jul 15 16:14:22.475529 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:22.475366    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv" event={"ID":"1769ac7f-01e0-42f5-bc71-f283252edda8","Type":"ContainerStarted","Data":"e3949995fbd2f9b970b2412931f88714d8bad7d06db25dab80c39b586de77aea"}
Jul 15 16:14:22.495843 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:22.495797    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv" podStartSLOduration=1.495780064 podStartE2EDuration="1.495780064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:14:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:14:22.494096871 +0000 UTC m=+2339.902870084" watchObservedRunningTime="2026-07-15 16:14:22.495780064 +0000 UTC m=+2339.904553255"
Jul 15 16:14:23.000602 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:23.000566    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:23.005839 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:23.005811    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:23.480433 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:23.480399    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:23.481318 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:23.481293    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:24.419083 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:24.419048    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:24.527173 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:24.527145    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:24.622791 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:24.622754    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:24.723062 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:24.723033    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:25.066314 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:25.066225    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:25.167298 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:25.167260    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:28.897357 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:28.897290    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:29.513048 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:29.513014    2583 generic.go:356] "Generic (PLEG): container finished" podID="0f9e4bf5-e327-4578-a904-6b618fec97a8" containerID="5c4267bc48c8e8151acca3919dd0b44019b2b7cbaf3bbd6b57a1c18e9c25492c" exitCode=0
Jul 15 16:14:29.513285 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:29.513092    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2" event={"ID":"0f9e4bf5-e327-4578-a904-6b618fec97a8","Type":"ContainerDied","Data":"5c4267bc48c8e8151acca3919dd0b44019b2b7cbaf3bbd6b57a1c18e9c25492c"}
Jul 15 16:14:29.513543 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:29.513528    2583 scope.go:117] "RemoveContainer" containerID="5c4267bc48c8e8151acca3919dd0b44019b2b7cbaf3bbd6b57a1c18e9c25492c"
Jul 15 16:14:29.514570 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:29.514542    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:14:29.514624 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:29.514605    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:14:29.514659 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:29.514644    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:14:30.437326 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:30.437279    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:30.519998 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:30.519941    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2" event={"ID":"0f9e4bf5-e327-4578-a904-6b618fec97a8","Type":"ContainerStarted","Data":"ddf6042f474b702a513ff9e111b4df6865be3c24bf46a880328159949f850995"}
Jul 15 16:14:31.114389 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:31.114356    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:31.115175 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:31.115150    2583 patch_prober.go:28] interesting pod/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 15 16:14:31.115309 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:31.115213    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2" podUID="0f9e4bf5-e327-4578-a904-6b618fec97a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 15 16:14:32.114718 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:32.114682    2583 patch_prober.go:28] interesting pod/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 15 16:14:32.115116 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:32.114750    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2" podUID="0f9e4bf5-e327-4578-a904-6b618fec97a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 15 16:14:32.898391 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:32.898350    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:14:33.115345 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:33.115305    2583 patch_prober.go:28] interesting pod/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 15 16:14:33.115798 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:33.115377    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2" podUID="0f9e4bf5-e327-4578-a904-6b618fec97a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 15 16:14:34.115359 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:34.115324    2583 patch_prober.go:28] interesting pod/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 15 16:14:34.115788 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:34.115761    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2" podUID="0f9e4bf5-e327-4578-a904-6b618fec97a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 15 16:14:35.118499 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:35.118467    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:35.118983 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:35.118858    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:35.119602 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:35.119583    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:14:37.638204 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:37.638166    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:37.737669 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:37.737635    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:39.521097 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:39.521043    2583 patch_prober.go:28] interesting pod/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 16:14:39.521589 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:39.521115    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv" podUID="1769ac7f-01e0-42f5-bc71-f283252edda8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 16:14:40.579838 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:40.579808    2583 generic.go:356] "Generic (PLEG): container finished" podID="1769ac7f-01e0-42f5-bc71-f283252edda8" containerID="77b701f068bbe6715e5364c4bb835ae9dfb8c418be1e31761e597e37bc1b3164" exitCode=0
Jul 15 16:14:40.580239 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:40.579881    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv" event={"ID":"1769ac7f-01e0-42f5-bc71-f283252edda8","Type":"ContainerDied","Data":"77b701f068bbe6715e5364c4bb835ae9dfb8c418be1e31761e597e37bc1b3164"}
Jul 15 16:14:40.580330 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:40.580315    2583 scope.go:117] "RemoveContainer" containerID="77b701f068bbe6715e5364c4bb835ae9dfb8c418be1e31761e597e37bc1b3164"
Jul 15 16:14:40.581327 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:40.581296    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:14:40.581433 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:40.581379    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:14:40.581433 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:40.581427    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:14:41.586645 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:41.586613    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv" event={"ID":"1769ac7f-01e0-42f5-bc71-f283252edda8","Type":"ContainerStarted","Data":"27d63314ae267c3d7cfcadbf841088c3ff947fcc20c755e448b4866899feb9e4"}
Jul 15 16:14:42.000681 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:42.000644    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:42.000886 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:42.000865    2583 patch_prober.go:28] interesting pod/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 15 16:14:42.001001 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:42.000913    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv" podUID="1769ac7f-01e0-42f5-bc71-f283252edda8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 15 16:14:43.001170 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:43.001136    2583 patch_prober.go:28] interesting pod/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 15 16:14:43.001569 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:43.001192    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv" podUID="1769ac7f-01e0-42f5-bc71-f283252edda8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 15 16:14:44.000628 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:44.000589    2583 patch_prober.go:28] interesting pod/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 15 16:14:44.000814 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:44.000652    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv" podUID="1769ac7f-01e0-42f5-bc71-f283252edda8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 15 16:14:45.000345 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:45.000312    2583 patch_prober.go:28] interesting pod/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 15 16:14:45.000758 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:45.000367    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv" podUID="1769ac7f-01e0-42f5-bc71-f283252edda8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 15 16:14:46.003488 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:46.003455    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:46.003849 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:46.003804    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:46.004358 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:46.004341    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:14:46.128831 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:46.128780    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:46.230452 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:46.230411    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:49.680417 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:49.680378    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:49.750205 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:49.750171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:51.389205 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:51.389173    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:14:52.137085 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:52.137040    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:58.550487 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:58.550438    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:14:58.624294 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:14:58.624263    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:02.811469 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:02.811437    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"]
Jul 15 16:15:02.811940 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:02.811637    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2" podUID="0f9e4bf5-e327-4578-a904-6b618fec97a8" containerName="istio-proxy" containerID="cri-o://ddf6042f474b702a513ff9e111b4df6865be3c24bf46a880328159949f850995" gracePeriod=30
Jul 15 16:15:02.835221 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:02.835185    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:03.178080 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:03.177942    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:03.701270 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:03.701229    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:03.802658 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:03.802624    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:05.120871 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:05.120832    2583 patch_prober.go:28] interesting pod/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 16:15:05.121293 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:05.120900    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2" podUID="0f9e4bf5-e327-4578-a904-6b618fec97a8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:15:08.070867 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.070815    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:15:08.099234 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.099207    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-token\") pod \"0f9e4bf5-e327-4578-a904-6b618fec97a8\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") "
Jul 15 16:15:08.099384 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.099262    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-podinfo\") pod \"0f9e4bf5-e327-4578-a904-6b618fec97a8\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") "
Jul 15 16:15:08.099384 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.099291    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-credential-socket\") pod \"0f9e4bf5-e327-4578-a904-6b618fec97a8\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") "
Jul 15 16:15:08.099384 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.099328    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-workload-certs\") pod \"0f9e4bf5-e327-4578-a904-6b618fec97a8\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") "
Jul 15 16:15:08.099532 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.099414    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-workload-socket\") pod \"0f9e4bf5-e327-4578-a904-6b618fec97a8\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") "
Jul 15 16:15:08.099532 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.099439    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f9e4bf5-e327-4578-a904-6b618fec97a8-istiod-ca-cert\") pod \"0f9e4bf5-e327-4578-a904-6b618fec97a8\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") "
Jul 15 16:15:08.099532 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.099466    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-data\") pod \"0f9e4bf5-e327-4578-a904-6b618fec97a8\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") "
Jul 15 16:15:08.099532 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.099501    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-envoy\") pod \"0f9e4bf5-e327-4578-a904-6b618fec97a8\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") "
Jul 15 16:15:08.099532 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.099522    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdk9h\" (UniqueName: \"kubernetes.io/projected/0f9e4bf5-e327-4578-a904-6b618fec97a8-kube-api-access-sdk9h\") pod \"0f9e4bf5-e327-4578-a904-6b618fec97a8\" (UID: \"0f9e4bf5-e327-4578-a904-6b618fec97a8\") "
Jul 15 16:15:08.099757 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.099626    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0f9e4bf5-e327-4578-a904-6b618fec97a8" (UID: "0f9e4bf5-e327-4578-a904-6b618fec97a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:15:08.099844 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.099812    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0f9e4bf5-e327-4578-a904-6b618fec97a8" (UID: "0f9e4bf5-e327-4578-a904-6b618fec97a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:15:08.099912 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.099842    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0f9e4bf5-e327-4578-a904-6b618fec97a8" (UID: "0f9e4bf5-e327-4578-a904-6b618fec97a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:15:08.099912 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.099902    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-credential-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:08.100034 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.099923    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-workload-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:08.100157 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.100121    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f9e4bf5-e327-4578-a904-6b618fec97a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0f9e4bf5-e327-4578-a904-6b618fec97a8" (UID: "0f9e4bf5-e327-4578-a904-6b618fec97a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:15:08.100742 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.100715    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "0f9e4bf5-e327-4578-a904-6b618fec97a8" (UID: "0f9e4bf5-e327-4578-a904-6b618fec97a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:15:08.101997 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.101934    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0f9e4bf5-e327-4578-a904-6b618fec97a8" (UID: "0f9e4bf5-e327-4578-a904-6b618fec97a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:15:08.102227 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.102203    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f9e4bf5-e327-4578-a904-6b618fec97a8-kube-api-access-sdk9h" (OuterVolumeSpecName: "kube-api-access-sdk9h") pod "0f9e4bf5-e327-4578-a904-6b618fec97a8" (UID: "0f9e4bf5-e327-4578-a904-6b618fec97a8"). InnerVolumeSpecName "kube-api-access-sdk9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:15:08.102400 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.102366    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0f9e4bf5-e327-4578-a904-6b618fec97a8" (UID: "0f9e4bf5-e327-4578-a904-6b618fec97a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:15:08.102476 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.102463    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "0f9e4bf5-e327-4578-a904-6b618fec97a8" (UID: "0f9e4bf5-e327-4578-a904-6b618fec97a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:15:08.201331 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.201301    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-podinfo\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:08.201331 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.201325    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-workload-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:08.201331 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.201335    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f9e4bf5-e327-4578-a904-6b618fec97a8-istiod-ca-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:08.201544 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.201345    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-data\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:08.201544 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.201357    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-envoy\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:08.201544 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.201368    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdk9h\" (UniqueName: \"kubernetes.io/projected/0f9e4bf5-e327-4578-a904-6b618fec97a8-kube-api-access-sdk9h\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:08.201544 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.201380    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f9e4bf5-e327-4578-a904-6b618fec97a8-istio-token\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:08.717696 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.717666    2583 generic.go:356] "Generic (PLEG): container finished" podID="0f9e4bf5-e327-4578-a904-6b618fec97a8" containerID="ddf6042f474b702a513ff9e111b4df6865be3c24bf46a880328159949f850995" exitCode=0
Jul 15 16:15:08.717877 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.717714    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"
Jul 15 16:15:08.717877 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.717742    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2" event={"ID":"0f9e4bf5-e327-4578-a904-6b618fec97a8","Type":"ContainerDied","Data":"ddf6042f474b702a513ff9e111b4df6865be3c24bf46a880328159949f850995"}
Jul 15 16:15:08.717877 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.717784    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2" event={"ID":"0f9e4bf5-e327-4578-a904-6b618fec97a8","Type":"ContainerDied","Data":"cb9b085c154f3b39e29b6e805c207572ea2f56b8acd770b0a86984de82c44145"}
Jul 15 16:15:08.717877 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.717806    2583 scope.go:117] "RemoveContainer" containerID="ddf6042f474b702a513ff9e111b4df6865be3c24bf46a880328159949f850995"
Jul 15 16:15:08.726842 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.726824    2583 scope.go:117] "RemoveContainer" containerID="5c4267bc48c8e8151acca3919dd0b44019b2b7cbaf3bbd6b57a1c18e9c25492c"
Jul 15 16:15:08.734421 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.734405    2583 scope.go:117] "RemoveContainer" containerID="ddf6042f474b702a513ff9e111b4df6865be3c24bf46a880328159949f850995"
Jul 15 16:15:08.734670 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:15:08.734651    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddf6042f474b702a513ff9e111b4df6865be3c24bf46a880328159949f850995\": container with ID starting with ddf6042f474b702a513ff9e111b4df6865be3c24bf46a880328159949f850995 not found: ID does not exist" containerID="ddf6042f474b702a513ff9e111b4df6865be3c24bf46a880328159949f850995"
Jul 15 16:15:08.734724 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.734677    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddf6042f474b702a513ff9e111b4df6865be3c24bf46a880328159949f850995"} err="failed to get container status \"ddf6042f474b702a513ff9e111b4df6865be3c24bf46a880328159949f850995\": rpc error: code = NotFound desc = could not find container \"ddf6042f474b702a513ff9e111b4df6865be3c24bf46a880328159949f850995\": container with ID starting with ddf6042f474b702a513ff9e111b4df6865be3c24bf46a880328159949f850995 not found: ID does not exist"
Jul 15 16:15:08.734724 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.734695    2583 scope.go:117] "RemoveContainer" containerID="5c4267bc48c8e8151acca3919dd0b44019b2b7cbaf3bbd6b57a1c18e9c25492c"
Jul 15 16:15:08.734937 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:15:08.734919    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c4267bc48c8e8151acca3919dd0b44019b2b7cbaf3bbd6b57a1c18e9c25492c\": container with ID starting with 5c4267bc48c8e8151acca3919dd0b44019b2b7cbaf3bbd6b57a1c18e9c25492c not found: ID does not exist" containerID="5c4267bc48c8e8151acca3919dd0b44019b2b7cbaf3bbd6b57a1c18e9c25492c"
Jul 15 16:15:08.735008 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.734941    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c4267bc48c8e8151acca3919dd0b44019b2b7cbaf3bbd6b57a1c18e9c25492c"} err="failed to get container status \"5c4267bc48c8e8151acca3919dd0b44019b2b7cbaf3bbd6b57a1c18e9c25492c\": rpc error: code = NotFound desc = could not find container \"5c4267bc48c8e8151acca3919dd0b44019b2b7cbaf3bbd6b57a1c18e9c25492c\": container with ID starting with 5c4267bc48c8e8151acca3919dd0b44019b2b7cbaf3bbd6b57a1c18e9c25492c not found: ID does not exist"
Jul 15 16:15:08.741962 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.741924    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"]
Jul 15 16:15:08.745640 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:08.745621    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b896e0-openshift-default-7bfbbb56d7-p98j2"]
Jul 15 16:15:09.586413 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:09.586379    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f9e4bf5-e327-4578-a904-6b618fec97a8" path="/var/lib/kubelet/pods/0f9e4bf5-e327-4578-a904-6b618fec97a8/volumes"
Jul 15 16:15:13.743490 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:13.743458    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:16.591134 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:16.591095    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:15:18.328220 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:18.328184    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:18.434195 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:18.434160    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:18.497048 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:18.497014    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:23.214456 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:23.214430    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 16:15:23.217012 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:23.216993    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 16:15:24.657383 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:24.657337    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:24.735456 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:24.735425    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:29.067398 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:29.067365    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"]
Jul 15 16:15:29.067798 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:29.067581    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv" podUID="1769ac7f-01e0-42f5-bc71-f283252edda8" containerName="istio-proxy" containerID="cri-o://27d63314ae267c3d7cfcadbf841088c3ff947fcc20c755e448b4866899feb9e4" gracePeriod=30
Jul 15 16:15:29.089304 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:29.089273    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:29.320797 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:29.320693    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:29.654569 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:29.654485    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:30.069058 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.069026    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"]
Jul 15 16:15:30.069485 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.069471    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f9e4bf5-e327-4578-a904-6b618fec97a8" containerName="istio-proxy"
Jul 15 16:15:30.069572 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.069487    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f9e4bf5-e327-4578-a904-6b618fec97a8" containerName="istio-proxy"
Jul 15 16:15:30.069572 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.069496    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f9e4bf5-e327-4578-a904-6b618fec97a8" containerName="istio-proxy"
Jul 15 16:15:30.069572 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.069502    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f9e4bf5-e327-4578-a904-6b618fec97a8" containerName="istio-proxy"
Jul 15 16:15:30.069572 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.069563    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f9e4bf5-e327-4578-a904-6b618fec97a8" containerName="istio-proxy"
Jul 15 16:15:30.069572 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.069572    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f9e4bf5-e327-4578-a904-6b618fec97a8" containerName="istio-proxy"
Jul 15 16:15:30.072113 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.072095    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.079050 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.078665    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-95128b-openshift-default-dockercfg-4wtvs\""
Jul 15 16:15:30.107439 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.107391    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"]
Jul 15 16:15:30.120014 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.119988    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:30.205284 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.205244    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-workload-socket\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.205468 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.205288    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-istio-envoy\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.205468 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.205383    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-credential-socket\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.205468 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.205439    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-istio-data\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.205594 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.205469    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66fd4342-5517-4fec-bda6-50e210daea4c-istiod-ca-cert\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.205594 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.205502    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66fd4342-5517-4fec-bda6-50e210daea4c-istio-podinfo\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.205594 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.205535    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8x9g\" (UniqueName: \"kubernetes.io/projected/66fd4342-5517-4fec-bda6-50e210daea4c-kube-api-access-s8x9g\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.205594 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.205559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66fd4342-5517-4fec-bda6-50e210daea4c-istio-token\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.205594 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.205587    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-workload-certs\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.307109 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.307071    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-istio-envoy\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.307320 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.307142    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-credential-socket\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.307320 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.307197    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-istio-data\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.307320 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.307227    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66fd4342-5517-4fec-bda6-50e210daea4c-istiod-ca-cert\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.307320 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.307266    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66fd4342-5517-4fec-bda6-50e210daea4c-istio-podinfo\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.307320 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.307296    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8x9g\" (UniqueName: \"kubernetes.io/projected/66fd4342-5517-4fec-bda6-50e210daea4c-kube-api-access-s8x9g\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.307581 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.307433    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66fd4342-5517-4fec-bda6-50e210daea4c-istio-token\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.307581 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.307495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-workload-certs\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.307581 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.307554    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-workload-socket\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.307732 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.307616    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-credential-socket\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.307732 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.307645    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-istio-data\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.307867 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.307850    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-workload-socket\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.307928 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.307893    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-workload-certs\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.308283 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.308263    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66fd4342-5517-4fec-bda6-50e210daea4c-istiod-ca-cert\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.309405 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.309387    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-istio-envoy\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.309641 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.309623    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66fd4342-5517-4fec-bda6-50e210daea4c-istio-podinfo\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.315459 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.315440    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66fd4342-5517-4fec-bda6-50e210daea4c-istio-token\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.316126 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.316111    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8x9g\" (UniqueName: \"kubernetes.io/projected/66fd4342-5517-4fec-bda6-50e210daea4c-kube-api-access-s8x9g\") pod \"e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") " pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.382979 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.382900    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:30.518767 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.518743    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"]
Jul 15 16:15:30.521278 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:15:30.521245    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66fd4342_5517_4fec_bda6_50e210daea4c.slice/crio-71c0c16411fbe10659883e47ed831f0d99df7e8621e193159205f81097de6aef WatchSource:0}: Error finding container 71c0c16411fbe10659883e47ed831f0d99df7e8621e193159205f81097de6aef: Status 404 returned error can't find the container with id 71c0c16411fbe10659883e47ed831f0d99df7e8621e193159205f81097de6aef
Jul 15 16:15:30.523507 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.523473    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:15:30.523582 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.523540    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:15:30.523582 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.523566    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:15:30.717926 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.717891    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:30.825839 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.825806    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s" event={"ID":"66fd4342-5517-4fec-bda6-50e210daea4c","Type":"ContainerStarted","Data":"af76b2eeb252b4c1e8fc9c8c298749a13fd7cc48057e57b18b395a2807b75269"}
Jul 15 16:15:30.826050 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.825857    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s" event={"ID":"66fd4342-5517-4fec-bda6-50e210daea4c","Type":"ContainerStarted","Data":"71c0c16411fbe10659883e47ed831f0d99df7e8621e193159205f81097de6aef"}
Jul 15 16:15:30.860033 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:30.859978    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s" podStartSLOduration=0.85992788 podStartE2EDuration="859.92788ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:15:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:15:30.858047459 +0000 UTC m=+2408.266820650" watchObservedRunningTime="2026-07-15 16:15:30.85992788 +0000 UTC m=+2408.268701070"
Jul 15 16:15:31.006195 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:31.006098    2583 patch_prober.go:28] interesting pod/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 15 16:15:31.006195 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:31.006154    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv" podUID="1769ac7f-01e0-42f5-bc71-f283252edda8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:15:31.383870 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:31.383790    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:31.387934 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:31.387911    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:31.830407 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:31.830365    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:31.831418 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:31.831396    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:32.829090 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:32.829049    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:32.931031 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:32.930992    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:33.021907 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:33.021874    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:33.122512 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:33.122422    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:33.574545 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:33.574505    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:33.643149 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:33.643105    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:34.312019 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.311996    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:15:34.450090 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.450067    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-token\") pod \"1769ac7f-01e0-42f5-bc71-f283252edda8\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") "
Jul 15 16:15:34.450240 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.450100    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdg62\" (UniqueName: \"kubernetes.io/projected/1769ac7f-01e0-42f5-bc71-f283252edda8-kube-api-access-vdg62\") pod \"1769ac7f-01e0-42f5-bc71-f283252edda8\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") "
Jul 15 16:15:34.450240 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.450137    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-podinfo\") pod \"1769ac7f-01e0-42f5-bc71-f283252edda8\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") "
Jul 15 16:15:34.450240 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.450181    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-envoy\") pod \"1769ac7f-01e0-42f5-bc71-f283252edda8\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") "
Jul 15 16:15:34.450384 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.450267    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-workload-socket\") pod \"1769ac7f-01e0-42f5-bc71-f283252edda8\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") "
Jul 15 16:15:34.450384 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.450301    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-credential-socket\") pod \"1769ac7f-01e0-42f5-bc71-f283252edda8\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") "
Jul 15 16:15:34.450384 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.450343    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-data\") pod \"1769ac7f-01e0-42f5-bc71-f283252edda8\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") "
Jul 15 16:15:34.450520 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.450432    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-workload-certs\") pod \"1769ac7f-01e0-42f5-bc71-f283252edda8\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") "
Jul 15 16:15:34.450520 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.450458    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1769ac7f-01e0-42f5-bc71-f283252edda8-istiod-ca-cert\") pod \"1769ac7f-01e0-42f5-bc71-f283252edda8\" (UID: \"1769ac7f-01e0-42f5-bc71-f283252edda8\") "
Jul 15 16:15:34.450718 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.450691    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1769ac7f-01e0-42f5-bc71-f283252edda8" (UID: "1769ac7f-01e0-42f5-bc71-f283252edda8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:15:34.450884 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.450865    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-credential-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:34.451126 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.451104    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1769ac7f-01e0-42f5-bc71-f283252edda8" (UID: "1769ac7f-01e0-42f5-bc71-f283252edda8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:15:34.451126 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.451114    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1769ac7f-01e0-42f5-bc71-f283252edda8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1769ac7f-01e0-42f5-bc71-f283252edda8" (UID: "1769ac7f-01e0-42f5-bc71-f283252edda8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:15:34.451260 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.451201    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1769ac7f-01e0-42f5-bc71-f283252edda8" (UID: "1769ac7f-01e0-42f5-bc71-f283252edda8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:15:34.451418 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.451391    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-data" (OuterVolumeSpecName: "istio-data") pod "1769ac7f-01e0-42f5-bc71-f283252edda8" (UID: "1769ac7f-01e0-42f5-bc71-f283252edda8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:15:34.452300 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.452275    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-token" (OuterVolumeSpecName: "istio-token") pod "1769ac7f-01e0-42f5-bc71-f283252edda8" (UID: "1769ac7f-01e0-42f5-bc71-f283252edda8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:15:34.452427 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.452413    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1769ac7f-01e0-42f5-bc71-f283252edda8-kube-api-access-vdg62" (OuterVolumeSpecName: "kube-api-access-vdg62") pod "1769ac7f-01e0-42f5-bc71-f283252edda8" (UID: "1769ac7f-01e0-42f5-bc71-f283252edda8"). InnerVolumeSpecName "kube-api-access-vdg62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:15:34.452473 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.452452    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1769ac7f-01e0-42f5-bc71-f283252edda8" (UID: "1769ac7f-01e0-42f5-bc71-f283252edda8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:15:34.452514 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.452468    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1769ac7f-01e0-42f5-bc71-f283252edda8" (UID: "1769ac7f-01e0-42f5-bc71-f283252edda8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:15:34.551493 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.551456    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-workload-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:34.551493 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.551487    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-data\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:34.551493 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.551501    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-workload-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:34.551708 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.551515    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1769ac7f-01e0-42f5-bc71-f283252edda8-istiod-ca-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:34.551708 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.551527    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-token\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:34.551708 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.551538    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdg62\" (UniqueName: \"kubernetes.io/projected/1769ac7f-01e0-42f5-bc71-f283252edda8-kube-api-access-vdg62\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:34.551708 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.551552    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-podinfo\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:34.551708 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.551562    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1769ac7f-01e0-42f5-bc71-f283252edda8-istio-envoy\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:15:34.845697 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.845615    2583 generic.go:356] "Generic (PLEG): container finished" podID="1769ac7f-01e0-42f5-bc71-f283252edda8" containerID="27d63314ae267c3d7cfcadbf841088c3ff947fcc20c755e448b4866899feb9e4" exitCode=0
Jul 15 16:15:34.845697 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.845660    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"
Jul 15 16:15:34.845882 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.845705    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv" event={"ID":"1769ac7f-01e0-42f5-bc71-f283252edda8","Type":"ContainerDied","Data":"27d63314ae267c3d7cfcadbf841088c3ff947fcc20c755e448b4866899feb9e4"}
Jul 15 16:15:34.845882 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.845775    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv" event={"ID":"1769ac7f-01e0-42f5-bc71-f283252edda8","Type":"ContainerDied","Data":"e3949995fbd2f9b970b2412931f88714d8bad7d06db25dab80c39b586de77aea"}
Jul 15 16:15:34.845882 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.845807    2583 scope.go:117] "RemoveContainer" containerID="27d63314ae267c3d7cfcadbf841088c3ff947fcc20c755e448b4866899feb9e4"
Jul 15 16:15:34.855415 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.855386    2583 scope.go:117] "RemoveContainer" containerID="77b701f068bbe6715e5364c4bb835ae9dfb8c418be1e31761e597e37bc1b3164"
Jul 15 16:15:34.864563 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.864484    2583 scope.go:117] "RemoveContainer" containerID="27d63314ae267c3d7cfcadbf841088c3ff947fcc20c755e448b4866899feb9e4"
Jul 15 16:15:34.864978 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:15:34.864847    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27d63314ae267c3d7cfcadbf841088c3ff947fcc20c755e448b4866899feb9e4\": container with ID starting with 27d63314ae267c3d7cfcadbf841088c3ff947fcc20c755e448b4866899feb9e4 not found: ID does not exist" containerID="27d63314ae267c3d7cfcadbf841088c3ff947fcc20c755e448b4866899feb9e4"
Jul 15 16:15:34.864978 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.864879    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27d63314ae267c3d7cfcadbf841088c3ff947fcc20c755e448b4866899feb9e4"} err="failed to get container status \"27d63314ae267c3d7cfcadbf841088c3ff947fcc20c755e448b4866899feb9e4\": rpc error: code = NotFound desc = could not find container \"27d63314ae267c3d7cfcadbf841088c3ff947fcc20c755e448b4866899feb9e4\": container with ID starting with 27d63314ae267c3d7cfcadbf841088c3ff947fcc20c755e448b4866899feb9e4 not found: ID does not exist"
Jul 15 16:15:34.864978 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.864903    2583 scope.go:117] "RemoveContainer" containerID="77b701f068bbe6715e5364c4bb835ae9dfb8c418be1e31761e597e37bc1b3164"
Jul 15 16:15:34.865335 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:15:34.865279    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77b701f068bbe6715e5364c4bb835ae9dfb8c418be1e31761e597e37bc1b3164\": container with ID starting with 77b701f068bbe6715e5364c4bb835ae9dfb8c418be1e31761e597e37bc1b3164 not found: ID does not exist" containerID="77b701f068bbe6715e5364c4bb835ae9dfb8c418be1e31761e597e37bc1b3164"
Jul 15 16:15:34.865335 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.865307    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77b701f068bbe6715e5364c4bb835ae9dfb8c418be1e31761e597e37bc1b3164"} err="failed to get container status \"77b701f068bbe6715e5364c4bb835ae9dfb8c418be1e31761e597e37bc1b3164\": rpc error: code = NotFound desc = could not find container \"77b701f068bbe6715e5364c4bb835ae9dfb8c418be1e31761e597e37bc1b3164\": container with ID starting with 77b701f068bbe6715e5364c4bb835ae9dfb8c418be1e31761e597e37bc1b3164 not found: ID does not exist"
Jul 15 16:15:34.874514 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.874493    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"]
Jul 15 16:15:34.880857 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:34.880836    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-652d3f-openshift-default-6dcf597ccc-qm7rv"]
Jul 15 16:15:35.585891 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:35.585853    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1769ac7f-01e0-42f5-bc71-f283252edda8" path="/var/lib/kubelet/pods/1769ac7f-01e0-42f5-bc71-f283252edda8/volumes"
Jul 15 16:15:37.011075 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:37.011044    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:15:37.359548 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:37.359460    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:37.716827 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:37.716789    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:38.010282 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.010206    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"]
Jul 15 16:15:38.010626 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.010615    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1769ac7f-01e0-42f5-bc71-f283252edda8" containerName="istio-proxy"
Jul 15 16:15:38.010683 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.010627    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1769ac7f-01e0-42f5-bc71-f283252edda8" containerName="istio-proxy"
Jul 15 16:15:38.010721 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.010693    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1769ac7f-01e0-42f5-bc71-f283252edda8" containerName="istio-proxy"
Jul 15 16:15:38.015451 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.015432    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.018250 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.018228    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-8eb165-openshift-default-dockercfg-z6tnt\""
Jul 15 16:15:38.036931 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.036896    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"]
Jul 15 16:15:38.045065 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.045034    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:38.185176 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.185129    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-workload-socket\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.185364 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.185241    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-token\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.185364 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.185303    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-envoy\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.185364 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.185330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-data\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.185364 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.185361    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqlpg\" (UniqueName: \"kubernetes.io/projected/80f965d0-9487-4d30-8e3a-4d97339e6269-kube-api-access-vqlpg\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.185554 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.185401    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80f965d0-9487-4d30-8e3a-4d97339e6269-istiod-ca-cert\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.185554 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.185420    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-workload-certs\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.185554 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.185516    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-credential-socket\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.185691 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.185579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-podinfo\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.287052 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.286926    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80f965d0-9487-4d30-8e3a-4d97339e6269-istiod-ca-cert\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.287052 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.286993    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-workload-certs\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.287052 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.287035    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-credential-socket\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.287344 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.287073    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-podinfo\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.287344 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.287101    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-workload-socket\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.287344 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.287178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-token\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.287344 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.287229    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-envoy\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.287344 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.287261    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-data\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.287344 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.287292    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqlpg\" (UniqueName: \"kubernetes.io/projected/80f965d0-9487-4d30-8e3a-4d97339e6269-kube-api-access-vqlpg\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.287610 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.287402    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-workload-certs\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.287610 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.287448    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-credential-socket\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.287610 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.287571    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-workload-socket\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.287738 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.287682    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-data\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.287775 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.287741    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80f965d0-9487-4d30-8e3a-4d97339e6269-istiod-ca-cert\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.289545 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.289523    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-envoy\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.289705 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.289685    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-podinfo\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.297476 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.297451    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-token\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.297588 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.297543    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqlpg\" (UniqueName: \"kubernetes.io/projected/80f965d0-9487-4d30-8e3a-4d97339e6269-kube-api-access-vqlpg\") pod \"e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") " pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.323250 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.323220    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:38.325155 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.325135    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:38.515517 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.515491    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"]
Jul 15 16:15:38.516773 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:15:38.516746    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f965d0_9487_4d30_8e3a_4d97339e6269.slice/crio-6c94a4ff003edb46de86fef41e7c81e0f3bd1744498e02740d25cc6fdb38542c WatchSource:0}: Error finding container 6c94a4ff003edb46de86fef41e7c81e0f3bd1744498e02740d25cc6fdb38542c: Status 404 returned error can't find the container with id 6c94a4ff003edb46de86fef41e7c81e0f3bd1744498e02740d25cc6fdb38542c
Jul 15 16:15:38.519238 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.519203    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:15:38.519337 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.519283    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:15:38.519337 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.519325    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:15:38.721242 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.721204    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:38.867201 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.867099    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r" event={"ID":"80f965d0-9487-4d30-8e3a-4d97339e6269","Type":"ContainerStarted","Data":"71fcc1760215ba795bdfa6b14c39eb3bbe5663213e4b7a491ef2d4ad128a213f"}
Jul 15 16:15:38.867201 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.867152    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r" event={"ID":"80f965d0-9487-4d30-8e3a-4d97339e6269","Type":"ContainerStarted","Data":"6c94a4ff003edb46de86fef41e7c81e0f3bd1744498e02740d25cc6fdb38542c"}
Jul 15 16:15:38.891210 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:38.891152    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r" podStartSLOduration=1.8911317520000002 podStartE2EDuration="1.891131752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:15:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:15:38.890088898 +0000 UTC m=+2416.298862122" watchObservedRunningTime="2026-07-15 16:15:38.891131752 +0000 UTC m=+2416.299904943"
Jul 15 16:15:39.326189 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:39.326157    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:39.335361 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:39.335329    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:39.871907 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:39.871883    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:39.872917 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:39.872900    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:40.981860 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:40.981827    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:41.095742 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:41.095707    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:41.188063 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:41.188033    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:41.290461 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:41.290375    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:41.734958 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:41.734900    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:41.885130 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:41.885078    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:44.897980 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:44.897934    2583 generic.go:356] "Generic (PLEG): container finished" podID="66fd4342-5517-4fec-bda6-50e210daea4c" containerID="af76b2eeb252b4c1e8fc9c8c298749a13fd7cc48057e57b18b395a2807b75269" exitCode=0
Jul 15 16:15:44.897980 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:44.897972    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s" event={"ID":"66fd4342-5517-4fec-bda6-50e210daea4c","Type":"ContainerDied","Data":"af76b2eeb252b4c1e8fc9c8c298749a13fd7cc48057e57b18b395a2807b75269"}
Jul 15 16:15:44.898389 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:44.898357    2583 scope.go:117] "RemoveContainer" containerID="af76b2eeb252b4c1e8fc9c8c298749a13fd7cc48057e57b18b395a2807b75269"
Jul 15 16:15:44.899325 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:44.899294    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:15:44.899429 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:44.899377    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:15:44.899498 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:44.899426    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:15:45.543178 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:45.543143    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:45.904200 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:45.904112    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s" event={"ID":"66fd4342-5517-4fec-bda6-50e210daea4c","Type":"ContainerStarted","Data":"56bbea8658b0aa8009267dfde408f6872fd424acf84142075156ee0924bf07cd"}
Jul 15 16:15:46.383327 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:46.383299    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:46.384031 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:46.384007    2583 patch_prober.go:28] interesting pod/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 15 16:15:46.384158 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:46.384081    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s" podUID="66fd4342-5517-4fec-bda6-50e210daea4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 15 16:15:46.830507 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:46.830457    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:47.383930 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:47.383894    2583 patch_prober.go:28] interesting pod/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 15 16:15:47.384419 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:47.383984    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s" podUID="66fd4342-5517-4fec-bda6-50e210daea4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 15 16:15:47.894475 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:47.894439    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:15:48.383800 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:48.383769    2583 patch_prober.go:28] interesting pod/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 15 16:15:48.383992 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:48.383839    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s" podUID="66fd4342-5517-4fec-bda6-50e210daea4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 15 16:15:49.383544 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:49.383502    2583 patch_prober.go:28] interesting pod/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 15 16:15:49.383763 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:49.383573    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s" podUID="66fd4342-5517-4fec-bda6-50e210daea4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 15 16:15:50.387435 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:50.387406    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:50.388321 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:50.388302    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:15:54.431010 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:54.430973    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:54.531324 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:54.531288    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:55.787815 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:55.787394    2583 patch_prober.go:28] interesting pod/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:45902->10.133.0.46:15021: read: connection reset by peer" start-of-body=
Jul 15 16:15:55.787815 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:55.787472    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r" podUID="80f965d0-9487-4d30-8e3a-4d97339e6269" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:45902->10.133.0.46:15021: read: connection reset by peer"
Jul 15 16:15:55.955927 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:55.955866    2583 generic.go:356] "Generic (PLEG): container finished" podID="80f965d0-9487-4d30-8e3a-4d97339e6269" containerID="71fcc1760215ba795bdfa6b14c39eb3bbe5663213e4b7a491ef2d4ad128a213f" exitCode=0
Jul 15 16:15:55.956057 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:55.955955    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r" event={"ID":"80f965d0-9487-4d30-8e3a-4d97339e6269","Type":"ContainerDied","Data":"71fcc1760215ba795bdfa6b14c39eb3bbe5663213e4b7a491ef2d4ad128a213f"}
Jul 15 16:15:55.956355 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:55.956342    2583 scope.go:117] "RemoveContainer" containerID="71fcc1760215ba795bdfa6b14c39eb3bbe5663213e4b7a491ef2d4ad128a213f"
Jul 15 16:15:55.957475 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:55.957442    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:15:55.957539 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:55.957514    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:15:55.957579 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:55.957548    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:15:56.963125 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:56.963093    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r" event={"ID":"80f965d0-9487-4d30-8e3a-4d97339e6269","Type":"ContainerStarted","Data":"870dbe40bc252476a46b34dc7ae24041d355f9a79108482f6b54ebd9346ad77b"}
Jul 15 16:15:57.326374 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.326267    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:15:57.326549 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.326479    2583 patch_prober.go:28] interesting pod/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 15 16:15:57.326549 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.326531    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r" podUID="80f965d0-9487-4d30-8e3a-4d97339e6269" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 15 16:15:57.721218 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.721179    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"]
Jul 15 16:15:57.721632 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.721618    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1769ac7f-01e0-42f5-bc71-f283252edda8" containerName="istio-proxy"
Jul 15 16:15:57.721682 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.721634    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1769ac7f-01e0-42f5-bc71-f283252edda8" containerName="istio-proxy"
Jul 15 16:15:57.721718 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.721696    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1769ac7f-01e0-42f5-bc71-f283252edda8" containerName="istio-proxy"
Jul 15 16:15:57.723790 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.723774    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.727157 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.727138    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-95128b\"/\"default-dockercfg-9wr6w\""
Jul 15 16:15:57.727157 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.727143    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-95128b\"/\"kube-root-ca.crt\""
Jul 15 16:15:57.728158 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.728138    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-95128b\"/\"auth-test-model-95128b-kserve-self-signed-certs\""
Jul 15 16:15:57.728224 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.728161    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-95128b\"/\"openshift-service-ca.crt\""
Jul 15 16:15:57.752967 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.749175    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"]
Jul 15 16:15:57.759763 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.759392    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:15:57.795355 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.795324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-tmp-dir\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.795534 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.795375    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-home\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.795534 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.795457    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c24rz\" (UniqueName: \"kubernetes.io/projected/e249417e-aac1-4d42-9682-a48a57185daa-kube-api-access-c24rz\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.795534 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.795499    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e249417e-aac1-4d42-9682-a48a57185daa-tls-certs\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.795638 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.795534    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-dshm\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.795638 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.795578    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-model-cache\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.897087 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.897045    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c24rz\" (UniqueName: \"kubernetes.io/projected/e249417e-aac1-4d42-9682-a48a57185daa-kube-api-access-c24rz\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.897087 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.897094    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e249417e-aac1-4d42-9682-a48a57185daa-tls-certs\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.897347 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.897156    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-dshm\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.897347 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.897173    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-model-cache\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.897347 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.897208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-tmp-dir\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.897347 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.897262    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-home\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.897681 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.897657    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-model-cache\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.897766 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.897694    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-home\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.897766 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.897716    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-tmp-dir\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.899510 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.899484    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-dshm\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.899735 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.899717    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e249417e-aac1-4d42-9682-a48a57185daa-tls-certs\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:57.905756 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:57.905733    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c24rz\" (UniqueName: \"kubernetes.io/projected/e249417e-aac1-4d42-9682-a48a57185daa-kube-api-access-c24rz\") pod \"auth-test-model-95128b-kserve-67695d7ff-j7mn2\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") " pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:58.055021 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:58.054925    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:15:58.208353 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:58.208328    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"]
Jul 15 16:15:58.210457 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:15:58.210430    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode249417e_aac1_4d42_9682_a48a57185daa.slice/crio-0bb4449204ae6fef903443b9d6062dbc28fc103e789def2c842c9db7c02b8733 WatchSource:0}: Error finding container 0bb4449204ae6fef903443b9d6062dbc28fc103e789def2c842c9db7c02b8733: Status 404 returned error can't find the container with id 0bb4449204ae6fef903443b9d6062dbc28fc103e789def2c842c9db7c02b8733
Jul 15 16:15:58.325622 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:58.325549    2583 patch_prober.go:28] interesting pod/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 15 16:15:58.325622 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:58.325599    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r" podUID="80f965d0-9487-4d30-8e3a-4d97339e6269" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 15 16:15:58.975094 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:58.975060    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2" event={"ID":"e249417e-aac1-4d42-9682-a48a57185daa","Type":"ContainerStarted","Data":"25468085f94386b4ea12a9440d342d937c9006129e45360770499afc763e002e"}
Jul 15 16:15:58.975094 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:58.975103    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2" event={"ID":"e249417e-aac1-4d42-9682-a48a57185daa","Type":"ContainerStarted","Data":"0bb4449204ae6fef903443b9d6062dbc28fc103e789def2c842c9db7c02b8733"}
Jul 15 16:15:58.999601 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:58.999528    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2" podStartSLOduration=1.999511804 podStartE2EDuration="1.999511804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:15:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:15:58.996847274 +0000 UTC m=+2436.405620463" watchObservedRunningTime="2026-07-15 16:15:58.999511804 +0000 UTC m=+2436.408284992"
Jul 15 16:15:59.325757 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:59.325679    2583 patch_prober.go:28] interesting pod/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 15 16:15:59.325757 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:15:59.325736    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r" podUID="80f965d0-9487-4d30-8e3a-4d97339e6269" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 15 16:16:00.326366 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:00.326331    2583 patch_prober.go:28] interesting pod/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 15 16:16:00.326714 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:00.326382    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r" podUID="80f965d0-9487-4d30-8e3a-4d97339e6269" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 15 16:16:00.892554 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:00.892516    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:16:01.329024 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:01.328998    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:16:01.329427 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:01.329376    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:16:01.330040 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:01.330020    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:16:02.788857 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:02.788823    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:02.889538 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:02.889508    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:08.055885 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:08.055854    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:16:08.056282 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:08.055923    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:16:08.067897 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:08.067872    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:16:09.034578 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:09.034546    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:16:20.593555 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.593517    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"]
Jul 15 16:16:20.598508 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.598484    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.601998 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.601971    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8eb165\"/\"default-dockercfg-7fx45\""
Jul 15 16:16:20.601998 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.601991    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8eb165\"/\"kube-root-ca.crt\""
Jul 15 16:16:20.602187 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.601991    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8eb165\"/\"openshift-service-ca.crt\""
Jul 15 16:16:20.602187 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.602050    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8eb165\"/\"auth-test-model-8eb165-kserve-self-signed-certs\""
Jul 15 16:16:20.607351 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.607328    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"]
Jul 15 16:16:20.623290 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.623264    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:20.702230 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.702195    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8wtc\" (UniqueName: \"kubernetes.io/projected/52a3e098-f49a-40aa-876a-8844f0b89b09-kube-api-access-w8wtc\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.702397 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.702264    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-tmp-dir\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.702397 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.702309    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-model-cache\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.702397 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.702383    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52a3e098-f49a-40aa-876a-8844f0b89b09-tls-certs\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.702521 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.702419    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-dshm\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.702521 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.702446    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-home\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.803164 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.803126    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52a3e098-f49a-40aa-876a-8844f0b89b09-tls-certs\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.803362 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.803172    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-dshm\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.803362 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.803209    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-home\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.803362 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.803257    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8wtc\" (UniqueName: \"kubernetes.io/projected/52a3e098-f49a-40aa-876a-8844f0b89b09-kube-api-access-w8wtc\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.803362 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.803331    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-tmp-dir\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.803585 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.803394    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-model-cache\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.803716 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.803691    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-home\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.803771 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.803712    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-model-cache\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.803817 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.803786    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-tmp-dir\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.805519 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.805496    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-dshm\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.805779 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.805759    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52a3e098-f49a-40aa-876a-8844f0b89b09-tls-certs\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.812315 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.812289    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8wtc\" (UniqueName: \"kubernetes.io/projected/52a3e098-f49a-40aa-876a-8844f0b89b09-kube-api-access-w8wtc\") pod \"auth-test-model-8eb165-kserve-765fd6447f-mz22x\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") " pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:20.909528 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:20.909469    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:21.043527 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:21.043504    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"]
Jul 15 16:16:21.045508 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:16:21.045481    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52a3e098_f49a_40aa_876a_8844f0b89b09.slice/crio-f3cc1b19c1f9c19e382844d3b4e28191957564d50b59c922da3cf8777b4f55b2 WatchSource:0}: Error finding container f3cc1b19c1f9c19e382844d3b4e28191957564d50b59c922da3cf8777b4f55b2: Status 404 returned error can't find the container with id f3cc1b19c1f9c19e382844d3b4e28191957564d50b59c922da3cf8777b4f55b2
Jul 15 16:16:21.088663 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:21.088639    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x" event={"ID":"52a3e098-f49a-40aa-876a-8844f0b89b09","Type":"ContainerStarted","Data":"f3cc1b19c1f9c19e382844d3b4e28191957564d50b59c922da3cf8777b4f55b2"}
Jul 15 16:16:22.098013 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:22.097980    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x" event={"ID":"52a3e098-f49a-40aa-876a-8844f0b89b09","Type":"ContainerStarted","Data":"3b4cd7215174689546067641a3b46e1654528d098da5e576fd3d99f85fe2c534"}
Jul 15 16:16:22.118770 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:22.118720    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x" podStartSLOduration=2.118705572 podStartE2EDuration="2.118705572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:16:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:22.116742225 +0000 UTC m=+2459.525515418" watchObservedRunningTime="2026-07-15 16:16:22.118705572 +0000 UTC m=+2459.527478760"
Jul 15 16:16:23.785529 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:23.785500    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:16:30.910603 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:30.910571    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:30.911097 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:30.910851    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:30.923217 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:30.923183    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:31.154492 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:31.154459    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:16:44.229108 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:44.229060    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:16:59.393203 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:16:59.393158    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:17:07.888350 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:17:07.888314    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:17:17.287183 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:17:17.287087    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:17:33.279607 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:17:33.279569    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:17:50.287861 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:17:50.287822    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:17:58.334016 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:17:58.333964    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:17:58.434529 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:17:58.434497    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:18:04.183606 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:04.183567    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:18:18.030591 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:18.030556    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"]
Jul 15 16:18:18.084387 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:18.084346    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:18:18.774108 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:18.774071    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"]
Jul 15 16:18:18.796198 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:18.796168    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:18:21.004095 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:21.004063    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:18:33.051316 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.051253    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2" podUID="e249417e-aac1-4d42-9682-a48a57185daa" containerName="main" containerID="cri-o://25468085f94386b4ea12a9440d342d937c9006129e45360770499afc763e002e" gracePeriod=45
Jul 15 16:18:33.149704 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.149659    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:18:33.308804 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.308741    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:18:33.431775 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.431736    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-model-cache\") pod \"e249417e-aac1-4d42-9682-a48a57185daa\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") "
Jul 15 16:18:33.431970 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.431796    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-tmp-dir\") pod \"e249417e-aac1-4d42-9682-a48a57185daa\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") "
Jul 15 16:18:33.431970 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.431821    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e249417e-aac1-4d42-9682-a48a57185daa-tls-certs\") pod \"e249417e-aac1-4d42-9682-a48a57185daa\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") "
Jul 15 16:18:33.431970 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.431875    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c24rz\" (UniqueName: \"kubernetes.io/projected/e249417e-aac1-4d42-9682-a48a57185daa-kube-api-access-c24rz\") pod \"e249417e-aac1-4d42-9682-a48a57185daa\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") "
Jul 15 16:18:33.431970 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.431930    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-home\") pod \"e249417e-aac1-4d42-9682-a48a57185daa\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") "
Jul 15 16:18:33.432205 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.432020    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-dshm\") pod \"e249417e-aac1-4d42-9682-a48a57185daa\" (UID: \"e249417e-aac1-4d42-9682-a48a57185daa\") "
Jul 15 16:18:33.432205 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.432094    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e249417e-aac1-4d42-9682-a48a57185daa" (UID: "e249417e-aac1-4d42-9682-a48a57185daa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:18:33.432321 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.432208    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-home" (OuterVolumeSpecName: "home") pod "e249417e-aac1-4d42-9682-a48a57185daa" (UID: "e249417e-aac1-4d42-9682-a48a57185daa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:18:33.432321 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.432277    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-model-cache" (OuterVolumeSpecName: "model-cache") pod "e249417e-aac1-4d42-9682-a48a57185daa" (UID: "e249417e-aac1-4d42-9682-a48a57185daa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:18:33.432776 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.432751    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-model-cache\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:18:33.432776 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.432778    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-tmp-dir\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:18:33.432983 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.432791    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-home\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:18:33.434336 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.434304    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e249417e-aac1-4d42-9682-a48a57185daa-kube-api-access-c24rz" (OuterVolumeSpecName: "kube-api-access-c24rz") pod "e249417e-aac1-4d42-9682-a48a57185daa" (UID: "e249417e-aac1-4d42-9682-a48a57185daa"). InnerVolumeSpecName "kube-api-access-c24rz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:18:33.434336 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.434319    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-dshm" (OuterVolumeSpecName: "dshm") pod "e249417e-aac1-4d42-9682-a48a57185daa" (UID: "e249417e-aac1-4d42-9682-a48a57185daa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:18:33.434467 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.434352    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e249417e-aac1-4d42-9682-a48a57185daa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e249417e-aac1-4d42-9682-a48a57185daa" (UID: "e249417e-aac1-4d42-9682-a48a57185daa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:18:33.533759 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.533716    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e249417e-aac1-4d42-9682-a48a57185daa-dshm\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:18:33.533759 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.533759    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e249417e-aac1-4d42-9682-a48a57185daa-tls-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:18:33.534011 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.533775    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c24rz\" (UniqueName: \"kubernetes.io/projected/e249417e-aac1-4d42-9682-a48a57185daa-kube-api-access-c24rz\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:18:33.739654 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.739612    2583 generic.go:356] "Generic (PLEG): container finished" podID="e249417e-aac1-4d42-9682-a48a57185daa" containerID="25468085f94386b4ea12a9440d342d937c9006129e45360770499afc763e002e" exitCode=0
Jul 15 16:18:33.739654 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.739657    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"
Jul 15 16:18:33.739914 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.739696    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2" event={"ID":"e249417e-aac1-4d42-9682-a48a57185daa","Type":"ContainerDied","Data":"25468085f94386b4ea12a9440d342d937c9006129e45360770499afc763e002e"}
Jul 15 16:18:33.739914 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.739746    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2" event={"ID":"e249417e-aac1-4d42-9682-a48a57185daa","Type":"ContainerDied","Data":"0bb4449204ae6fef903443b9d6062dbc28fc103e789def2c842c9db7c02b8733"}
Jul 15 16:18:33.739914 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.739770    2583 scope.go:117] "RemoveContainer" containerID="25468085f94386b4ea12a9440d342d937c9006129e45360770499afc763e002e"
Jul 15 16:18:33.748403 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.748385    2583 scope.go:117] "RemoveContainer" containerID="25468085f94386b4ea12a9440d342d937c9006129e45360770499afc763e002e"
Jul 15 16:18:33.748658 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:18:33.748640    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25468085f94386b4ea12a9440d342d937c9006129e45360770499afc763e002e\": container with ID starting with 25468085f94386b4ea12a9440d342d937c9006129e45360770499afc763e002e not found: ID does not exist" containerID="25468085f94386b4ea12a9440d342d937c9006129e45360770499afc763e002e"
Jul 15 16:18:33.748722 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.748670    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25468085f94386b4ea12a9440d342d937c9006129e45360770499afc763e002e"} err="failed to get container status \"25468085f94386b4ea12a9440d342d937c9006129e45360770499afc763e002e\": rpc error: code = NotFound desc = could not find container \"25468085f94386b4ea12a9440d342d937c9006129e45360770499afc763e002e\": container with ID starting with 25468085f94386b4ea12a9440d342d937c9006129e45360770499afc763e002e not found: ID does not exist"
Jul 15 16:18:33.760245 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.760217    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"]
Jul 15 16:18:33.766180 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.766153    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-95128b/auth-test-model-95128b-kserve-67695d7ff-j7mn2"]
Jul 15 16:18:33.794850 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:33.794820    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x" podUID="52a3e098-f49a-40aa-876a-8844f0b89b09" containerName="main" containerID="cri-o://3b4cd7215174689546067641a3b46e1654528d098da5e576fd3d99f85fe2c534" gracePeriod=45
Jul 15 16:18:34.042136 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.042105    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:18:34.142076 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.142044    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-tmp-dir\") pod \"52a3e098-f49a-40aa-876a-8844f0b89b09\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") "
Jul 15 16:18:34.142481 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.142175    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52a3e098-f49a-40aa-876a-8844f0b89b09-tls-certs\") pod \"52a3e098-f49a-40aa-876a-8844f0b89b09\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") "
Jul 15 16:18:34.142481 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.142219    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-home\") pod \"52a3e098-f49a-40aa-876a-8844f0b89b09\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") "
Jul 15 16:18:34.142481 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.142241    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-dshm\") pod \"52a3e098-f49a-40aa-876a-8844f0b89b09\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") "
Jul 15 16:18:34.142481 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.142274    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-model-cache\") pod \"52a3e098-f49a-40aa-876a-8844f0b89b09\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") "
Jul 15 16:18:34.142481 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.142322    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8wtc\" (UniqueName: \"kubernetes.io/projected/52a3e098-f49a-40aa-876a-8844f0b89b09-kube-api-access-w8wtc\") pod \"52a3e098-f49a-40aa-876a-8844f0b89b09\" (UID: \"52a3e098-f49a-40aa-876a-8844f0b89b09\") "
Jul 15 16:18:34.142481 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.142272    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "52a3e098-f49a-40aa-876a-8844f0b89b09" (UID: "52a3e098-f49a-40aa-876a-8844f0b89b09"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:18:34.142802 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.142487    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-home" (OuterVolumeSpecName: "home") pod "52a3e098-f49a-40aa-876a-8844f0b89b09" (UID: "52a3e098-f49a-40aa-876a-8844f0b89b09"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:18:34.142802 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.142506    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-model-cache" (OuterVolumeSpecName: "model-cache") pod "52a3e098-f49a-40aa-876a-8844f0b89b09" (UID: "52a3e098-f49a-40aa-876a-8844f0b89b09"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:18:34.142802 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.142665    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-home\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:18:34.142802 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.142676    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-model-cache\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:18:34.142802 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.142685    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-tmp-dir\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:18:34.144551 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.144518    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-dshm" (OuterVolumeSpecName: "dshm") pod "52a3e098-f49a-40aa-876a-8844f0b89b09" (UID: "52a3e098-f49a-40aa-876a-8844f0b89b09"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:18:34.144665 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.144566    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52a3e098-f49a-40aa-876a-8844f0b89b09-kube-api-access-w8wtc" (OuterVolumeSpecName: "kube-api-access-w8wtc") pod "52a3e098-f49a-40aa-876a-8844f0b89b09" (UID: "52a3e098-f49a-40aa-876a-8844f0b89b09"). InnerVolumeSpecName "kube-api-access-w8wtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:18:34.144665 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.144584    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52a3e098-f49a-40aa-876a-8844f0b89b09-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "52a3e098-f49a-40aa-876a-8844f0b89b09" (UID: "52a3e098-f49a-40aa-876a-8844f0b89b09"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:18:34.243940 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.243902    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52a3e098-f49a-40aa-876a-8844f0b89b09-tls-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:18:34.243940 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.243933    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52a3e098-f49a-40aa-876a-8844f0b89b09-dshm\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:18:34.243940 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.243968    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8wtc\" (UniqueName: \"kubernetes.io/projected/52a3e098-f49a-40aa-876a-8844f0b89b09-kube-api-access-w8wtc\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:18:34.747112 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.747075    2583 generic.go:356] "Generic (PLEG): container finished" podID="52a3e098-f49a-40aa-876a-8844f0b89b09" containerID="3b4cd7215174689546067641a3b46e1654528d098da5e576fd3d99f85fe2c534" exitCode=0
Jul 15 16:18:34.747286 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.747122    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"
Jul 15 16:18:34.747286 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.747157    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x" event={"ID":"52a3e098-f49a-40aa-876a-8844f0b89b09","Type":"ContainerDied","Data":"3b4cd7215174689546067641a3b46e1654528d098da5e576fd3d99f85fe2c534"}
Jul 15 16:18:34.747286 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.747201    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x" event={"ID":"52a3e098-f49a-40aa-876a-8844f0b89b09","Type":"ContainerDied","Data":"f3cc1b19c1f9c19e382844d3b4e28191957564d50b59c922da3cf8777b4f55b2"}
Jul 15 16:18:34.747286 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.747219    2583 scope.go:117] "RemoveContainer" containerID="3b4cd7215174689546067641a3b46e1654528d098da5e576fd3d99f85fe2c534"
Jul 15 16:18:34.763452 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.763434    2583 scope.go:117] "RemoveContainer" containerID="3b4cd7215174689546067641a3b46e1654528d098da5e576fd3d99f85fe2c534"
Jul 15 16:18:34.763726 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:18:34.763707    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b4cd7215174689546067641a3b46e1654528d098da5e576fd3d99f85fe2c534\": container with ID starting with 3b4cd7215174689546067641a3b46e1654528d098da5e576fd3d99f85fe2c534 not found: ID does not exist" containerID="3b4cd7215174689546067641a3b46e1654528d098da5e576fd3d99f85fe2c534"
Jul 15 16:18:34.763791 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.763739    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b4cd7215174689546067641a3b46e1654528d098da5e576fd3d99f85fe2c534"} err="failed to get container status \"3b4cd7215174689546067641a3b46e1654528d098da5e576fd3d99f85fe2c534\": rpc error: code = NotFound desc = could not find container \"3b4cd7215174689546067641a3b46e1654528d098da5e576fd3d99f85fe2c534\": container with ID starting with 3b4cd7215174689546067641a3b46e1654528d098da5e576fd3d99f85fe2c534 not found: ID does not exist"
Jul 15 16:18:34.774356 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.774329    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"]
Jul 15 16:18:34.778514 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:34.778490    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/auth-test-model-8eb165-kserve-765fd6447f-mz22x"]
Jul 15 16:18:35.585576 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:35.585538    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52a3e098-f49a-40aa-876a-8844f0b89b09" path="/var/lib/kubelet/pods/52a3e098-f49a-40aa-876a-8844f0b89b09/volumes"
Jul 15 16:18:35.586172 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:35.586151    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e249417e-aac1-4d42-9682-a48a57185daa" path="/var/lib/kubelet/pods/e249417e-aac1-4d42-9682-a48a57185daa/volumes"
Jul 15 16:18:36.182760 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:36.182721    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:18:53.006166 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.006131    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"]
Jul 15 16:18:53.007162 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.006719    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52a3e098-f49a-40aa-876a-8844f0b89b09" containerName="main"
Jul 15 16:18:53.007162 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.006743    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="52a3e098-f49a-40aa-876a-8844f0b89b09" containerName="main"
Jul 15 16:18:53.007162 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.006765    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e249417e-aac1-4d42-9682-a48a57185daa" containerName="main"
Jul 15 16:18:53.007162 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.006774    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e249417e-aac1-4d42-9682-a48a57185daa" containerName="main"
Jul 15 16:18:53.007162 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.006878    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e249417e-aac1-4d42-9682-a48a57185daa" containerName="main"
Jul 15 16:18:53.007162 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.006892    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="52a3e098-f49a-40aa-876a-8844f0b89b09" containerName="main"
Jul 15 16:18:53.011925 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.011900    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.015004 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.014981    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8eb165\"/\"kube-root-ca.crt\""
Jul 15 16:18:53.016075 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.016047    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8eb165\"/\"sub-test-model-8eb165-kserve-self-signed-certs\""
Jul 15 16:18:53.016394 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.016375    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8eb165\"/\"openshift-service-ca.crt\""
Jul 15 16:18:53.016503 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.016388    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8eb165\"/\"default-dockercfg-7fx45\""
Jul 15 16:18:53.020305 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.020280    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"]
Jul 15 16:18:53.041821 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.041785    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:18:53.122434 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.122392    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-home\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.122434 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.122433    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-tmp-dir\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.122647 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.122455    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-dshm\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.122647 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.122566    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-model-cache\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.122647 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.122594    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhrcw\" (UniqueName: \"kubernetes.io/projected/fbd10e27-935d-442e-a269-64c67a7dd2e5-kube-api-access-zhrcw\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.122647 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.122615    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbd10e27-935d-442e-a269-64c67a7dd2e5-tls-certs\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.223464 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.223420    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-dshm\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.223676 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.223517    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-model-cache\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.223676 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.223541    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhrcw\" (UniqueName: \"kubernetes.io/projected/fbd10e27-935d-442e-a269-64c67a7dd2e5-kube-api-access-zhrcw\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.223676 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.223567    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbd10e27-935d-442e-a269-64c67a7dd2e5-tls-certs\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.223676 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.223664    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-home\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.223909 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.223697    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-tmp-dir\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.224080 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.223937    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-model-cache\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.224080 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.224059    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-tmp-dir\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.224170 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.224113    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-home\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.225830 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.225808    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-dshm\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.226132 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.226117    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbd10e27-935d-442e-a269-64c67a7dd2e5-tls-certs\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.232623 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.232602    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhrcw\" (UniqueName: \"kubernetes.io/projected/fbd10e27-935d-442e-a269-64c67a7dd2e5-kube-api-access-zhrcw\") pod \"sub-test-model-8eb165-kserve-5f9fc64c49-stp2j\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") " pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.322815 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.322723    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:18:53.464859 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.464825    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"]
Jul 15 16:18:53.468240 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:18:53.468218    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbd10e27_935d_442e_a269_64c67a7dd2e5.slice/crio-7f71c9a23de9f9a77fefb1ec9aab41108d7348051a9a6bd633c6b26c7d228d58 WatchSource:0}: Error finding container 7f71c9a23de9f9a77fefb1ec9aab41108d7348051a9a6bd633c6b26c7d228d58: Status 404 returned error can't find the container with id 7f71c9a23de9f9a77fefb1ec9aab41108d7348051a9a6bd633c6b26c7d228d58
Jul 15 16:18:53.842423 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.842386    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j" event={"ID":"fbd10e27-935d-442e-a269-64c67a7dd2e5","Type":"ContainerStarted","Data":"ead562c07af56ed54057b2c38e75fb4d60ccf4ea802f5216fe16c1f1c5197e6a"}
Jul 15 16:18:53.842599 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.842437    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j" event={"ID":"fbd10e27-935d-442e-a269-64c67a7dd2e5","Type":"ContainerStarted","Data":"7f71c9a23de9f9a77fefb1ec9aab41108d7348051a9a6bd633c6b26c7d228d58"}
Jul 15 16:18:53.863119 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:53.863058    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j" podStartSLOduration=1.8630412600000001 podStartE2EDuration="1.86304126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:18:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:18:53.861449351 +0000 UTC m=+2611.270222555" watchObservedRunningTime="2026-07-15 16:18:53.86304126 +0000 UTC m=+2611.271814450"
Jul 15 16:18:57.679191 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:57.679148    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:18:59.745751 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:59.745712    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:18:59.846840 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:18:59.846805    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:19:03.323584 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:03.323537    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:19:03.324008 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:03.323604    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:19:03.336176 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:03.336147    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:19:03.906180 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:03.906147    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:19:17.098688 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:17.098650    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:19:32.174746 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:32.174711    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:19:38.866980 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:38.866928    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:19:39.702819 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:39.702783    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"]
Jul 15 16:19:39.728351 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:39.728312    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:19:45.910403 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:45.910367    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:19:48.203494 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.203461    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"]
Jul 15 16:19:48.207176 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.207157    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.209836 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.209813    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-95128b\"/\"rate-test-model-95128b-kserve-self-signed-certs\""
Jul 15 16:19:48.210862 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.210838    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-95128b\"/\"openshift-service-ca.crt\""
Jul 15 16:19:48.210986 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.210875    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-95128b\"/\"kube-root-ca.crt\""
Jul 15 16:19:48.210986 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.210885    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-95128b\"/\"default-dockercfg-9wr6w\""
Jul 15 16:19:48.219674 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.219649    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"]
Jul 15 16:19:48.231492 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.231461    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:19:48.378846 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.378799    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-home\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.379070 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.378973    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-tmp-dir\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.379070 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.379056    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg4vq\" (UniqueName: \"kubernetes.io/projected/4c67d847-f7b5-492a-9aac-de5290cd9075-kube-api-access-xg4vq\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.379170 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.379093    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-model-cache\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.379170 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.379114    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c67d847-f7b5-492a-9aac-de5290cd9075-tls-certs\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.379170 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.379145    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-dshm\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.480687 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.480585    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-tmp-dir\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.480687 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.480643    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg4vq\" (UniqueName: \"kubernetes.io/projected/4c67d847-f7b5-492a-9aac-de5290cd9075-kube-api-access-xg4vq\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.480936 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.480764    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-model-cache\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.480936 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.480817    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c67d847-f7b5-492a-9aac-de5290cd9075-tls-certs\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.480936 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.480862    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-dshm\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.480936 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.480909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-home\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.481148 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.481068    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-tmp-dir\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.481148 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.481122    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-model-cache\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.481312 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.481292    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-home\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.483133 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.483109    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-dshm\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.483405 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.483386    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c67d847-f7b5-492a-9aac-de5290cd9075-tls-certs\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.489019 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.488998    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg4vq\" (UniqueName: \"kubernetes.io/projected/4c67d847-f7b5-492a-9aac-de5290cd9075-kube-api-access-xg4vq\") pod \"rate-test-model-95128b-kserve-9bd449df5-vw7bc\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") " pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.517066 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.517026    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:48.665875 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:48.665848    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"]
Jul 15 16:19:48.667630 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:19:48.667596    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c67d847_f7b5_492a_9aac_de5290cd9075.slice/crio-3a7a25e05acb04842850858570175780226a18d27d2bb5d419f6c2514857166e WatchSource:0}: Error finding container 3a7a25e05acb04842850858570175780226a18d27d2bb5d419f6c2514857166e: Status 404 returned error can't find the container with id 3a7a25e05acb04842850858570175780226a18d27d2bb5d419f6c2514857166e
Jul 15 16:19:49.125464 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:49.125366    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc" event={"ID":"4c67d847-f7b5-492a-9aac-de5290cd9075","Type":"ContainerStarted","Data":"ce50bc20fe4864ad1c35f05336e07e6c73f0ae740626d40e7b722dbb5f7fcd76"}
Jul 15 16:19:49.125464 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:49.125422    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc" event={"ID":"4c67d847-f7b5-492a-9aac-de5290cd9075","Type":"ContainerStarted","Data":"3a7a25e05acb04842850858570175780226a18d27d2bb5d419f6c2514857166e"}
Jul 15 16:19:49.146795 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:49.146740    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc" podStartSLOduration=1.146722101 podStartE2EDuration="1.146722101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:19:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:19:49.144598426 +0000 UTC m=+2666.553371614" watchObservedRunningTime="2026-07-15 16:19:49.146722101 +0000 UTC m=+2666.555495292"
Jul 15 16:19:52.301174 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:52.301140    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:19:54.723055 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:54.723019    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j" podUID="fbd10e27-935d-442e-a269-64c67a7dd2e5" containerName="main" containerID="cri-o://ead562c07af56ed54057b2c38e75fb4d60ccf4ea802f5216fe16c1f1c5197e6a" gracePeriod=45
Jul 15 16:19:54.969835 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:54.969811    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:19:55.147818 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.147741    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-dshm\") pod \"fbd10e27-935d-442e-a269-64c67a7dd2e5\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") "
Jul 15 16:19:55.147818 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.147783    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-home\") pod \"fbd10e27-935d-442e-a269-64c67a7dd2e5\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") "
Jul 15 16:19:55.148088 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.147854    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhrcw\" (UniqueName: \"kubernetes.io/projected/fbd10e27-935d-442e-a269-64c67a7dd2e5-kube-api-access-zhrcw\") pod \"fbd10e27-935d-442e-a269-64c67a7dd2e5\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") "
Jul 15 16:19:55.148088 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.147883    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-tmp-dir\") pod \"fbd10e27-935d-442e-a269-64c67a7dd2e5\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") "
Jul 15 16:19:55.148088 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.147915    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbd10e27-935d-442e-a269-64c67a7dd2e5-tls-certs\") pod \"fbd10e27-935d-442e-a269-64c67a7dd2e5\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") "
Jul 15 16:19:55.148088 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.147958    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-model-cache\") pod \"fbd10e27-935d-442e-a269-64c67a7dd2e5\" (UID: \"fbd10e27-935d-442e-a269-64c67a7dd2e5\") "
Jul 15 16:19:55.148296 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.148165    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-home" (OuterVolumeSpecName: "home") pod "fbd10e27-935d-442e-a269-64c67a7dd2e5" (UID: "fbd10e27-935d-442e-a269-64c67a7dd2e5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:19:55.148296 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.148173    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fbd10e27-935d-442e-a269-64c67a7dd2e5" (UID: "fbd10e27-935d-442e-a269-64c67a7dd2e5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:19:55.148403 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.148295    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-model-cache" (OuterVolumeSpecName: "model-cache") pod "fbd10e27-935d-442e-a269-64c67a7dd2e5" (UID: "fbd10e27-935d-442e-a269-64c67a7dd2e5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:19:55.148403 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.148367    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-tmp-dir\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:19:55.148403 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.148388    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-home\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:19:55.150119 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.150087    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbd10e27-935d-442e-a269-64c67a7dd2e5-kube-api-access-zhrcw" (OuterVolumeSpecName: "kube-api-access-zhrcw") pod "fbd10e27-935d-442e-a269-64c67a7dd2e5" (UID: "fbd10e27-935d-442e-a269-64c67a7dd2e5"). InnerVolumeSpecName "kube-api-access-zhrcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:19:55.150238 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.150137    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbd10e27-935d-442e-a269-64c67a7dd2e5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fbd10e27-935d-442e-a269-64c67a7dd2e5" (UID: "fbd10e27-935d-442e-a269-64c67a7dd2e5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:19:55.150297 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.150246    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-dshm" (OuterVolumeSpecName: "dshm") pod "fbd10e27-935d-442e-a269-64c67a7dd2e5" (UID: "fbd10e27-935d-442e-a269-64c67a7dd2e5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:19:55.162357 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.162327    2583 generic.go:356] "Generic (PLEG): container finished" podID="fbd10e27-935d-442e-a269-64c67a7dd2e5" containerID="ead562c07af56ed54057b2c38e75fb4d60ccf4ea802f5216fe16c1f1c5197e6a" exitCode=0
Jul 15 16:19:55.162476 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.162384    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"
Jul 15 16:19:55.162476 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.162385    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j" event={"ID":"fbd10e27-935d-442e-a269-64c67a7dd2e5","Type":"ContainerDied","Data":"ead562c07af56ed54057b2c38e75fb4d60ccf4ea802f5216fe16c1f1c5197e6a"}
Jul 15 16:19:55.162476 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.162425    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j" event={"ID":"fbd10e27-935d-442e-a269-64c67a7dd2e5","Type":"ContainerDied","Data":"7f71c9a23de9f9a77fefb1ec9aab41108d7348051a9a6bd633c6b26c7d228d58"}
Jul 15 16:19:55.162476 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.162446    2583 scope.go:117] "RemoveContainer" containerID="ead562c07af56ed54057b2c38e75fb4d60ccf4ea802f5216fe16c1f1c5197e6a"
Jul 15 16:19:55.172450 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.172432    2583 scope.go:117] "RemoveContainer" containerID="ead562c07af56ed54057b2c38e75fb4d60ccf4ea802f5216fe16c1f1c5197e6a"
Jul 15 16:19:55.172718 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:19:55.172685    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ead562c07af56ed54057b2c38e75fb4d60ccf4ea802f5216fe16c1f1c5197e6a\": container with ID starting with ead562c07af56ed54057b2c38e75fb4d60ccf4ea802f5216fe16c1f1c5197e6a not found: ID does not exist" containerID="ead562c07af56ed54057b2c38e75fb4d60ccf4ea802f5216fe16c1f1c5197e6a"
Jul 15 16:19:55.172810 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.172727    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ead562c07af56ed54057b2c38e75fb4d60ccf4ea802f5216fe16c1f1c5197e6a"} err="failed to get container status \"ead562c07af56ed54057b2c38e75fb4d60ccf4ea802f5216fe16c1f1c5197e6a\": rpc error: code = NotFound desc = could not find container \"ead562c07af56ed54057b2c38e75fb4d60ccf4ea802f5216fe16c1f1c5197e6a\": container with ID starting with ead562c07af56ed54057b2c38e75fb4d60ccf4ea802f5216fe16c1f1c5197e6a not found: ID does not exist"
Jul 15 16:19:55.197339 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.197314    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"]
Jul 15 16:19:55.206624 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.206603    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/sub-test-model-8eb165-kserve-5f9fc64c49-stp2j"]
Jul 15 16:19:55.249697 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.249664    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhrcw\" (UniqueName: \"kubernetes.io/projected/fbd10e27-935d-442e-a269-64c67a7dd2e5-kube-api-access-zhrcw\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:19:55.249697 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.249688    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbd10e27-935d-442e-a269-64c67a7dd2e5-tls-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:19:55.249697 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.249698    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-model-cache\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:19:55.250013 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.249707    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbd10e27-935d-442e-a269-64c67a7dd2e5-dshm\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:19:55.585173 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:55.585139    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbd10e27-935d-442e-a269-64c67a7dd2e5" path="/var/lib/kubelet/pods/fbd10e27-935d-442e-a269-64c67a7dd2e5/volumes"
Jul 15 16:19:58.517493 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:58.517454    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:58.517895 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:58.517508    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:58.529727 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:58.529705    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:19:59.194723 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:19:59.194693    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:20:17.903258 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:20:17.903154    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:20:22.283616 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:20:22.283577    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:20:23.246787 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:20:23.246758    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 16:20:23.250338 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:20:23.250315    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqdzr_db3635c9-5545-49e5-9004-500eff2f48da/ovn-acl-logging/0.log"
Jul 15 16:20:37.588727 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:20:37.588690    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:20:49.998451 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:20:49.998410    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:20:50.111126 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:20:50.111089    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:20:55.179547 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:20:55.179508    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:20:55.281377 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:20:55.281342    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:20:59.499396 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:20:59.499355    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:21:03.318903 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:03.318869    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"]
Jul 15 16:21:03.398625 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:03.398575    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:21:03.739211 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:03.739179    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:21:03.839614 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:03.839574    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:21:04.096058 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:04.095938    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:21:14.291427 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:14.291389    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:21:18.338681 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.338622    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc" podUID="4c67d847-f7b5-492a-9aac-de5290cd9075" containerName="main" containerID="cri-o://ce50bc20fe4864ad1c35f05336e07e6c73f0ae740626d40e7b722dbb5f7fcd76" gracePeriod=45
Jul 15 16:21:18.567692 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.567658    2583 generic.go:356] "Generic (PLEG): container finished" podID="4c67d847-f7b5-492a-9aac-de5290cd9075" containerID="ce50bc20fe4864ad1c35f05336e07e6c73f0ae740626d40e7b722dbb5f7fcd76" exitCode=0
Jul 15 16:21:18.567852 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.567725    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc" event={"ID":"4c67d847-f7b5-492a-9aac-de5290cd9075","Type":"ContainerDied","Data":"ce50bc20fe4864ad1c35f05336e07e6c73f0ae740626d40e7b722dbb5f7fcd76"}
Jul 15 16:21:18.594272 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.594209    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:21:18.679194 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.679162    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-tmp-dir\") pod \"4c67d847-f7b5-492a-9aac-de5290cd9075\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") "
Jul 15 16:21:18.679362 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.679226    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c67d847-f7b5-492a-9aac-de5290cd9075-tls-certs\") pod \"4c67d847-f7b5-492a-9aac-de5290cd9075\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") "
Jul 15 16:21:18.679362 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.679254    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg4vq\" (UniqueName: \"kubernetes.io/projected/4c67d847-f7b5-492a-9aac-de5290cd9075-kube-api-access-xg4vq\") pod \"4c67d847-f7b5-492a-9aac-de5290cd9075\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") "
Jul 15 16:21:18.679362 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.679284    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-home\") pod \"4c67d847-f7b5-492a-9aac-de5290cd9075\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") "
Jul 15 16:21:18.679362 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.679308    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-dshm\") pod \"4c67d847-f7b5-492a-9aac-de5290cd9075\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") "
Jul 15 16:21:18.679362 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.679332    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-model-cache\") pod \"4c67d847-f7b5-492a-9aac-de5290cd9075\" (UID: \"4c67d847-f7b5-492a-9aac-de5290cd9075\") "
Jul 15 16:21:18.679633 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.679452    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4c67d847-f7b5-492a-9aac-de5290cd9075" (UID: "4c67d847-f7b5-492a-9aac-de5290cd9075"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:21:18.679633 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.679588    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-home" (OuterVolumeSpecName: "home") pod "4c67d847-f7b5-492a-9aac-de5290cd9075" (UID: "4c67d847-f7b5-492a-9aac-de5290cd9075"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:21:18.679723 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.679648    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-model-cache" (OuterVolumeSpecName: "model-cache") pod "4c67d847-f7b5-492a-9aac-de5290cd9075" (UID: "4c67d847-f7b5-492a-9aac-de5290cd9075"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:21:18.679723 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.679682    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-tmp-dir\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:21:18.679723 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.679699    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-home\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:21:18.681450 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.681415    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c67d847-f7b5-492a-9aac-de5290cd9075-kube-api-access-xg4vq" (OuterVolumeSpecName: "kube-api-access-xg4vq") pod "4c67d847-f7b5-492a-9aac-de5290cd9075" (UID: "4c67d847-f7b5-492a-9aac-de5290cd9075"). InnerVolumeSpecName "kube-api-access-xg4vq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:21:18.681450 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.681414    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-dshm" (OuterVolumeSpecName: "dshm") pod "4c67d847-f7b5-492a-9aac-de5290cd9075" (UID: "4c67d847-f7b5-492a-9aac-de5290cd9075"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:21:18.681597 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.681496    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c67d847-f7b5-492a-9aac-de5290cd9075-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4c67d847-f7b5-492a-9aac-de5290cd9075" (UID: "4c67d847-f7b5-492a-9aac-de5290cd9075"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:21:18.781175 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.781140    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c67d847-f7b5-492a-9aac-de5290cd9075-tls-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:21:18.781175 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.781168    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xg4vq\" (UniqueName: \"kubernetes.io/projected/4c67d847-f7b5-492a-9aac-de5290cd9075-kube-api-access-xg4vq\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:21:18.781175 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.781178    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-dshm\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:21:18.781393 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:18.781187    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c67d847-f7b5-492a-9aac-de5290cd9075-model-cache\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:21:19.574544 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:19.574494    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc" event={"ID":"4c67d847-f7b5-492a-9aac-de5290cd9075","Type":"ContainerDied","Data":"3a7a25e05acb04842850858570175780226a18d27d2bb5d419f6c2514857166e"}
Jul 15 16:21:19.575060 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:19.574564    2583 scope.go:117] "RemoveContainer" containerID="ce50bc20fe4864ad1c35f05336e07e6c73f0ae740626d40e7b722dbb5f7fcd76"
Jul 15 16:21:19.575060 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:19.574767    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"
Jul 15 16:21:19.600402 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:19.600374    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"]
Jul 15 16:21:19.604305 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:19.604283    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-95128b/rate-test-model-95128b-kserve-9bd449df5-vw7bc"]
Jul 15 16:21:21.584671 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:21.584636    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c67d847-f7b5-492a-9aac-de5290cd9075" path="/var/lib/kubelet/pods/4c67d847-f7b5-492a-9aac-de5290cd9075/volumes"
Jul 15 16:21:23.722133 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:23.722102    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:21:23.822586 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:23.822552    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:21:29.766801 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:29.766762    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:21:33.531409 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:33.531370    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:21:37.189875 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:37.189842    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:21:38.218124 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:38.218087    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:21:46.294919 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:46.294841    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:21:46.395693 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:46.395659    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:21:48.891291 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:48.891259    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"]
Jul 15 16:21:48.891734 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:48.891475    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s" podUID="66fd4342-5517-4fec-bda6-50e210daea4c" containerName="istio-proxy" containerID="cri-o://56bbea8658b0aa8009267dfde408f6872fd424acf84142075156ee0924bf07cd" gracePeriod=30
Jul 15 16:21:48.909212 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:48.909157    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:21:49.155729 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:49.155644    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:21:49.989849 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:49.989807    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:21:50.090171 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:50.090132    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:21:50.389963 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:50.389850    2583 patch_prober.go:28] interesting pod/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 16:21:50.389963 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:50.389917    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s" podUID="66fd4342-5517-4fec-bda6-50e210daea4c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:21:54.147876 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.147851    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:21:54.222218 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.222187    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-credential-socket\") pod \"66fd4342-5517-4fec-bda6-50e210daea4c\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") "
Jul 15 16:21:54.222391 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.222234    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66fd4342-5517-4fec-bda6-50e210daea4c-istiod-ca-cert\") pod \"66fd4342-5517-4fec-bda6-50e210daea4c\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") "
Jul 15 16:21:54.222391 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.222270    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66fd4342-5517-4fec-bda6-50e210daea4c-istio-token\") pod \"66fd4342-5517-4fec-bda6-50e210daea4c\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") "
Jul 15 16:21:54.222391 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.222294    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66fd4342-5517-4fec-bda6-50e210daea4c-istio-podinfo\") pod \"66fd4342-5517-4fec-bda6-50e210daea4c\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") "
Jul 15 16:21:54.222391 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.222336    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8x9g\" (UniqueName: \"kubernetes.io/projected/66fd4342-5517-4fec-bda6-50e210daea4c-kube-api-access-s8x9g\") pod \"66fd4342-5517-4fec-bda6-50e210daea4c\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") "
Jul 15 16:21:54.222391 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.222380    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-workload-socket\") pod \"66fd4342-5517-4fec-bda6-50e210daea4c\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") "
Jul 15 16:21:54.222649 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.222410    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-istio-envoy\") pod \"66fd4342-5517-4fec-bda6-50e210daea4c\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") "
Jul 15 16:21:54.222649 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.222462    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-istio-data\") pod \"66fd4342-5517-4fec-bda6-50e210daea4c\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") "
Jul 15 16:21:54.222649 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.222504    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "66fd4342-5517-4fec-bda6-50e210daea4c" (UID: "66fd4342-5517-4fec-bda6-50e210daea4c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:21:54.222649 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.222520    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-workload-certs\") pod \"66fd4342-5517-4fec-bda6-50e210daea4c\" (UID: \"66fd4342-5517-4fec-bda6-50e210daea4c\") "
Jul 15 16:21:54.222853 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.222775    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66fd4342-5517-4fec-bda6-50e210daea4c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "66fd4342-5517-4fec-bda6-50e210daea4c" (UID: "66fd4342-5517-4fec-bda6-50e210daea4c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:21:54.222911 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.222868    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-credential-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:21:54.223086 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.223047    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "66fd4342-5517-4fec-bda6-50e210daea4c" (UID: "66fd4342-5517-4fec-bda6-50e210daea4c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:21:54.223227 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.223206    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "66fd4342-5517-4fec-bda6-50e210daea4c" (UID: "66fd4342-5517-4fec-bda6-50e210daea4c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:21:54.223666 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.223641    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-istio-data" (OuterVolumeSpecName: "istio-data") pod "66fd4342-5517-4fec-bda6-50e210daea4c" (UID: "66fd4342-5517-4fec-bda6-50e210daea4c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:21:54.224571 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.224549    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66fd4342-5517-4fec-bda6-50e210daea4c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "66fd4342-5517-4fec-bda6-50e210daea4c" (UID: "66fd4342-5517-4fec-bda6-50e210daea4c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:21:54.224637 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.224565    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "66fd4342-5517-4fec-bda6-50e210daea4c" (UID: "66fd4342-5517-4fec-bda6-50e210daea4c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:21:54.224883 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.224849    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66fd4342-5517-4fec-bda6-50e210daea4c-istio-token" (OuterVolumeSpecName: "istio-token") pod "66fd4342-5517-4fec-bda6-50e210daea4c" (UID: "66fd4342-5517-4fec-bda6-50e210daea4c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:21:54.224927 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.224874    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66fd4342-5517-4fec-bda6-50e210daea4c-kube-api-access-s8x9g" (OuterVolumeSpecName: "kube-api-access-s8x9g") pod "66fd4342-5517-4fec-bda6-50e210daea4c" (UID: "66fd4342-5517-4fec-bda6-50e210daea4c"). InnerVolumeSpecName "kube-api-access-s8x9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:21:54.323721 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.323687    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66fd4342-5517-4fec-bda6-50e210daea4c-istiod-ca-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:21:54.323721 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.323714    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66fd4342-5517-4fec-bda6-50e210daea4c-istio-token\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:21:54.323721 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.323723    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66fd4342-5517-4fec-bda6-50e210daea4c-istio-podinfo\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:21:54.323936 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.323731    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8x9g\" (UniqueName: \"kubernetes.io/projected/66fd4342-5517-4fec-bda6-50e210daea4c-kube-api-access-s8x9g\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:21:54.323936 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.323740    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-workload-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:21:54.323936 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.323748    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-istio-envoy\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:21:54.323936 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.323756    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-istio-data\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:21:54.323936 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.323763    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66fd4342-5517-4fec-bda6-50e210daea4c-workload-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:21:54.739737 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.739706    2583 generic.go:356] "Generic (PLEG): container finished" podID="66fd4342-5517-4fec-bda6-50e210daea4c" containerID="56bbea8658b0aa8009267dfde408f6872fd424acf84142075156ee0924bf07cd" exitCode=0
Jul 15 16:21:54.739879 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.739752    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"
Jul 15 16:21:54.739879 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.739793    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s" event={"ID":"66fd4342-5517-4fec-bda6-50e210daea4c","Type":"ContainerDied","Data":"56bbea8658b0aa8009267dfde408f6872fd424acf84142075156ee0924bf07cd"}
Jul 15 16:21:54.739879 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.739851    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s" event={"ID":"66fd4342-5517-4fec-bda6-50e210daea4c","Type":"ContainerDied","Data":"71c0c16411fbe10659883e47ed831f0d99df7e8621e193159205f81097de6aef"}
Jul 15 16:21:54.739879 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.739875    2583 scope.go:117] "RemoveContainer" containerID="56bbea8658b0aa8009267dfde408f6872fd424acf84142075156ee0924bf07cd"
Jul 15 16:21:54.749016 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.748999    2583 scope.go:117] "RemoveContainer" containerID="af76b2eeb252b4c1e8fc9c8c298749a13fd7cc48057e57b18b395a2807b75269"
Jul 15 16:21:54.756860 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.756842    2583 scope.go:117] "RemoveContainer" containerID="56bbea8658b0aa8009267dfde408f6872fd424acf84142075156ee0924bf07cd"
Jul 15 16:21:54.757144 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:21:54.757124    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56bbea8658b0aa8009267dfde408f6872fd424acf84142075156ee0924bf07cd\": container with ID starting with 56bbea8658b0aa8009267dfde408f6872fd424acf84142075156ee0924bf07cd not found: ID does not exist" containerID="56bbea8658b0aa8009267dfde408f6872fd424acf84142075156ee0924bf07cd"
Jul 15 16:21:54.757242 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.757170    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56bbea8658b0aa8009267dfde408f6872fd424acf84142075156ee0924bf07cd"} err="failed to get container status \"56bbea8658b0aa8009267dfde408f6872fd424acf84142075156ee0924bf07cd\": rpc error: code = NotFound desc = could not find container \"56bbea8658b0aa8009267dfde408f6872fd424acf84142075156ee0924bf07cd\": container with ID starting with 56bbea8658b0aa8009267dfde408f6872fd424acf84142075156ee0924bf07cd not found: ID does not exist"
Jul 15 16:21:54.757242 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.757187    2583 scope.go:117] "RemoveContainer" containerID="af76b2eeb252b4c1e8fc9c8c298749a13fd7cc48057e57b18b395a2807b75269"
Jul 15 16:21:54.757420 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:21:54.757403    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af76b2eeb252b4c1e8fc9c8c298749a13fd7cc48057e57b18b395a2807b75269\": container with ID starting with af76b2eeb252b4c1e8fc9c8c298749a13fd7cc48057e57b18b395a2807b75269 not found: ID does not exist" containerID="af76b2eeb252b4c1e8fc9c8c298749a13fd7cc48057e57b18b395a2807b75269"
Jul 15 16:21:54.757457 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.757428    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af76b2eeb252b4c1e8fc9c8c298749a13fd7cc48057e57b18b395a2807b75269"} err="failed to get container status \"af76b2eeb252b4c1e8fc9c8c298749a13fd7cc48057e57b18b395a2807b75269\": rpc error: code = NotFound desc = could not find container \"af76b2eeb252b4c1e8fc9c8c298749a13fd7cc48057e57b18b395a2807b75269\": container with ID starting with af76b2eeb252b4c1e8fc9c8c298749a13fd7cc48057e57b18b395a2807b75269 not found: ID does not exist"
Jul 15 16:21:54.766780 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.766759    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"]
Jul 15 16:21:54.778698 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:54.778672    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-95128b-openshift-default-5fbcdfd5dc-s5k8s"]
Jul 15 16:21:55.585990 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:55.585931    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66fd4342-5517-4fec-bda6-50e210daea4c" path="/var/lib/kubelet/pods/66fd4342-5517-4fec-bda6-50e210daea4c/volumes"
Jul 15 16:21:59.761323 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:21:59.761284    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:22:02.887285 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:02.887246    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qzjpr"]
Jul 15 16:22:04.388516 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:04.388473    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:22:10.635594 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:10.635557    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:22:10.709146 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:10.709096    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:22:15.022004 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:15.021967    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"]
Jul 15 16:22:15.022470 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:15.022154    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r" podUID="80f965d0-9487-4d30-8e3a-4d97339e6269" containerName="istio-proxy" containerID="cri-o://870dbe40bc252476a46b34dc7ae24041d355f9a79108482f6b54ebd9346ad77b" gracePeriod=30
Jul 15 16:22:15.048239 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:15.048206    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:22:15.261215 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:15.261182    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:22:16.332260 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:16.332225    2583 patch_prober.go:28] interesting pod/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 16:22:16.332655 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:16.332292    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r" podUID="80f965d0-9487-4d30-8e3a-4d97339e6269" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:22:19.647425 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:19.647388    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:22:20.280986 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.280960    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:22:20.369199 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.369090    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqlpg\" (UniqueName: \"kubernetes.io/projected/80f965d0-9487-4d30-8e3a-4d97339e6269-kube-api-access-vqlpg\") pod \"80f965d0-9487-4d30-8e3a-4d97339e6269\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") "
Jul 15 16:22:20.369199 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.369162    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-workload-socket\") pod \"80f965d0-9487-4d30-8e3a-4d97339e6269\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") "
Jul 15 16:22:20.369199 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.369197    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-data\") pod \"80f965d0-9487-4d30-8e3a-4d97339e6269\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") "
Jul 15 16:22:20.369458 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.369233    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-credential-socket\") pod \"80f965d0-9487-4d30-8e3a-4d97339e6269\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") "
Jul 15 16:22:20.369458 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.369265    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-token\") pod \"80f965d0-9487-4d30-8e3a-4d97339e6269\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") "
Jul 15 16:22:20.369458 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.369390    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-podinfo\") pod \"80f965d0-9487-4d30-8e3a-4d97339e6269\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") "
Jul 15 16:22:20.369458 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.369414    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80f965d0-9487-4d30-8e3a-4d97339e6269-istiod-ca-cert\") pod \"80f965d0-9487-4d30-8e3a-4d97339e6269\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") "
Jul 15 16:22:20.369458 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.369442    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-envoy\") pod \"80f965d0-9487-4d30-8e3a-4d97339e6269\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") "
Jul 15 16:22:20.369937 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.369472    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-workload-certs\") pod \"80f965d0-9487-4d30-8e3a-4d97339e6269\" (UID: \"80f965d0-9487-4d30-8e3a-4d97339e6269\") "
Jul 15 16:22:20.369937 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.369536    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "80f965d0-9487-4d30-8e3a-4d97339e6269" (UID: "80f965d0-9487-4d30-8e3a-4d97339e6269"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:22:20.369937 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.369551    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "80f965d0-9487-4d30-8e3a-4d97339e6269" (UID: "80f965d0-9487-4d30-8e3a-4d97339e6269"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:22:20.369937 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.369766    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "80f965d0-9487-4d30-8e3a-4d97339e6269" (UID: "80f965d0-9487-4d30-8e3a-4d97339e6269"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:22:20.369937 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.369840    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80f965d0-9487-4d30-8e3a-4d97339e6269-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "80f965d0-9487-4d30-8e3a-4d97339e6269" (UID: "80f965d0-9487-4d30-8e3a-4d97339e6269"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:22:20.369937 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.369871    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-workload-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:22:20.369937 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.369889    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-workload-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:22:20.369937 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.369904    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-credential-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:22:20.370303 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.370149    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-data" (OuterVolumeSpecName: "istio-data") pod "80f965d0-9487-4d30-8e3a-4d97339e6269" (UID: "80f965d0-9487-4d30-8e3a-4d97339e6269"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:22:20.371590 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.371552    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-token" (OuterVolumeSpecName: "istio-token") pod "80f965d0-9487-4d30-8e3a-4d97339e6269" (UID: "80f965d0-9487-4d30-8e3a-4d97339e6269"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:22:20.371694 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.371664    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "80f965d0-9487-4d30-8e3a-4d97339e6269" (UID: "80f965d0-9487-4d30-8e3a-4d97339e6269"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:22:20.371928 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.371896    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "80f965d0-9487-4d30-8e3a-4d97339e6269" (UID: "80f965d0-9487-4d30-8e3a-4d97339e6269"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:22:20.371928 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.371902    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80f965d0-9487-4d30-8e3a-4d97339e6269-kube-api-access-vqlpg" (OuterVolumeSpecName: "kube-api-access-vqlpg") pod "80f965d0-9487-4d30-8e3a-4d97339e6269" (UID: "80f965d0-9487-4d30-8e3a-4d97339e6269"). InnerVolumeSpecName "kube-api-access-vqlpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:22:20.470999 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.470963    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqlpg\" (UniqueName: \"kubernetes.io/projected/80f965d0-9487-4d30-8e3a-4d97339e6269-kube-api-access-vqlpg\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:22:20.470999 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.470993    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-data\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:22:20.470999 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.471001    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-token\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:22:20.470999 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.471009    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-podinfo\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:22:20.471291 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.471017    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80f965d0-9487-4d30-8e3a-4d97339e6269-istiod-ca-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:22:20.471291 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.471025    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80f965d0-9487-4d30-8e3a-4d97339e6269-istio-envoy\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 15 16:22:20.865899 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.865866    2583 generic.go:356] "Generic (PLEG): container finished" podID="80f965d0-9487-4d30-8e3a-4d97339e6269" containerID="870dbe40bc252476a46b34dc7ae24041d355f9a79108482f6b54ebd9346ad77b" exitCode=0
Jul 15 16:22:20.866352 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.865912    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"
Jul 15 16:22:20.866352 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.865975    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r" event={"ID":"80f965d0-9487-4d30-8e3a-4d97339e6269","Type":"ContainerDied","Data":"870dbe40bc252476a46b34dc7ae24041d355f9a79108482f6b54ebd9346ad77b"}
Jul 15 16:22:20.866352 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.866032    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r" event={"ID":"80f965d0-9487-4d30-8e3a-4d97339e6269","Type":"ContainerDied","Data":"6c94a4ff003edb46de86fef41e7c81e0f3bd1744498e02740d25cc6fdb38542c"}
Jul 15 16:22:20.866352 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.866054    2583 scope.go:117] "RemoveContainer" containerID="870dbe40bc252476a46b34dc7ae24041d355f9a79108482f6b54ebd9346ad77b"
Jul 15 16:22:20.875194 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.875178    2583 scope.go:117] "RemoveContainer" containerID="71fcc1760215ba795bdfa6b14c39eb3bbe5663213e4b7a491ef2d4ad128a213f"
Jul 15 16:22:20.883493 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.883478    2583 scope.go:117] "RemoveContainer" containerID="870dbe40bc252476a46b34dc7ae24041d355f9a79108482f6b54ebd9346ad77b"
Jul 15 16:22:20.883719 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:22:20.883702    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"870dbe40bc252476a46b34dc7ae24041d355f9a79108482f6b54ebd9346ad77b\": container with ID starting with 870dbe40bc252476a46b34dc7ae24041d355f9a79108482f6b54ebd9346ad77b not found: ID does not exist" containerID="870dbe40bc252476a46b34dc7ae24041d355f9a79108482f6b54ebd9346ad77b"
Jul 15 16:22:20.883757 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.883727    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"870dbe40bc252476a46b34dc7ae24041d355f9a79108482f6b54ebd9346ad77b"} err="failed to get container status \"870dbe40bc252476a46b34dc7ae24041d355f9a79108482f6b54ebd9346ad77b\": rpc error: code = NotFound desc = could not find container \"870dbe40bc252476a46b34dc7ae24041d355f9a79108482f6b54ebd9346ad77b\": container with ID starting with 870dbe40bc252476a46b34dc7ae24041d355f9a79108482f6b54ebd9346ad77b not found: ID does not exist"
Jul 15 16:22:20.883757 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.883747    2583 scope.go:117] "RemoveContainer" containerID="71fcc1760215ba795bdfa6b14c39eb3bbe5663213e4b7a491ef2d4ad128a213f"
Jul 15 16:22:20.883980 ip-10-0-135-178 kubenswrapper[2583]: E0715 16:22:20.883941    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71fcc1760215ba795bdfa6b14c39eb3bbe5663213e4b7a491ef2d4ad128a213f\": container with ID starting with 71fcc1760215ba795bdfa6b14c39eb3bbe5663213e4b7a491ef2d4ad128a213f not found: ID does not exist" containerID="71fcc1760215ba795bdfa6b14c39eb3bbe5663213e4b7a491ef2d4ad128a213f"
Jul 15 16:22:20.884107 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.883985    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71fcc1760215ba795bdfa6b14c39eb3bbe5663213e4b7a491ef2d4ad128a213f"} err="failed to get container status \"71fcc1760215ba795bdfa6b14c39eb3bbe5663213e4b7a491ef2d4ad128a213f\": rpc error: code = NotFound desc = could not find container \"71fcc1760215ba795bdfa6b14c39eb3bbe5663213e4b7a491ef2d4ad128a213f\": container with ID starting with 71fcc1760215ba795bdfa6b14c39eb3bbe5663213e4b7a491ef2d4ad128a213f not found: ID does not exist"
Jul 15 16:22:20.890373 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.890338    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"]
Jul 15 16:22:20.895085 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:20.895065    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-8eb165-openshift-default-5676bd9475-85p2r"]
Jul 15 16:22:21.082463 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:21.082425    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fpj28_3f025f0d-bd71-401d-84ff-326c92e4c7bb/manager/0.log"
Jul 15 16:22:21.204661 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:21.204631    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vtkwv_803ad9e4-3bf5-4580-ad57-18fa30dc1bc4/manager/0.log"
Jul 15 16:22:21.585738 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:21.585644    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80f965d0-9487-4d30-8e3a-4d97339e6269" path="/var/lib/kubelet/pods/80f965d0-9487-4d30-8e3a-4d97339e6269/volumes"
Jul 15 16:22:21.827044 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:21.827017    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ccf5c88b7-n7p28_a8a4b832-c988-46d1-b06b-8289aee8d3ef/copy-manifests/0.log"
Jul 15 16:22:21.833877 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:21.833854    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ccf5c88b7-n7p28_a8a4b832-c988-46d1-b06b-8289aee8d3ef/manager/0.log"
Jul 15 16:22:25.675540 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:25.675508    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8cwzx_9bfb888b-7e26-4885-938d-5ada2c330baa/manager/0.log"
Jul 15 16:22:26.152733 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:26.152705    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qzjpr_2368128d-7b8f-4074-8ac4-e279236e2cfd/limitador/0.log"
Jul 15 16:22:26.276475 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:26.276446    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bhvtt_c917582c-9a83-4ba3-87cb-040ee2b39822/manager/0.log"
Jul 15 16:22:26.647221 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:26.647187    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47ssgs_21824abc-d876-4956-a30d-9a5cece33df7/istio-proxy/0.log"
Jul 15 16:22:27.122475 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:27.122437    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rfd9v_2b5835d1-1eb9-4459-ab99-254d09aa6138/istio-proxy/1.log"
Jul 15 16:22:28.295971 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:28.295871    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dbjks_0fef1eb0-dd33-49fa-84c0-13f542fe957d/main/0.log"
Jul 15 16:22:34.161071 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161034    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7j6b2/must-gather-hdxr9"]
Jul 15 16:22:34.161497 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161445    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66fd4342-5517-4fec-bda6-50e210daea4c" containerName="istio-proxy"
Jul 15 16:22:34.161497 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161457    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="66fd4342-5517-4fec-bda6-50e210daea4c" containerName="istio-proxy"
Jul 15 16:22:34.161497 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161465    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80f965d0-9487-4d30-8e3a-4d97339e6269" containerName="istio-proxy"
Jul 15 16:22:34.161497 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161471    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="80f965d0-9487-4d30-8e3a-4d97339e6269" containerName="istio-proxy"
Jul 15 16:22:34.161497 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161478    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbd10e27-935d-442e-a269-64c67a7dd2e5" containerName="main"
Jul 15 16:22:34.161497 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161484    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbd10e27-935d-442e-a269-64c67a7dd2e5" containerName="main"
Jul 15 16:22:34.161685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161509    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c67d847-f7b5-492a-9aac-de5290cd9075" containerName="main"
Jul 15 16:22:34.161685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161514    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c67d847-f7b5-492a-9aac-de5290cd9075" containerName="main"
Jul 15 16:22:34.161685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161568    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="80f965d0-9487-4d30-8e3a-4d97339e6269" containerName="istio-proxy"
Jul 15 16:22:34.161685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161578    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="80f965d0-9487-4d30-8e3a-4d97339e6269" containerName="istio-proxy"
Jul 15 16:22:34.161685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161584    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbd10e27-935d-442e-a269-64c67a7dd2e5" containerName="main"
Jul 15 16:22:34.161685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161592    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="66fd4342-5517-4fec-bda6-50e210daea4c" containerName="istio-proxy"
Jul 15 16:22:34.161685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161597    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="66fd4342-5517-4fec-bda6-50e210daea4c" containerName="istio-proxy"
Jul 15 16:22:34.161685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161602    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c67d847-f7b5-492a-9aac-de5290cd9075" containerName="main"
Jul 15 16:22:34.161685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161663    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66fd4342-5517-4fec-bda6-50e210daea4c" containerName="istio-proxy"
Jul 15 16:22:34.161685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161668    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="66fd4342-5517-4fec-bda6-50e210daea4c" containerName="istio-proxy"
Jul 15 16:22:34.161685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161674    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80f965d0-9487-4d30-8e3a-4d97339e6269" containerName="istio-proxy"
Jul 15 16:22:34.161685 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.161679    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="80f965d0-9487-4d30-8e3a-4d97339e6269" containerName="istio-proxy"
Jul 15 16:22:34.164448 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.164430    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7j6b2/must-gather-hdxr9"
Jul 15 16:22:34.167025 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.167009    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7j6b2\"/\"kube-root-ca.crt\""
Jul 15 16:22:34.168076 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.168056    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7j6b2\"/\"default-dockercfg-zrw5m\""
Jul 15 16:22:34.168076 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.168067    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7j6b2\"/\"openshift-service-ca.crt\""
Jul 15 16:22:34.175161 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.175137    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:22:34.175794 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.175775    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7j6b2/must-gather-hdxr9"]
Jul 15 16:22:34.259202 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.259166    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log" limit=1024
Jul 15 16:22:34.298792 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.298759    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/22e00498-71ac-41ab-8922-6d14b2bf10ec-must-gather-output\") pod \"must-gather-hdxr9\" (UID: \"22e00498-71ac-41ab-8922-6d14b2bf10ec\") " pod="openshift-must-gather-7j6b2/must-gather-hdxr9"
Jul 15 16:22:34.298968 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.298859    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2975z\" (UniqueName: \"kubernetes.io/projected/22e00498-71ac-41ab-8922-6d14b2bf10ec-kube-api-access-2975z\") pod \"must-gather-hdxr9\" (UID: \"22e00498-71ac-41ab-8922-6d14b2bf10ec\") " pod="openshift-must-gather-7j6b2/must-gather-hdxr9"
Jul 15 16:22:34.399567 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.399533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2975z\" (UniqueName: \"kubernetes.io/projected/22e00498-71ac-41ab-8922-6d14b2bf10ec-kube-api-access-2975z\") pod \"must-gather-hdxr9\" (UID: \"22e00498-71ac-41ab-8922-6d14b2bf10ec\") " pod="openshift-must-gather-7j6b2/must-gather-hdxr9"
Jul 15 16:22:34.399744 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.399601    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/22e00498-71ac-41ab-8922-6d14b2bf10ec-must-gather-output\") pod \"must-gather-hdxr9\" (UID: \"22e00498-71ac-41ab-8922-6d14b2bf10ec\") " pod="openshift-must-gather-7j6b2/must-gather-hdxr9"
Jul 15 16:22:34.400000 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.399983    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/22e00498-71ac-41ab-8922-6d14b2bf10ec-must-gather-output\") pod \"must-gather-hdxr9\" (UID: \"22e00498-71ac-41ab-8922-6d14b2bf10ec\") " pod="openshift-must-gather-7j6b2/must-gather-hdxr9"
Jul 15 16:22:34.411009 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.410985    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2975z\" (UniqueName: \"kubernetes.io/projected/22e00498-71ac-41ab-8922-6d14b2bf10ec-kube-api-access-2975z\") pod \"must-gather-hdxr9\" (UID: \"22e00498-71ac-41ab-8922-6d14b2bf10ec\") " pod="openshift-must-gather-7j6b2/must-gather-hdxr9"
Jul 15 16:22:34.474106 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.474078    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7j6b2/must-gather-hdxr9"
Jul 15 16:22:34.604260 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.604234    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7j6b2/must-gather-hdxr9"]
Jul 15 16:22:34.606733 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:22:34.606706    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22e00498_71ac_41ab_8922_6d14b2bf10ec.slice/crio-3282df896547efeeb9e7715e820c0c2ce923c016818ea5744143caf2d9296d6c WatchSource:0}: Error finding container 3282df896547efeeb9e7715e820c0c2ce923c016818ea5744143caf2d9296d6c: Status 404 returned error can't find the container with id 3282df896547efeeb9e7715e820c0c2ce923c016818ea5744143caf2d9296d6c
Jul 15 16:22:34.608526 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.608507    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 16:22:34.930186 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:34.930098    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7j6b2/must-gather-hdxr9" event={"ID":"22e00498-71ac-41ab-8922-6d14b2bf10ec","Type":"ContainerStarted","Data":"3282df896547efeeb9e7715e820c0c2ce923c016818ea5744143caf2d9296d6c"}
Jul 15 16:22:35.936372 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:35.936288    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7j6b2/must-gather-hdxr9" event={"ID":"22e00498-71ac-41ab-8922-6d14b2bf10ec","Type":"ContainerStarted","Data":"c95a6d93474bfbe987eae1e3728a9586723b0a3d4128433bc8b9b029d76f79d6"}
Jul 15 16:22:35.936372 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:35.936331    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7j6b2/must-gather-hdxr9" event={"ID":"22e00498-71ac-41ab-8922-6d14b2bf10ec","Type":"ContainerStarted","Data":"2b9f3db2236e0310df831d3121e0a5fc39c302a615a51f6d72ef4c75bed5c57e"}
Jul 15 16:22:35.955294 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:35.955248    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7j6b2/must-gather-hdxr9" podStartSLOduration=1.112468203 podStartE2EDuration="1.955231s" totalImagesPullingTime="842.762797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:22:35.953849076 +0000 UTC m=+2833.362622268" watchObservedRunningTime="2026-07-15 16:22:35.955231 +0000 UTC m=+2833.364004189"
Jul 15 16:22:37.142811 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:37.142777    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tts5k_b0b6ce0e-c412-48dd-a538-19e92a2910ed/global-pull-secret-syncer/0.log"
Jul 15 16:22:37.197490 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:37.197450    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m9ggg_0f387fbf-3210-4c20-8ee2-803e27f4f75b/konnectivity-agent/0.log"
Jul 15 16:22:37.338983 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:37.338933    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-178.ec2.internal_102fbd48ff7ff0cfcd397c73fd966f70/haproxy/0.log"
Jul 15 16:22:42.859657 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:42.859624    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8cwzx_9bfb888b-7e26-4885-938d-5ada2c330baa/manager/0.log"
Jul 15 16:22:43.290103 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:43.290070    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qzjpr_2368128d-7b8f-4074-8ac4-e279236e2cfd/limitador/0.log"
Jul 15 16:22:43.378550 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:43.378517    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bhvtt_c917582c-9a83-4ba3-87cb-040ee2b39822/manager/0.log"
Jul 15 16:22:45.424437 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:45.424272    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-h5qbj_b4b3e841-bbf8-402a-a3b4-b88fea12aad5/kube-state-metrics/0.log"
Jul 15 16:22:45.442520 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:45.442469    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-h5qbj_b4b3e841-bbf8-402a-a3b4-b88fea12aad5/kube-rbac-proxy-main/0.log"
Jul 15 16:22:45.469404 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:45.469371    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-h5qbj_b4b3e841-bbf8-402a-a3b4-b88fea12aad5/kube-rbac-proxy-self/0.log"
Jul 15 16:22:45.511290 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:45.511264    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-69b68cf8d-rq4cr_4acd7cd9-f9da-4754-a988-bb517d1061e4/metrics-server/0.log"
Jul 15 16:22:45.541551 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:45.541512    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-zzt94_8a44503b-afa3-484b-a944-387c78559614/monitoring-plugin/0.log"
Jul 15 16:22:45.568724 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:45.568692    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6bbd8_d7c67569-2b3b-4d5a-a157-916b5402240f/node-exporter/0.log"
Jul 15 16:22:45.590354 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:45.590319    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6bbd8_d7c67569-2b3b-4d5a-a157-916b5402240f/kube-rbac-proxy/0.log"
Jul 15 16:22:45.617478 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:45.617448    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6bbd8_d7c67569-2b3b-4d5a-a157-916b5402240f/init-textfile/0.log"
Jul 15 16:22:45.810449 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:45.810416    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-rznwg_ac3ed45f-5acf-4546-9912-f2284022f3fc/kube-rbac-proxy-main/0.log"
Jul 15 16:22:45.833329 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:45.833298    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-rznwg_ac3ed45f-5acf-4546-9912-f2284022f3fc/kube-rbac-proxy-self/0.log"
Jul 15 16:22:45.856059 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:45.856032    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-rznwg_ac3ed45f-5acf-4546-9912-f2284022f3fc/openshift-state-metrics/0.log"
Jul 15 16:22:45.899735 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:45.899700    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b8a9318d-cf80-49a6-924e-ad1d5970adb4/prometheus/0.log"
Jul 15 16:22:45.921361 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:45.921331    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b8a9318d-cf80-49a6-924e-ad1d5970adb4/config-reloader/0.log"
Jul 15 16:22:45.945643 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:45.945616    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b8a9318d-cf80-49a6-924e-ad1d5970adb4/thanos-sidecar/0.log"
Jul 15 16:22:45.972378 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:45.972350    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b8a9318d-cf80-49a6-924e-ad1d5970adb4/kube-rbac-proxy-web/0.log"
Jul 15 16:22:45.995881 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:45.995851    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b8a9318d-cf80-49a6-924e-ad1d5970adb4/kube-rbac-proxy/0.log"
Jul 15 16:22:46.020810 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:46.020780    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b8a9318d-cf80-49a6-924e-ad1d5970adb4/kube-rbac-proxy-thanos/0.log"
Jul 15 16:22:46.043304 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:46.043279    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b8a9318d-cf80-49a6-924e-ad1d5970adb4/init-config-reloader/0.log"
Jul 15 16:22:46.163186 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:46.163115    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b4f8cb767-7rxwn_4f0d25b8-054c-418a-b5a3-17f6af9c3d27/telemeter-client/0.log"
Jul 15 16:22:46.185236 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:46.185200    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b4f8cb767-7rxwn_4f0d25b8-054c-418a-b5a3-17f6af9c3d27/reload/0.log"
Jul 15 16:22:46.211160 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:46.211132    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b4f8cb767-7rxwn_4f0d25b8-054c-418a-b5a3-17f6af9c3d27/kube-rbac-proxy/0.log"
Jul 15 16:22:46.250818 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:46.250764    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5bbf459-mlsj9_732570c5-caf8-4854-8a18-50afa143b9b1/thanos-query/0.log"
Jul 15 16:22:46.275093 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:46.275060    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5bbf459-mlsj9_732570c5-caf8-4854-8a18-50afa143b9b1/kube-rbac-proxy-web/0.log"
Jul 15 16:22:46.298640 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:46.298595    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5bbf459-mlsj9_732570c5-caf8-4854-8a18-50afa143b9b1/kube-rbac-proxy/0.log"
Jul 15 16:22:46.320232 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:46.320188    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5bbf459-mlsj9_732570c5-caf8-4854-8a18-50afa143b9b1/prom-label-proxy/0.log"
Jul 15 16:22:46.342091 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:46.342052    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5bbf459-mlsj9_732570c5-caf8-4854-8a18-50afa143b9b1/kube-rbac-proxy-rules/0.log"
Jul 15 16:22:46.365476 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:46.365436    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5bbf459-mlsj9_732570c5-caf8-4854-8a18-50afa143b9b1/kube-rbac-proxy-metrics/0.log"
Jul 15 16:22:47.245893 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.245850    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"]
Jul 15 16:22:47.251706 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.251680    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.263280 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.263245    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"]
Jul 15 16:22:47.348763 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.348721    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2c0fef50-c24d-44af-a67b-705d96798521-podres\") pod \"perf-node-gather-daemonset-86nh4\" (UID: \"2c0fef50-c24d-44af-a67b-705d96798521\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.348978 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.348781    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fk8w\" (UniqueName: \"kubernetes.io/projected/2c0fef50-c24d-44af-a67b-705d96798521-kube-api-access-5fk8w\") pod \"perf-node-gather-daemonset-86nh4\" (UID: \"2c0fef50-c24d-44af-a67b-705d96798521\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.348978 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.348869    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c0fef50-c24d-44af-a67b-705d96798521-sys\") pod \"perf-node-gather-daemonset-86nh4\" (UID: \"2c0fef50-c24d-44af-a67b-705d96798521\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.348978 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.348920    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c0fef50-c24d-44af-a67b-705d96798521-lib-modules\") pod \"perf-node-gather-daemonset-86nh4\" (UID: \"2c0fef50-c24d-44af-a67b-705d96798521\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.349206 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.349032    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2c0fef50-c24d-44af-a67b-705d96798521-proc\") pod \"perf-node-gather-daemonset-86nh4\" (UID: \"2c0fef50-c24d-44af-a67b-705d96798521\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.449910 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.449860    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2c0fef50-c24d-44af-a67b-705d96798521-proc\") pod \"perf-node-gather-daemonset-86nh4\" (UID: \"2c0fef50-c24d-44af-a67b-705d96798521\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.450127 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.449999    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2c0fef50-c24d-44af-a67b-705d96798521-podres\") pod \"perf-node-gather-daemonset-86nh4\" (UID: \"2c0fef50-c24d-44af-a67b-705d96798521\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.450127 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.450026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fk8w\" (UniqueName: \"kubernetes.io/projected/2c0fef50-c24d-44af-a67b-705d96798521-kube-api-access-5fk8w\") pod \"perf-node-gather-daemonset-86nh4\" (UID: \"2c0fef50-c24d-44af-a67b-705d96798521\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.450127 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.450053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c0fef50-c24d-44af-a67b-705d96798521-sys\") pod \"perf-node-gather-daemonset-86nh4\" (UID: \"2c0fef50-c24d-44af-a67b-705d96798521\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.450127 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.450092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c0fef50-c24d-44af-a67b-705d96798521-lib-modules\") pod \"perf-node-gather-daemonset-86nh4\" (UID: \"2c0fef50-c24d-44af-a67b-705d96798521\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.450337 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.450256    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c0fef50-c24d-44af-a67b-705d96798521-lib-modules\") pod \"perf-node-gather-daemonset-86nh4\" (UID: \"2c0fef50-c24d-44af-a67b-705d96798521\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.450337 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.450313    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2c0fef50-c24d-44af-a67b-705d96798521-proc\") pod \"perf-node-gather-daemonset-86nh4\" (UID: \"2c0fef50-c24d-44af-a67b-705d96798521\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.450434 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.450387    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2c0fef50-c24d-44af-a67b-705d96798521-podres\") pod \"perf-node-gather-daemonset-86nh4\" (UID: \"2c0fef50-c24d-44af-a67b-705d96798521\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.450741 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.450720    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c0fef50-c24d-44af-a67b-705d96798521-sys\") pod \"perf-node-gather-daemonset-86nh4\" (UID: \"2c0fef50-c24d-44af-a67b-705d96798521\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.460480 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.460439    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fk8w\" (UniqueName: \"kubernetes.io/projected/2c0fef50-c24d-44af-a67b-705d96798521-kube-api-access-5fk8w\") pod \"perf-node-gather-daemonset-86nh4\" (UID: \"2c0fef50-c24d-44af-a67b-705d96798521\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.565534 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.565424    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:47.784409 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:47.784182    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"]
Jul 15 16:22:47.787315 ip-10-0-135-178 kubenswrapper[2583]: W0715 16:22:47.787276    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2c0fef50_c24d_44af_a67b_705d96798521.slice/crio-a547b2c23b5a7f70a88ac208b20e1084f021d0a4e8aaba0f5bcb6bedf1d674b6 WatchSource:0}: Error finding container a547b2c23b5a7f70a88ac208b20e1084f021d0a4e8aaba0f5bcb6bedf1d674b6: Status 404 returned error can't find the container with id a547b2c23b5a7f70a88ac208b20e1084f021d0a4e8aaba0f5bcb6bedf1d674b6
Jul 15 16:22:48.022773 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:48.022732    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4" event={"ID":"2c0fef50-c24d-44af-a67b-705d96798521","Type":"ContainerStarted","Data":"42ec295b97f77423c777e94ae1459bbc896dd7ad0e73b578a8fb46af2a719b6e"}
Jul 15 16:22:48.022961 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:48.022790    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4" event={"ID":"2c0fef50-c24d-44af-a67b-705d96798521","Type":"ContainerStarted","Data":"a547b2c23b5a7f70a88ac208b20e1084f021d0a4e8aaba0f5bcb6bedf1d674b6"}
Jul 15 16:22:48.022961 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:48.022821    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:48.046061 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:48.046011    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4" podStartSLOduration=1.045993689 podStartE2EDuration="1.045993689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:22:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:22:48.042544922 +0000 UTC m=+2845.451318129" watchObservedRunningTime="2026-07-15 16:22:48.045993689 +0000 UTC m=+2845.454766893"
Jul 15 16:22:50.445862 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:50.445827    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c5xml_6fdde45b-3a66-404d-8787-84e6f3084714/dns/0.log"
Jul 15 16:22:50.469988 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:50.469940    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c5xml_6fdde45b-3a66-404d-8787-84e6f3084714/kube-rbac-proxy/0.log"
Jul 15 16:22:50.579405 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:50.579377    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mwrjx_43c2120c-175e-49b8-9a9d-25fbfcdd6481/dns-node-resolver/0.log"
Jul 15 16:22:51.157345 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:51.157313    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6dd6b6ccfb-npjrm_ded984a8-2d13-4dc2-97ac-72ee9f035b82/registry/0.log"
Jul 15 16:22:51.243257 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:51.243224    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h7fgx_f980a640-3a85-4ec8-a905-20a33aca6a40/node-ca/0.log"
Jul 15 16:22:52.237796 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:52.237764    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47ssgs_21824abc-d876-4956-a30d-9a5cece33df7/istio-proxy/0.log"
Jul 15 16:22:52.526023 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:52.525922    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rfd9v_2b5835d1-1eb9-4459-ab99-254d09aa6138/istio-proxy/0.log"
Jul 15 16:22:52.590233 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:52.590199    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rfd9v_2b5835d1-1eb9-4459-ab99-254d09aa6138/istio-proxy/1.log"
Jul 15 16:22:53.448156 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:53.448117    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8fvlg_3b182ec6-d85a-4859-96d3-eeffbe877dc9/serve-healthcheck-canary/0.log"
Jul 15 16:22:54.038900 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:54.038870    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-86nh4"
Jul 15 16:22:54.095889 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:54.095864    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ggmcc_3c8a4344-4412-43ef-8c3a-160e358c4a9d/kube-rbac-proxy/0.log"
Jul 15 16:22:54.120918 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:54.120887    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ggmcc_3c8a4344-4412-43ef-8c3a-160e358c4a9d/exporter/0.log"
Jul 15 16:22:54.146248 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:54.146214    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ggmcc_3c8a4344-4412-43ef-8c3a-160e358c4a9d/extractor/0.log"
Jul 15 16:22:56.640833 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:56.640746    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fpj28_3f025f0d-bd71-401d-84ff-326c92e4c7bb/manager/0.log"
Jul 15 16:22:56.904771 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:56.904625    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vtkwv_803ad9e4-3bf5-4580-ad57-18fa30dc1bc4/manager/0.log"
Jul 15 16:22:57.294487 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:57.294456    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ccf5c88b7-n7p28_a8a4b832-c988-46d1-b06b-8289aee8d3ef/manager/0.log"
Jul 15 16:22:57.294725 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:57.294703    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47ssgs_21824abc-d876-4956-a30d-9a5cece33df7/istio-proxy/0.log"
Jul 15 16:22:57.316896 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:57.316867    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ccf5c88b7-n7p28_a8a4b832-c988-46d1-b06b-8289aee8d3ef/copy-manifests/0.log"
Jul 15 16:22:57.590281 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:57.590196    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rfd9v_2b5835d1-1eb9-4459-ab99-254d09aa6138/istio-proxy/0.log"
Jul 15 16:22:57.651345 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:57.651313    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rfd9v_2b5835d1-1eb9-4459-ab99-254d09aa6138/istio-proxy/1.log"
Jul 15 16:22:58.844604 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:58.844570    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c74867c7d-ppldf_ef7a378b-6546-47b3-97f9-e24614a10e4e/manager/0.log"
Jul 15 16:22:58.982530 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:58.982500    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47ssgs_21824abc-d876-4956-a30d-9a5cece33df7/istio-proxy/0.log"
Jul 15 16:22:59.232519 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:59.232488    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rfd9v_2b5835d1-1eb9-4459-ab99-254d09aa6138/istio-proxy/0.log"
Jul 15 16:22:59.287971 ip-10-0-135-178 kubenswrapper[2583]: I0715 16:22:59.287925    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rfd9v_2b5835d1-1eb9-4459-ab99-254d09aa6138/istio-proxy/1.log"