Jul 02 20:30:41.653249 ip-10-0-133-123 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 02 20:30:41.653260 ip-10-0-133-123 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 02 20:30:41.653267 ip-10-0-133-123 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 02 20:30:41.653479 ip-10-0-133-123 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 02 20:30:52.165076 ip-10-0-133-123 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 02 20:30:52.165089 ip-10-0-133-123 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 02baa204bb0b4664be036439228e68d8 --
Jul 02 20:32:35.777117 ip-10-0-133-123 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 20:32:36.099106 ip-10-0-133-123 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 20:32:36.099106 ip-10-0-133-123 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 20:32:36.099106 ip-10-0-133-123 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 20:32:36.099106 ip-10-0-133-123 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 20:32:36.099106 ip-10-0-133-123 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 20:32:36.101542 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.101419    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 20:32:36.106725 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106705    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:36.106725 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106725    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106730    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106734    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106738    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106741    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106744    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106747    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106750    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106764    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106768    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106771    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106774    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106777    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106780    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106783    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106786    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106789    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106791    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106794    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:36.106808 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106797    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106799    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106802    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106805    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106808    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106811    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106814    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106817    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106820    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106823    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106826    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106842    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106845    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106850    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106852    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106855    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106858    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106863    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106867    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:36.107300 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106870    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106873    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106877    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106880    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106884    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106887    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106890    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106893    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106895    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106898    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106901    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106904    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106907    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106909    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106912    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106916    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106919    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106922    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106924    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106927    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:36.107812 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106930    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106933    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106935    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106938    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106940    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106943    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106946    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106950    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106953    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106957    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106959    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106962    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106965    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106967    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106970    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106972    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106975    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106978    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106981    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:36.108358 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106985    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106988    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106991    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106994    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106997    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.106999    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107002    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107005    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107009    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107012    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107014    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107017    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107019    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107022    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107025    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107028    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107030    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107033    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107036    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107040    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:36.108843 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107042    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107851    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107859    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107863    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107866    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107870    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107873    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107876    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107879    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107882    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107885    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107887    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107890    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107893    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107895    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107898    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107901    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107905    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107909    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:36.109353 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107913    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107917    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107920    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107923    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107925    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107928    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107931    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107933    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107936    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107939    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107941    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107945    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107947    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107951    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107953    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107956    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107959    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107961    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107964    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107967    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:36.109896 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107969    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107972    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107975    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107978    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107981    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107984    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107988    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107990    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107993    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107996    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.107998    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108001    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108004    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108008    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108010    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108013    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108016    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108018    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108021    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:36.110446 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108026    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108029    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108033    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108036    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108038    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108041    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108044    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108048    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108051    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108054    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108057    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108059    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108062    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108065    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108069    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108072    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108074    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108077    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108080    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:36.110947 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108082    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108085    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108088    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108090    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108093    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108096    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108099    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108103    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108106    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108109    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108111    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108115    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108119    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108122    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108125    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108128    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108131    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108133    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108136    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108140    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108143    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:36.111440 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108146    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.108149    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109336    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109343    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109347    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109350    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109353    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109356    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109360    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109363    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109366    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109370    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109372    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109375    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109378    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109381    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109384    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109387    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109390    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109393    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:36.111982 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109396    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109399    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109402    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109405    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109407    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109410    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109413    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109416    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109419    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109422    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109425    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109427    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109431    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109433    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109436    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109439    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109442    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109444    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109447    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109449    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:36.112510 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109452    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109455    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109458    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109462    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109465    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109468    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109470    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109473    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109475    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109478    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109481    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109483    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109486    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109488    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109491    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109494    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109496    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109499    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109502    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109504    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:36.113032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109507    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109510    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109512    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109516    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109520    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109523    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109526    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109529    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109532    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109534    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109537    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109541    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109545    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109548    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109551    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109554    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109558    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109561    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109563    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:36.113544 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109566    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109569    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109571    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109575    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109578    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109581    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109584    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109586    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109589    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109592    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109594    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109597    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109600    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109602    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109605    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109609    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109612    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109615    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109619    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:36.114042 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109622    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109625    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.109628    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109714    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109725    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109736    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109744    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109750    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109753    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109758    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109763    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109767    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109770    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109774    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109778    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109781    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109785    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109788    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109791    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109794    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109798    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109802    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109805    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109808    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 20:32:36.114522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109811    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109815    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109819    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109822    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109825    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109842    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109846    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109849    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109853    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109857    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109860    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109865    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109868    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109871    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109874    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109877    2565 flags.go:64] FLAG: --enable-server="true"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109880    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109885    2565 flags.go:64] FLAG: --event-burst="100"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109889    2565 flags.go:64] FLAG: --event-qps="50"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109892    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109895    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109898    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109902    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109905    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109909    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 20:32:36.115163 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109913    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109916    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109919    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109923    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109926    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109929    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109932    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109935    2565 flags.go:64] FLAG: --feature-gates=""
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109939    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109942    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109945    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109948    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109951    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109954    2565 flags.go:64] FLAG: --help="false"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109957    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109964    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109967    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109970    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109974    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109978    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109981    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109984    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109987    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 20:32:36.115818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109990    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109993    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.109997    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110000    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110002    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110005    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110008    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110011    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110015    2565 flags.go:64] FLAG: --lock-file=""
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110018    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110021    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110024    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110030    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110033    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110036    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110038    2565 flags.go:64] FLAG: --logging-format="text"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110041    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110045    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110048    2565 flags.go:64] FLAG: --manifest-url=""
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110051    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110055    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110059    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110063    2565 flags.go:64] FLAG: --max-pods="110"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110066    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110070    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 20:32:36.116479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110073    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110076    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110081    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110084    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110087    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110095    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110099    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110103    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110106    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110109    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110115    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110118    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110122    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110125    2565 flags.go:64] FLAG: --port="10250"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110128    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110132    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0657fe647b9786ece"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110135    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110138    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110141    2565 flags.go:64] FLAG: --register-node="true"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110144    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110148    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110151    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110155    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110158    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110161    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 20:32:36.117137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110165    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110168    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110171    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110174    2565 flags.go:64] FLAG: --runonce="false"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110177    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110180    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110183    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110188    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110191    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110194    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110200    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110203    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110208    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110212    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110214    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110217    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110220    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110223    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110227    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110232    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110235    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110238    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110243    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110246    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110249    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 20:32:36.117780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110252    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110255    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110258    2565 flags.go:64] FLAG: --v="2"
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110262    2565 flags.go:64] FLAG: --version="false"
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110266    2565 flags.go:64] FLAG: --vmodule=""
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110270    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.110273    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110408    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110412    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110416    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110419    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110422    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110425    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110428    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110433    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110436    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110438    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110442    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110445    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110452    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110455    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:36.118455 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110459    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110462    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110465    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110468    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110471    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110475    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110478    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110481    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110484    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110487    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110490    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110493    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110496    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110498    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110501    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110504    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110507    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110509    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110512    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110515    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110518    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:36.119348 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110520    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110523    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110526    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110529    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110533    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110536    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110539    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110541    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110544    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110558    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110561    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110564    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110568    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110571    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110574    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110576    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110579    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110582    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110584    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:36.120026 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110587    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110589    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110592    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110596    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110598    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110601    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110604    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110607    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110610    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110612    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110616    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110618    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110621    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110624    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110626    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110629    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110631    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110636    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110641    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:36.120571 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110644    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110647    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110650    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110657    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110666    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110670    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110673    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110676    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110678    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110681    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110684    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110687    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110689    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110692    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110695    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110697    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110700    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110703    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110706    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110708    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:36.121210 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110711    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:36.121719 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110713    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:36.121719 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110716    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:36.121719 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110719    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:36.121719 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110722    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:36.121719 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.110725    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:36.121719 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.111334    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 20:32:36.121719 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.120097    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 20:32:36.121719 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.120115    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 20:32:36.121719 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.120137    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 20:32:36.121719 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.120144    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 20:32:36.121719 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120207    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:36.121719 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120213    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:36.121719 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120217    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:36.121719 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120221    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120224    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120227    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120230    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120233    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120236    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120239    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120242    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120245    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120248    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120253    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120259    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120263    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120266    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120270    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120273    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120276    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120279    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120282    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:36.122117 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120284    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120288    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120290    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120293    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120296    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120299    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120302    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120306    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120308    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120311    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120314    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120317    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120321    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120323    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120326    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120329    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120332    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120335    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120337    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120340    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:36.122602 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120343    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120345    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120348    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120351    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120354    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120357    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120360    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120363    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120365    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120368    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120371    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120373    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120376    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120379    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120381    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120384    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120388    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120392    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120395    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:36.123126 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120398    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120401    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120405    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120408    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120411    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120415    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120418    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120421    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120424    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120427    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120430    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120433    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120436    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120439    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120442    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120445    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120448    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120451    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120455    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120458    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:36.123626 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120461    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120464    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120467    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120470    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120472    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120475    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120478    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120480    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120484    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120486    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120489    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120491    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120495    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120498    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120501    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120504    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120506    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:36.124158 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120509    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:36.124587 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.120514    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 20:32:36.124587 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120642    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:36.124587 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120648    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:36.124587 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120652    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:36.124587 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120655    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:36.124587 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120658    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:36.124587 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120661    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:36.124587 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120664    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:36.124587 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120667    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:36.124587 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120670    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:36.124587 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120673    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:36.124587 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120676    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:36.124587 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120679    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:36.124587 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120686    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:36.124587 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120690    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120695    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120698    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120702    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120706    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120709    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120712    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120715    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120719    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120722    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120725    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120728    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120731    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120735    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120737    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120740    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120743    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120746    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120748    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:36.125002 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120751    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120754    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120758    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120762    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120764    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120767    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120770    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120773    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120775    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120778    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120781    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120784    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120787    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120790    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120793    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120796    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120798    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120801    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120803    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120806    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:36.125491 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120809    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120812    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120814    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120817    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120820    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120823    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120826    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120850    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120853    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120856    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120859    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120862    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120865    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120867    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120870    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120873    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120876    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120879    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120882    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120885    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:36.126018 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120887    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120890    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120893    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120896    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120899    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120902    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120906    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120910    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120913    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120916    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120918    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120921    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120924    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120926    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120929    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120932    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120935    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120938    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120941    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120943    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:36.126554 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120946    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:36.127076 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120949    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:36.127076 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120952    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:36.127076 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120955    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:36.127076 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120957    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:36.127076 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120960    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:36.127076 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:36.120962    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:36.127076 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.120968    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 20:32:36.127076 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.121100    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 20:32:36.127076 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.124030    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 20:32:36.127076 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.125302    2565 server.go:1019] "Starting client certificate rotation"
Jul 02 20:32:36.127076 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.125406    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 20:32:36.127076 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.125446    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 20:32:36.127644 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.127628    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 20:32:36.130876 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.130857    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 20:32:36.140467 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.140448    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 02 20:32:36.145136 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.145117    2565 log.go:25] "Validated CRI v1 image API"
Jul 02 20:32:36.146090 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.146070    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 20:32:36.148390 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.148369    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7bb2b5f1-4f75-4c84-a9c3-401f763e53ee:/dev/nvme0n1p3 f3b972cf-926b-45cc-b8a4-1a7bdec336e5:/dev/nvme0n1p4]
Jul 02 20:32:36.148487 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.148388    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 20:32:36.155093 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.154962    2565 manager.go:216] Machine: {Timestamp:2026-07-02 20:32:36.153763074 +0000 UTC m=+0.276774639 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100713 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24536b9ee67517221e2312fb857d96 SystemUUID:ec24536b-9ee6-7517-221e-2312fb857d96 BootID:02baa204-bb0b-4664-be03-6439228e68d8 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fb:02:0e:5c:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fb:02:0e:5c:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:95:c5:fb:7a:c0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 20:32:36.155093 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.155084    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 20:32:36.155209 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.155177    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 20:32:36.157410 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.157382    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 20:32:36.157567 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.157413    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-123.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 20:32:36.158334 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.158217    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 20:32:36.158334 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.158268    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 20:32:36.158334 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.158280    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 20:32:36.158955 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.158884    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 20:32:36.159841 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.159812    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 20:32:36.160369 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.160353    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 20:32:36.164569 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.164555    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 20:32:36.164696 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.164686    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 20:32:36.164737 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.164720    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 20:32:36.164737 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.164732    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 20:32:36.164802 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.164747    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 20:32:36.164802 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.164758    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 02 20:32:36.164802 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.164767    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 20:32:36.165162 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.165150    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 20:32:36.165209 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.165170    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 20:32:36.167670 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.167649    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 20:32:36.169616 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.169602    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 20:32:36.169672 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.169635    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 20:32:36.170733 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.170720    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 20:32:36.170788 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.170738    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 20:32:36.170788 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.170746    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 20:32:36.170788 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.170751    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 20:32:36.170788 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.170760    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 20:32:36.170788 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.170766    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 20:32:36.170788 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.170774    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 20:32:36.170788 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.170780    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 20:32:36.170788 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.170786    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 20:32:36.170788 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.170792    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 20:32:36.171057 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.170801    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 20:32:36.171057 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.170807    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 20:32:36.171448 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.171436    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 20:32:36.171479 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.171448    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 20:32:36.175169 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.175110    2565 server.go:1268] "Started kubelet"
Jul 02 20:32:36.175275 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.175219    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 20:32:36.175637 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.175573    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 20:32:36.175711 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.175660    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 20:32:36.176033 ip-10-0-133-123 systemd[1]: Started Kubernetes Kubelet.
Jul 02 20:32:36.177496 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.177473    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 20:32:36.177957 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.177941    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 20:32:36.179417 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.179395    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-123.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 20:32:36.179417 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.179389    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 20:32:36.179669 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.179647    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 20:32:36.180376 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.179580    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-123.ec2.internal.18be93347faf63cc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-123.ec2.internal,UID:ip-10-0-133-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-123.ec2.internal,},FirstTimestamp:2026-07-02 20:32:36.175078348 +0000 UTC m=+0.298089913,LastTimestamp:2026-07-02 20:32:36.175078348 +0000 UTC m=+0.298089913,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-123.ec2.internal,}"
Jul 02 20:32:36.180376 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.180358    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 20:32:36.184026 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.184010    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 20:32:36.184582 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.184568    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 20:32:36.184677 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.184665    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found"
Jul 02 20:32:36.185242 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.185155    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 20:32:36.185242 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.185171    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 20:32:36.185433 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.185328    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 20:32:36.185433 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.185337    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 20:32:36.185433 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.185410    2565 factory.go:55] Registering systemd factory
Jul 02 20:32:36.185433 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.185428    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 02 20:32:36.185702 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.185686    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 20:32:36.185782 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.185691    2565 factory.go:153] Registering CRI-O factory
Jul 02 20:32:36.185916 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.185787    2565 factory.go:223] Registration of the crio container factory successfully
Jul 02 20:32:36.185916 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.185869    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 20:32:36.185916 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.185900    2565 factory.go:103] Registering Raw factory
Jul 02 20:32:36.185916 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.185915    2565 manager.go:1196] Started watching for new ooms in manager
Jul 02 20:32:36.186957 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.186931    2565 manager.go:349] Starting recovery of all containers
Jul 02 20:32:36.188147 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.188106    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 20:32:36.188259 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.188239    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 20:32:36.200249 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.200228    2565 manager.go:354] Recovery completed
Jul 02 20:32:36.204583 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.204566    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:36.207409 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.207387    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:36.207508 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.207422    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:36.207508 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.207433    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:36.208059 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.208043    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 20:32:36.208059 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.208057    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 20:32:36.208187 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.208063    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:36.208187 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.208074    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 20:32:36.208919 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.208902    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:36.208996 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.208937    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:36.208996 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.208953    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:36.210382 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.210368    2565 policy_none.go:49] "None policy: Start"
Jul 02 20:32:36.210448 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.210385    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 20:32:36.210448 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.210413    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 20:32:36.212557 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.212545    2565 policy_none.go:47] "Start"
Jul 02 20:32:36.217148 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.217051    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-123.ec2.internal.18be9334819cb248  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-123.ec2.internal,UID:ip-10-0-133-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-123.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-123.ec2.internal,},FirstTimestamp:2026-07-02 20:32:36.207407688 +0000 UTC m=+0.330419252,LastTimestamp:2026-07-02 20:32:36.207407688 +0000 UTC m=+0.330419252,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-123.ec2.internal,}"
Jul 02 20:32:36.222002 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.221976    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k4p28"
Jul 02 20:32:36.222318 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.222211    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-123.ec2.internal.18be9334819cfebe  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-123.ec2.internal,UID:ip-10-0-133-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-123.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-123.ec2.internal,},FirstTimestamp:2026-07-02 20:32:36.207427262 +0000 UTC m=+0.330438828,LastTimestamp:2026-07-02 20:32:36.207427262 +0000 UTC m=+0.330438828,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-123.ec2.internal,}"
Jul 02 20:32:36.228679 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.228513    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k4p28"
Jul 02 20:32:36.231096 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.231009    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-123.ec2.internal.18be9334819d2800  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-123.ec2.internal,UID:ip-10-0-133-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-123.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-123.ec2.internal,},FirstTimestamp:2026-07-02 20:32:36.207437824 +0000 UTC m=+0.330449388,LastTimestamp:2026-07-02 20:32:36.207437824 +0000 UTC m=+0.330449388,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-123.ec2.internal,}"
Jul 02 20:32:36.254555 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.254534    2565 manager.go:337] "Starting Device Plugin manager"
Jul 02 20:32:36.254690 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.254582    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 20:32:36.254690 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.254597    2565 server.go:87] "Starting device plugin registration server"
Jul 02 20:32:36.254945 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.254930    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 20:32:36.255076 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.254947    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 20:32:36.255076 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.255047    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 20:32:36.255164 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.255137    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 20:32:36.255164 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.255147    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 20:32:36.255733 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.255712    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 20:32:36.255865 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.255759    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-123.ec2.internal\" not found"
Jul 02 20:32:36.290982 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.290946    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 20:32:36.299631 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.292237    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 20:32:36.299631 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.292288    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 20:32:36.299631 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.292324    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 20:32:36.299631 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.292372    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 20:32:36.299631 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.294896    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 20:32:36.355980 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.355946    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:36.356986 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.356967    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:36.357096 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.357005    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:36.357096 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.357022    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:36.357096 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.357054    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.367196 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.367168    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.367342 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.367204    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-123.ec2.internal\": node \"ip-10-0-133-123.ec2.internal\" not found"
Jul 02 20:32:36.393559 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.393524    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal"]
Jul 02 20:32:36.393731 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.393609    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:36.395438 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.395418    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:36.395539 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.395453    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:36.395539 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.395465    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:36.397925 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.397901    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:36.398025 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.398010    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.398065 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.398039    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:36.398800 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.398785    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:36.398903 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.398818    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:36.398903 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.398772    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:36.398903 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.398832    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:36.398903 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.398848    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:36.398903 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.398859    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:36.400065 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.400047    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found"
Jul 02 20:32:36.401410 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.401392    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.401504 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.401432    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:36.402237 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.402222    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:36.402314 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.402245    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:36.402314 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.402255    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:36.415471 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.415449    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-123.ec2.internal\" not found" node="ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.420316 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.420290    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-123.ec2.internal\" not found" node="ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.500536 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.500445    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found"
Jul 02 20:32:36.586892 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.586847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2371af2c29d1ce0a80068ede78c8a9e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal\" (UID: \"2371af2c29d1ce0a80068ede78c8a9e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.587048 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.586910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2371af2c29d1ce0a80068ede78c8a9e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal\" (UID: \"2371af2c29d1ce0a80068ede78c8a9e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.587048 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.586956    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/74288498fb0c2498191bac60d7d7a2bd-config\") pod \"kube-apiserver-proxy-ip-10-0-133-123.ec2.internal\" (UID: \"74288498fb0c2498191bac60d7d7a2bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.601005 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.600966    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found"
Jul 02 20:32:36.687078 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.687038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/74288498fb0c2498191bac60d7d7a2bd-config\") pod \"kube-apiserver-proxy-ip-10-0-133-123.ec2.internal\" (UID: \"74288498fb0c2498191bac60d7d7a2bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.687219 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.687088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2371af2c29d1ce0a80068ede78c8a9e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal\" (UID: \"2371af2c29d1ce0a80068ede78c8a9e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.687219 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.687107    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/74288498fb0c2498191bac60d7d7a2bd-config\") pod \"kube-apiserver-proxy-ip-10-0-133-123.ec2.internal\" (UID: \"74288498fb0c2498191bac60d7d7a2bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.687219 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.687119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2371af2c29d1ce0a80068ede78c8a9e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal\" (UID: \"2371af2c29d1ce0a80068ede78c8a9e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.687219 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.687159    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2371af2c29d1ce0a80068ede78c8a9e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal\" (UID: \"2371af2c29d1ce0a80068ede78c8a9e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.687219 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.687182    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2371af2c29d1ce0a80068ede78c8a9e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal\" (UID: \"2371af2c29d1ce0a80068ede78c8a9e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.701681 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.701647    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found"
Jul 02 20:32:36.719118 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.719083    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.724601 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:36.724493    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal"
Jul 02 20:32:36.802571 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.802467    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found"
Jul 02 20:32:36.902917 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:36.902866    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found"
Jul 02 20:32:37.003077 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:37.003034    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found"
Jul 02 20:32:37.103736 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:37.103698    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found"
Jul 02 20:32:37.125298 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:37.125271    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 20:32:37.125456 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:37.125437    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 20:32:37.204560 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:37.204531    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found"
Jul 02 20:32:37.232362 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:37.232322    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 20:27:36 +0000 UTC" deadline="2028-04-01 19:36:03.319643896 +0000 UTC"
Jul 02 20:32:37.232362 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:37.232357    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15335h3m26.087290868s"
Jul 02 20:32:37.305264 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:37.305237    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found"
Jul 02 20:32:37.369612 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:37.369521    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:37.371083 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:37.371059    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:37.371225 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:37.371093    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:37.371225 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:37.371108    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:37.378710 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:37.378680    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 20:32:37.383414 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:37.383379    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2371af2c29d1ce0a80068ede78c8a9e5.slice/crio-208eef57a96e8d24e5bc784ad003b23c796a05b4b3fd6e8fab8269dcdbe6df58 WatchSource:0}: Error finding container 208eef57a96e8d24e5bc784ad003b23c796a05b4b3fd6e8fab8269dcdbe6df58: Status 404 returned error can't find the container with id 208eef57a96e8d24e5bc784ad003b23c796a05b4b3fd6e8fab8269dcdbe6df58
Jul 02 20:32:37.384003 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:37.383982    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74288498fb0c2498191bac60d7d7a2bd.slice/crio-e0b025c20db6bcb533d33090179b541b71722bbfea44cc367af1c86bdd2e0dfb WatchSource:0}: Error finding container e0b025c20db6bcb533d33090179b541b71722bbfea44cc367af1c86bdd2e0dfb: Status 404 returned error can't find the container with id e0b025c20db6bcb533d33090179b541b71722bbfea44cc367af1c86bdd2e0dfb
Jul 02 20:32:37.388808 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:37.388791    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:32:37.405900 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:37.405876    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found"
Jul 02 20:32:37.469409 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:37.469379    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 20:32:37.485423 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:37.485389    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal"
Jul 02 20:32:37.497118 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:37.497095    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 20:32:37.497964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:37.497949    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal"
Jul 02 20:32:37.521944 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:37.521913    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 20:32:37.633573 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:37.633488    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 20:32:38.167659 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.167613    2565 apiserver.go:52] "Watching apiserver"
Jul 02 20:32:38.177440 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.177406    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 20:32:38.178728 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.178697    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-sfbr9","openshift-network-operator/iptables-alerter-q7nrh","openshift-ovn-kubernetes/ovnkube-node-pknqr","kube-system/global-pull-secret-syncer-n5bj2","kube-system/konnectivity-agent-8r9rr","kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz","openshift-cluster-node-tuning-operator/tuned-cnxsl","openshift-dns/node-resolver-m5mhl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal","openshift-multus/network-metrics-daemon-swrg9","openshift-image-registry/node-ca-x26xq","openshift-multus/multus-additional-cni-plugins-zf9bn","openshift-multus/multus-k8rtk"]
Jul 02 20:32:38.181846 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.181818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:38.181974 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:38.181927    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:32:38.184058 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.184037    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q7nrh"
Jul 02 20:32:38.184807 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.184583    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 20:32:38.188784 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.188380    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.189484 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.189151    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 20:32:38.189484 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.189188    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 20:32:38.189484 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.189156    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:32:38.189484 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.189217    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.189742 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.189549    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gx6tw\""
Jul 02 20:32:38.191744 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.191726    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.193072 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.192971    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 20:32:38.193171 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.193086    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 20:32:38.193171 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.193087    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 20:32:38.194000 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.193739    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 20:32:38.194810 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.194793    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 20:32:38.195089 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.194904    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 20:32:38.195089 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.195059    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gg7c4\""
Jul 02 20:32:38.195089 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.195089    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 20:32:38.195322 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.195112    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fdqfk\""
Jul 02 20:32:38.195322 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.195233    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 20:32:38.195322 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.195268    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 20:32:38.195515 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.195322    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 20:32:38.195515 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.195451    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x26xq"
Jul 02 20:32:38.195617 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.195517    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 20:32:38.195617 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.195523    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 20:32:38.196662 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.196638    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x7j6k\""
Jul 02 20:32:38.198264 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.197960    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:38.198264 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:38.198050    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:32:38.199675 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199113    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 20:32:38.199675 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199352    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-systemd-units\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.199675 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-cni-netd\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.199675 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-multus-cni-dir\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.199675 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199450    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-var-lib-cni-multus\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.199675 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-hostroot\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.199675 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199524    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs\") pod \"network-metrics-daemon-swrg9\" (UID: \"888788da-c29d-4687-a880-bcbbd7bfa01f\") " pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:38.199675 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk8ws\" (UniqueName: \"kubernetes.io/projected/ea72b244-bdcf-4851-b87d-62845cf30403-kube-api-access-kk8ws\") pod \"iptables-alerter-q7nrh\" (UID: \"ea72b244-bdcf-4851-b87d-62845cf30403\") " pod="openshift-network-operator/iptables-alerter-q7nrh"
Jul 02 20:32:38.199675 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-run-netns\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.199675 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-run-systemd\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.200289 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199711    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-node-log\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.200289 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.200289 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea72b244-bdcf-4851-b87d-62845cf30403-iptables-alerter-script\") pod \"iptables-alerter-q7nrh\" (UID: \"ea72b244-bdcf-4851-b87d-62845cf30403\") " pod="openshift-network-operator/iptables-alerter-q7nrh"
Jul 02 20:32:38.200289 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-run-openvswitch\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.200289 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199949    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.200289 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199984    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0d5f826-a176-4167-b921-e05de73d1825-cni-binary-copy\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.200289 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.199993    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 20:32:38.200289 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.200010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-run-k8s-cni-cncf-io\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.200289 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.200043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-multus-conf-dir\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.200289 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.200075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0d5f826-a176-4167-b921-e05de73d1825-multus-daemon-config\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.200778 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.200314    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 20:32:38.200778 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.200332    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m2hn4\""
Jul 02 20:32:38.200778 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.200632    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.200953 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.200797    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-kubelet\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.200953 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.200880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-log-socket\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.200953 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.200935    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/764de1f9-bd56-4aea-9e76-98452d3ae9a3-ovnkube-config\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.201105 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.200978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-etc-kubernetes\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.201105 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.201012    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-cni-bin\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.201105 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.201047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-multus-socket-dir-parent\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.201250 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.201129    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-run-netns\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.201250 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.201163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-var-lib-kubelet\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.201250 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.201196    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/764de1f9-bd56-4aea-9e76-98452d3ae9a3-ovnkube-script-lib\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.201250 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.201231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea72b244-bdcf-4851-b87d-62845cf30403-host-slash\") pod \"iptables-alerter-q7nrh\" (UID: \"ea72b244-bdcf-4851-b87d-62845cf30403\") " pod="openshift-network-operator/iptables-alerter-q7nrh"
Jul 02 20:32:38.201448 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.201263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-etc-openvswitch\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.201550 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.201492    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-run-ovn\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.201712 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.201695    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-os-release\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.201873 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.201853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqgj8\" (UniqueName: \"kubernetes.io/projected/764de1f9-bd56-4aea-9e76-98452d3ae9a3-kube-api-access-jqgj8\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.202010 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.201994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcrbb\" (UniqueName: \"kubernetes.io/projected/888788da-c29d-4687-a880-bcbbd7bfa01f-kube-api-access-zcrbb\") pod \"network-metrics-daemon-swrg9\" (UID: \"888788da-c29d-4687-a880-bcbbd7bfa01f\") " pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:38.202152 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.202136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-var-lib-openvswitch\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.202262 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.202242    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/764de1f9-bd56-4aea-9e76-98452d3ae9a3-env-overrides\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.202386 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.202370    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-var-lib-cni-bin\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.202856 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.202842    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-run-multus-certs\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.203019 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.203002    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs9vd\" (UniqueName: \"kubernetes.io/projected/e0d5f826-a176-4167-b921-e05de73d1825-kube-api-access-cs9vd\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.203108 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.203033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-slash\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.203108 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.203058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/764de1f9-bd56-4aea-9e76-98452d3ae9a3-ovn-node-metrics-cert\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.203108 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.203082    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-system-cni-dir\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.203108 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.203105    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-cnibin\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.203655 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.203637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.204055 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.204023    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:32:38.204571 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.204370    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 20:32:38.204571 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.204429    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mbtsz\""
Jul 02 20:32:38.204571 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.204481    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 20:32:38.206692 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.206260    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m5mhl"
Jul 02 20:32:38.210261 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.209008    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 20:32:38.210261 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.209313    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 20:32:38.210261 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.209652    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 20:32:38.210261 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.209660    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-md9hq\""
Jul 02 20:32:38.210261 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.209709    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 20:32:38.210261 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.209907    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8r9rr"
Jul 02 20:32:38.210566 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.210395    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 20:32:38.210662 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.210620    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2z2jx\""
Jul 02 20:32:38.212932 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.212580    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:38.212932 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:38.212649    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:32:38.214520 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.214498    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 20:32:38.214874 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.214857    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 20:32:38.215117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.215100    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b6w8h\""
Jul 02 20:32:38.240382 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.240352    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kcdsm"
Jul 02 20:32:38.249930 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.249900    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kcdsm"
Jul 02 20:32:38.287567 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.287535    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 20:32:38.301118 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.301057    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" event={"ID":"2371af2c29d1ce0a80068ede78c8a9e5","Type":"ContainerStarted","Data":"208eef57a96e8d24e5bc784ad003b23c796a05b4b3fd6e8fab8269dcdbe6df58"}
Jul 02 20:32:38.303044 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303014    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal" event={"ID":"74288498fb0c2498191bac60d7d7a2bd","Type":"ContainerStarted","Data":"e0b025c20db6bcb533d33090179b541b71722bbfea44cc367af1c86bdd2e0dfb"}
Jul 02 20:32:38.303321 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea72b244-bdcf-4851-b87d-62845cf30403-host-slash\") pod \"iptables-alerter-q7nrh\" (UID: \"ea72b244-bdcf-4851-b87d-62845cf30403\") " pod="openshift-network-operator/iptables-alerter-q7nrh"
Jul 02 20:32:38.303386 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-etc-openvswitch\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.303386 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-run-ovn\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.303480 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-os-release\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.303480 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303431    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfs26\" (UniqueName: \"kubernetes.io/projected/1f6346a1-13f2-49ba-9b76-1fb229b002d3-kube-api-access-bfs26\") pod \"node-resolver-m5mhl\" (UID: \"1f6346a1-13f2-49ba-9b76-1fb229b002d3\") " pod="openshift-dns/node-resolver-m5mhl"
Jul 02 20:32:38.303480 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/58a9c44e-34ad-4112-a08b-48b27fcf339d-agent-certs\") pod \"konnectivity-agent-8r9rr\" (UID: \"58a9c44e-34ad-4112-a08b-48b27fcf339d\") " pod="kube-system/konnectivity-agent-8r9rr"
Jul 02 20:32:38.303588 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303493    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqgj8\" (UniqueName: \"kubernetes.io/projected/764de1f9-bd56-4aea-9e76-98452d3ae9a3-kube-api-access-jqgj8\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.303588 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcrbb\" (UniqueName: \"kubernetes.io/projected/888788da-c29d-4687-a880-bcbbd7bfa01f-kube-api-access-zcrbb\") pod \"network-metrics-daemon-swrg9\" (UID: \"888788da-c29d-4687-a880-bcbbd7bfa01f\") " pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:38.303588 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-var-lib-openvswitch\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.303733 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs9vd\" (UniqueName: \"kubernetes.io/projected/e0d5f826-a176-4167-b921-e05de73d1825-kube-api-access-cs9vd\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.303733 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3eee63fc-ae15-428d-8a57-390c573de403-host\") pod \"node-ca-x26xq\" (UID: \"3eee63fc-ae15-428d-8a57-390c573de403\") " pod="openshift-image-registry/node-ca-x26xq"
Jul 02 20:32:38.303733 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3eee63fc-ae15-428d-8a57-390c573de403-serviceca\") pod \"node-ca-x26xq\" (UID: \"3eee63fc-ae15-428d-8a57-390c573de403\") " pod="openshift-image-registry/node-ca-x26xq"
Jul 02 20:32:38.303733 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7mdq\" (UniqueName: \"kubernetes.io/projected/3eee63fc-ae15-428d-8a57-390c573de403-kube-api-access-h7mdq\") pod \"node-ca-x26xq\" (UID: \"3eee63fc-ae15-428d-8a57-390c573de403\") " pod="openshift-image-registry/node-ca-x26xq"
Jul 02 20:32:38.303733 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303725    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea72b244-bdcf-4851-b87d-62845cf30403-host-slash\") pod \"iptables-alerter-q7nrh\" (UID: \"ea72b244-bdcf-4851-b87d-62845cf30403\") " pod="openshift-network-operator/iptables-alerter-q7nrh"
Jul 02 20:32:38.304069 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-slash\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.304069 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303867    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-slash\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.304069 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303890    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-os-release\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.304069 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303919    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/764de1f9-bd56-4aea-9e76-98452d3ae9a3-ovn-node-metrics-cert\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.304069 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303930    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-etc-openvswitch\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.304069 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-cnibin\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.304069 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.303994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1419c726-721f-4fd9-bfb9-7043d578cf0c-cnibin\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.304069 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304019    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-kubernetes\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.304069 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-sysctl-d\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.304069 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-run\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.304069 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304063    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-var-lib-openvswitch\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.304615 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304138    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-run-ovn\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.304615 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304192    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-cnibin\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.304615 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-host\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.304615 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-systemd-units\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.304615 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-var-lib-cni-multus\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.304615 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-hostroot\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.304615 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304386    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-systemd-units\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.304615 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304433    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-hostroot\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.304615 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304437    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-var-lib-cni-multus\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.304615 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1419c726-721f-4fd9-bfb9-7043d578cf0c-os-release\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.304615 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304472    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-tuned\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.304615 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304462    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 20:32:38.304615 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-tmp\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.304615 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304536    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk8ws\" (UniqueName: \"kubernetes.io/projected/ea72b244-bdcf-4851-b87d-62845cf30403-kube-api-access-kk8ws\") pod \"iptables-alerter-q7nrh\" (UID: \"ea72b244-bdcf-4851-b87d-62845cf30403\") " pod="openshift-network-operator/iptables-alerter-q7nrh"
Jul 02 20:32:38.304615 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-run-netns\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304634    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-run-netns\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304665    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-node-log\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304699    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304797    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f6346a1-13f2-49ba-9b76-1fb229b002d3-tmp-dir\") pod \"node-resolver-m5mhl\" (UID: \"1f6346a1-13f2-49ba-9b76-1fb229b002d3\") " pod="openshift-dns/node-resolver-m5mhl"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304821    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-node-log\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304878    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304888    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-run-k8s-cni-cncf-io\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304925    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-registration-dir\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304973    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-run-k8s-cni-cncf-io\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.304977    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1f6346a1-13f2-49ba-9b76-1fb229b002d3-hosts-file\") pod \"node-resolver-m5mhl\" (UID: \"1f6346a1-13f2-49ba-9b76-1fb229b002d3\") " pod="openshift-dns/node-resolver-m5mhl"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d77247d-e7bf-42d1-9f3f-310fed10b354-kubelet-config\") pod \"global-pull-secret-syncer-n5bj2\" (UID: \"6d77247d-e7bf-42d1-9f3f-310fed10b354\") " pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-log-socket\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305103    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/764de1f9-bd56-4aea-9e76-98452d3ae9a3-ovnkube-config\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.305392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305157    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-log-socket\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305182    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-etc-kubernetes\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305304    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-sysctl-conf\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-cni-bin\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-multus-socket-dir-parent\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-run-netns\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305435    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkpn8\" (UniqueName: \"kubernetes.io/projected/5451dec1-e57e-4836-9797-bb1d91d545e6-kube-api-access-pkpn8\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305463    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1419c726-721f-4fd9-bfb9-7043d578cf0c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305501    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-sysconfig\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305527    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/764de1f9-bd56-4aea-9e76-98452d3ae9a3-ovnkube-script-lib\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/764de1f9-bd56-4aea-9e76-98452d3ae9a3-env-overrides\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-var-lib-cni-bin\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305620    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-run-multus-certs\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305648    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-sys-fs\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-lib-modules\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305736    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-multus-socket-dir-parent\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305759    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/764de1f9-bd56-4aea-9e76-98452d3ae9a3-ovnkube-config\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.306241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305765    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdvcc\" (UniqueName: \"kubernetes.io/projected/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-kube-api-access-hdvcc\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305812    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-cni-bin\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305855    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-etc-kubernetes\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305816    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret\") pod \"global-pull-secret-syncer-n5bj2\" (UID: \"6d77247d-e7bf-42d1-9f3f-310fed10b354\") " pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305893    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-system-cni-dir\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-socket-dir\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305956    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1419c726-721f-4fd9-bfb9-7043d578cf0c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.305983    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k57b\" (UniqueName: \"kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b\") pod \"network-check-target-sfbr9\" (UID: \"c3e0c687-ff13-4f04-a0b8-a69cc711f130\") " pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306025    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-cni-netd\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306066    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-multus-cni-dir\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306093    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306137    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1419c726-721f-4fd9-bfb9-7043d578cf0c-system-cni-dir\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306153    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-system-cni-dir\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306151    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-run-multus-certs\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-systemd\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306189    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-var-lib-cni-bin\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d77247d-e7bf-42d1-9f3f-310fed10b354-dbus\") pod \"global-pull-secret-syncer-n5bj2\" (UID: \"6d77247d-e7bf-42d1-9f3f-310fed10b354\") " pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:38.307117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306200    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-cni-netd\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306206    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-run-netns\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306242    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/764de1f9-bd56-4aea-9e76-98452d3ae9a3-env-overrides\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs\") pod \"network-metrics-daemon-swrg9\" (UID: \"888788da-c29d-4687-a880-bcbbd7bfa01f\") " pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306282    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-multus-cni-dir\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306297    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/764de1f9-bd56-4aea-9e76-98452d3ae9a3-ovnkube-script-lib\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-run-systemd\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-sys\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306344    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-run-systemd\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/58a9c44e-34ad-4112-a08b-48b27fcf339d-konnectivity-ca\") pod \"konnectivity-agent-8r9rr\" (UID: \"58a9c44e-34ad-4112-a08b-48b27fcf339d\") " pod="kube-system/konnectivity-agent-8r9rr"
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:38.306382    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:38.306472    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs podName:888788da-c29d-4687-a880-bcbbd7bfa01f nodeName:}" failed. No retries permitted until 2026-07-02 20:32:38.806439719 +0000 UTC m=+2.929451283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs") pod "network-metrics-daemon-swrg9" (UID: "888788da-c29d-4687-a880-bcbbd7bfa01f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea72b244-bdcf-4851-b87d-62845cf30403-iptables-alerter-script\") pod \"iptables-alerter-q7nrh\" (UID: \"ea72b244-bdcf-4851-b87d-62845cf30403\") " pod="openshift-network-operator/iptables-alerter-q7nrh"
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306561    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-run-openvswitch\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306614    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-run-openvswitch\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0d5f826-a176-4167-b921-e05de73d1825-cni-binary-copy\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-multus-conf-dir\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.308064 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0d5f826-a176-4167-b921-e05de73d1825-multus-daemon-config\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.309023 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306732    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-var-lib-kubelet\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.309023 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306759    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-kubelet\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.309023 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306804    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-device-dir\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.309023 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306837    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh5js\" (UniqueName: \"kubernetes.io/projected/1419c726-721f-4fd9-bfb9-7043d578cf0c-kube-api-access-mh5js\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.309023 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306867    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-var-lib-kubelet\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.309023 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1419c726-721f-4fd9-bfb9-7043d578cf0c-cni-binary-copy\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.309023 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306920    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1419c726-721f-4fd9-bfb9-7043d578cf0c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.309023 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.306944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-modprobe-d\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.309023 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.307040    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-multus-conf-dir\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.309023 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.307193    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea72b244-bdcf-4851-b87d-62845cf30403-iptables-alerter-script\") pod \"iptables-alerter-q7nrh\" (UID: \"ea72b244-bdcf-4851-b87d-62845cf30403\") " pod="openshift-network-operator/iptables-alerter-q7nrh"
Jul 02 20:32:38.309023 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.307271    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0d5f826-a176-4167-b921-e05de73d1825-cni-binary-copy\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.309023 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.307266    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/764de1f9-bd56-4aea-9e76-98452d3ae9a3-host-kubelet\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.309023 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.307340    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0d5f826-a176-4167-b921-e05de73d1825-host-var-lib-kubelet\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.309023 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.307550    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0d5f826-a176-4167-b921-e05de73d1825-multus-daemon-config\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.309752 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.309437    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/764de1f9-bd56-4aea-9e76-98452d3ae9a3-ovn-node-metrics-cert\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.319316 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.319236    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqgj8\" (UniqueName: \"kubernetes.io/projected/764de1f9-bd56-4aea-9e76-98452d3ae9a3-kube-api-access-jqgj8\") pod \"ovnkube-node-pknqr\" (UID: \"764de1f9-bd56-4aea-9e76-98452d3ae9a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.319316 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.319293    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk8ws\" (UniqueName: \"kubernetes.io/projected/ea72b244-bdcf-4851-b87d-62845cf30403-kube-api-access-kk8ws\") pod \"iptables-alerter-q7nrh\" (UID: \"ea72b244-bdcf-4851-b87d-62845cf30403\") " pod="openshift-network-operator/iptables-alerter-q7nrh"
Jul 02 20:32:38.320288 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.320124    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcrbb\" (UniqueName: \"kubernetes.io/projected/888788da-c29d-4687-a880-bcbbd7bfa01f-kube-api-access-zcrbb\") pod \"network-metrics-daemon-swrg9\" (UID: \"888788da-c29d-4687-a880-bcbbd7bfa01f\") " pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:38.322694 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.322659    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs9vd\" (UniqueName: \"kubernetes.io/projected/e0d5f826-a176-4167-b921-e05de73d1825-kube-api-access-cs9vd\") pod \"multus-k8rtk\" (UID: \"e0d5f826-a176-4167-b921-e05de73d1825\") " pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.407510 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1419c726-721f-4fd9-bfb9-7043d578cf0c-os-release\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.407718 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-tuned\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.407718 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-tmp\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.407718 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407580    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.407718 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f6346a1-13f2-49ba-9b76-1fb229b002d3-tmp-dir\") pod \"node-resolver-m5mhl\" (UID: \"1f6346a1-13f2-49ba-9b76-1fb229b002d3\") " pod="openshift-dns/node-resolver-m5mhl"
Jul 02 20:32:38.407718 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-registration-dir\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.407718 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1f6346a1-13f2-49ba-9b76-1fb229b002d3-hosts-file\") pod \"node-resolver-m5mhl\" (UID: \"1f6346a1-13f2-49ba-9b76-1fb229b002d3\") " pod="openshift-dns/node-resolver-m5mhl"
Jul 02 20:32:38.407718 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d77247d-e7bf-42d1-9f3f-310fed10b354-kubelet-config\") pod \"global-pull-secret-syncer-n5bj2\" (UID: \"6d77247d-e7bf-42d1-9f3f-310fed10b354\") " pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:38.407718 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-sysctl-conf\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkpn8\" (UniqueName: \"kubernetes.io/projected/5451dec1-e57e-4836-9797-bb1d91d545e6-kube-api-access-pkpn8\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1419c726-721f-4fd9-bfb9-7043d578cf0c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407768    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-sysconfig\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-sys-fs\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-lib-modules\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407894    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdvcc\" (UniqueName: \"kubernetes.io/projected/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-kube-api-access-hdvcc\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret\") pod \"global-pull-secret-syncer-n5bj2\" (UID: \"6d77247d-e7bf-42d1-9f3f-310fed10b354\") " pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-socket-dir\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1419c726-721f-4fd9-bfb9-7043d578cf0c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.407988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k57b\" (UniqueName: \"kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b\") pod \"network-check-target-sfbr9\" (UID: \"c3e0c687-ff13-4f04-a0b8-a69cc711f130\") " pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1419c726-721f-4fd9-bfb9-7043d578cf0c-system-cni-dir\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-systemd\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408094    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d77247d-e7bf-42d1-9f3f-310fed10b354-dbus\") pod \"global-pull-secret-syncer-n5bj2\" (UID: \"6d77247d-e7bf-42d1-9f3f-310fed10b354\") " pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-sys\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.408202 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408159    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/58a9c44e-34ad-4112-a08b-48b27fcf339d-konnectivity-ca\") pod \"konnectivity-agent-8r9rr\" (UID: \"58a9c44e-34ad-4112-a08b-48b27fcf339d\") " pod="kube-system/konnectivity-agent-8r9rr"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-var-lib-kubelet\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-device-dir\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408226    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1419c726-721f-4fd9-bfb9-7043d578cf0c-os-release\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408245    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh5js\" (UniqueName: \"kubernetes.io/projected/1419c726-721f-4fd9-bfb9-7043d578cf0c-kube-api-access-mh5js\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408292    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1419c726-721f-4fd9-bfb9-7043d578cf0c-system-cni-dir\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408329    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1419c726-721f-4fd9-bfb9-7043d578cf0c-cni-binary-copy\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1419c726-721f-4fd9-bfb9-7043d578cf0c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408396    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-modprobe-d\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408432    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfs26\" (UniqueName: \"kubernetes.io/projected/1f6346a1-13f2-49ba-9b76-1fb229b002d3-kube-api-access-bfs26\") pod \"node-resolver-m5mhl\" (UID: \"1f6346a1-13f2-49ba-9b76-1fb229b002d3\") " pod="openshift-dns/node-resolver-m5mhl"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/58a9c44e-34ad-4112-a08b-48b27fcf339d-agent-certs\") pod \"konnectivity-agent-8r9rr\" (UID: \"58a9c44e-34ad-4112-a08b-48b27fcf339d\") " pod="kube-system/konnectivity-agent-8r9rr"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408465    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f6346a1-13f2-49ba-9b76-1fb229b002d3-tmp-dir\") pod \"node-resolver-m5mhl\" (UID: \"1f6346a1-13f2-49ba-9b76-1fb229b002d3\") " pod="openshift-dns/node-resolver-m5mhl"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408577    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-registration-dir\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408586    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408604    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-systemd\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408644    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d77247d-e7bf-42d1-9f3f-310fed10b354-kubelet-config\") pod \"global-pull-secret-syncer-n5bj2\" (UID: \"6d77247d-e7bf-42d1-9f3f-310fed10b354\") " pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.408778    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-sysctl-conf\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.409125 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:38.408975    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:38.409964 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:38.409075    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret podName:6d77247d-e7bf-42d1-9f3f-310fed10b354 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:38.909051697 +0000 UTC m=+3.032063261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret") pod "global-pull-secret-syncer-n5bj2" (UID: "6d77247d-e7bf-42d1-9f3f-310fed10b354") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:38.409964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409184    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1419c726-721f-4fd9-bfb9-7043d578cf0c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.409964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409274    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-sysconfig\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.409964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409351    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-sys-fs\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.409964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409369    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-socket-dir\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.409964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409460    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-modprobe-d\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.409964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409510    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1419c726-721f-4fd9-bfb9-7043d578cf0c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.409964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409544    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1419c726-721f-4fd9-bfb9-7043d578cf0c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.409964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3eee63fc-ae15-428d-8a57-390c573de403-host\") pod \"node-ca-x26xq\" (UID: \"3eee63fc-ae15-428d-8a57-390c573de403\") " pod="openshift-image-registry/node-ca-x26xq"
Jul 02 20:32:38.409964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3eee63fc-ae15-428d-8a57-390c573de403-serviceca\") pod \"node-ca-x26xq\" (UID: \"3eee63fc-ae15-428d-8a57-390c573de403\") " pod="openshift-image-registry/node-ca-x26xq"
Jul 02 20:32:38.409964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7mdq\" (UniqueName: \"kubernetes.io/projected/3eee63fc-ae15-428d-8a57-390c573de403-kube-api-access-h7mdq\") pod \"node-ca-x26xq\" (UID: \"3eee63fc-ae15-428d-8a57-390c573de403\") " pod="openshift-image-registry/node-ca-x26xq"
Jul 02 20:32:38.409964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409632    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d77247d-e7bf-42d1-9f3f-310fed10b354-dbus\") pod \"global-pull-secret-syncer-n5bj2\" (UID: \"6d77247d-e7bf-42d1-9f3f-310fed10b354\") " pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:38.409964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409641    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1419c726-721f-4fd9-bfb9-7043d578cf0c-cni-binary-copy\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.409964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1419c726-721f-4fd9-bfb9-7043d578cf0c-cnibin\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.409964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-kubernetes\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.409964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409693    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-sys\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.410779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-sysctl-d\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.410779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409708    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5451dec1-e57e-4836-9797-bb1d91d545e6-device-dir\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.410779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-run\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.410779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409752    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3eee63fc-ae15-428d-8a57-390c573de403-host\") pod \"node-ca-x26xq\" (UID: \"3eee63fc-ae15-428d-8a57-390c573de403\") " pod="openshift-image-registry/node-ca-x26xq"
Jul 02 20:32:38.410779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409768    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-host\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.410779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409865    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-host\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.410779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409886    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-sysctl-d\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.410779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409911    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-run\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.410779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409935    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-kubernetes\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.410779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409958    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1f6346a1-13f2-49ba-9b76-1fb229b002d3-hosts-file\") pod \"node-resolver-m5mhl\" (UID: \"1f6346a1-13f2-49ba-9b76-1fb229b002d3\") " pod="openshift-dns/node-resolver-m5mhl"
Jul 02 20:32:38.410779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.409983    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-var-lib-kubelet\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.410779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.410026    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-lib-modules\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.410779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.410036    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1419c726-721f-4fd9-bfb9-7043d578cf0c-cnibin\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.410779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.410226    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3eee63fc-ae15-428d-8a57-390c573de403-serviceca\") pod \"node-ca-x26xq\" (UID: \"3eee63fc-ae15-428d-8a57-390c573de403\") " pod="openshift-image-registry/node-ca-x26xq"
Jul 02 20:32:38.410779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.410475    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/58a9c44e-34ad-4112-a08b-48b27fcf339d-konnectivity-ca\") pod \"konnectivity-agent-8r9rr\" (UID: \"58a9c44e-34ad-4112-a08b-48b27fcf339d\") " pod="kube-system/konnectivity-agent-8r9rr"
Jul 02 20:32:38.411621 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.411592    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/58a9c44e-34ad-4112-a08b-48b27fcf339d-agent-certs\") pod \"konnectivity-agent-8r9rr\" (UID: \"58a9c44e-34ad-4112-a08b-48b27fcf339d\") " pod="kube-system/konnectivity-agent-8r9rr"
Jul 02 20:32:38.412152 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.412131    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-tmp\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.414520 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.414492    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-etc-tuned\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.419123 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:38.419065    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:32:38.419123 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:38.419099    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:32:38.419123 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:38.419114    2565 projected.go:196] Error preparing data for projected volume kube-api-access-2k57b for pod openshift-network-diagnostics/network-check-target-sfbr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:38.419343 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:38.419195    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b podName:c3e0c687-ff13-4f04-a0b8-a69cc711f130 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:38.919173474 +0000 UTC m=+3.042185042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2k57b" (UniqueName: "kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b") pod "network-check-target-sfbr9" (UID: "c3e0c687-ff13-4f04-a0b8-a69cc711f130") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:38.422876 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.422848    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh5js\" (UniqueName: \"kubernetes.io/projected/1419c726-721f-4fd9-bfb9-7043d578cf0c-kube-api-access-mh5js\") pod \"multus-additional-cni-plugins-zf9bn\" (UID: \"1419c726-721f-4fd9-bfb9-7043d578cf0c\") " pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.423221 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.423183    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdvcc\" (UniqueName: \"kubernetes.io/projected/3fae3eab-74e9-49d3-b30d-8e453c8ec65b-kube-api-access-hdvcc\") pod \"tuned-cnxsl\" (UID: \"3fae3eab-74e9-49d3-b30d-8e453c8ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.427587 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.427557    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7mdq\" (UniqueName: \"kubernetes.io/projected/3eee63fc-ae15-428d-8a57-390c573de403-kube-api-access-h7mdq\") pod \"node-ca-x26xq\" (UID: \"3eee63fc-ae15-428d-8a57-390c573de403\") " pod="openshift-image-registry/node-ca-x26xq"
Jul 02 20:32:38.427896 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.427875    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfs26\" (UniqueName: \"kubernetes.io/projected/1f6346a1-13f2-49ba-9b76-1fb229b002d3-kube-api-access-bfs26\") pod \"node-resolver-m5mhl\" (UID: \"1f6346a1-13f2-49ba-9b76-1fb229b002d3\") " pod="openshift-dns/node-resolver-m5mhl"
Jul 02 20:32:38.427994 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.427912    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkpn8\" (UniqueName: \"kubernetes.io/projected/5451dec1-e57e-4836-9797-bb1d91d545e6-kube-api-access-pkpn8\") pod \"aws-ebs-csi-driver-node-8fwrz\" (UID: \"5451dec1-e57e-4836-9797-bb1d91d545e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.466104 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.466070    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 20:32:38.501767 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.501701    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q7nrh"
Jul 02 20:32:38.509884 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.509855    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:32:38.530196 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.530166    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k8rtk"
Jul 02 20:32:38.536387 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.536363    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zf9bn"
Jul 02 20:32:38.546475 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.546441    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x26xq"
Jul 02 20:32:38.555704 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.555675    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cnxsl"
Jul 02 20:32:38.564741 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.564713    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz"
Jul 02 20:32:38.573805 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.573748    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m5mhl"
Jul 02 20:32:38.579757 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.579732    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8r9rr"
Jul 02 20:32:38.812700 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.812609    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs\") pod \"network-metrics-daemon-swrg9\" (UID: \"888788da-c29d-4687-a880-bcbbd7bfa01f\") " pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:38.812902 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:38.812733    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:38.812902 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:38.812804    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs podName:888788da-c29d-4687-a880-bcbbd7bfa01f nodeName:}" failed. No retries permitted until 2026-07-02 20:32:39.812773764 +0000 UTC m=+3.935785314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs") pod "network-metrics-daemon-swrg9" (UID: "888788da-c29d-4687-a880-bcbbd7bfa01f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:38.913807 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:38.913755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret\") pod \"global-pull-secret-syncer-n5bj2\" (UID: \"6d77247d-e7bf-42d1-9f3f-310fed10b354\") " pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:38.913985 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:38.913872    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:38.913985 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:38.913952    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret podName:6d77247d-e7bf-42d1-9f3f-310fed10b354 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:39.913933804 +0000 UTC m=+4.036945359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret") pod "global-pull-secret-syncer-n5bj2" (UID: "6d77247d-e7bf-42d1-9f3f-310fed10b354") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:39.014768 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:39.014713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k57b\" (UniqueName: \"kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b\") pod \"network-check-target-sfbr9\" (UID: \"c3e0c687-ff13-4f04-a0b8-a69cc711f130\") " pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:39.014951 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:39.014893    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:32:39.014951 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:39.014911    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:32:39.014951 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:39.014921    2565 projected.go:196] Error preparing data for projected volume kube-api-access-2k57b for pod openshift-network-diagnostics/network-check-target-sfbr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:39.015086 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:39.014973    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b podName:c3e0c687-ff13-4f04-a0b8-a69cc711f130 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:40.014959136 +0000 UTC m=+4.137970687 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2k57b" (UniqueName: "kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b") pod "network-check-target-sfbr9" (UID: "c3e0c687-ff13-4f04-a0b8-a69cc711f130") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:39.253973 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:39.253928    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 20:27:38 +0000 UTC" deadline="2027-12-15 17:33:53.48290793 +0000 UTC"
Jul 02 20:32:39.253973 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:39.253963    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12741h1m14.228948594s"
Jul 02 20:32:39.603447 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:39.603352    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1419c726_721f_4fd9_bfb9_7043d578cf0c.slice/crio-9f9847f3a75c4651f484ce6a02efc71d2b28a4c79d31498125b1e8f2ef844bc8 WatchSource:0}: Error finding container 9f9847f3a75c4651f484ce6a02efc71d2b28a4c79d31498125b1e8f2ef844bc8: Status 404 returned error can't find the container with id 9f9847f3a75c4651f484ce6a02efc71d2b28a4c79d31498125b1e8f2ef844bc8
Jul 02 20:32:39.605528 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:39.605497    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d5f826_a176_4167_b921_e05de73d1825.slice/crio-f66b211a9768b921602346c2c8bedf124357e3664844102aedefa3aa6872cbfe WatchSource:0}: Error finding container f66b211a9768b921602346c2c8bedf124357e3664844102aedefa3aa6872cbfe: Status 404 returned error can't find the container with id f66b211a9768b921602346c2c8bedf124357e3664844102aedefa3aa6872cbfe
Jul 02 20:32:39.606367 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:39.606334    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea72b244_bdcf_4851_b87d_62845cf30403.slice/crio-e36eff3f9749a3bf4decde41c0d852905f5d749abcd757272c27028879b08ebe WatchSource:0}: Error finding container e36eff3f9749a3bf4decde41c0d852905f5d749abcd757272c27028879b08ebe: Status 404 returned error can't find the container with id e36eff3f9749a3bf4decde41c0d852905f5d749abcd757272c27028879b08ebe
Jul 02 20:32:39.608049 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:39.607962    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fae3eab_74e9_49d3_b30d_8e453c8ec65b.slice/crio-e231c9be4338aea61e0aa91d0506bc286d667a50e7ab0450419fa512190a840d WatchSource:0}: Error finding container e231c9be4338aea61e0aa91d0506bc286d667a50e7ab0450419fa512190a840d: Status 404 returned error can't find the container with id e231c9be4338aea61e0aa91d0506bc286d667a50e7ab0450419fa512190a840d
Jul 02 20:32:39.608969 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:39.608807    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5451dec1_e57e_4836_9797_bb1d91d545e6.slice/crio-79e72d642296baf71e0bedba8e5cb234ad448c1ab0e7230da866570b6da62f93 WatchSource:0}: Error finding container 79e72d642296baf71e0bedba8e5cb234ad448c1ab0e7230da866570b6da62f93: Status 404 returned error can't find the container with id 79e72d642296baf71e0bedba8e5cb234ad448c1ab0e7230da866570b6da62f93
Jul 02 20:32:39.611969 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:39.609589    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764de1f9_bd56_4aea_9e76_98452d3ae9a3.slice/crio-26f85518b2758bc2963e2d78158124320a5e1bb6b7e31395e11d1167e0315c81 WatchSource:0}: Error finding container 26f85518b2758bc2963e2d78158124320a5e1bb6b7e31395e11d1167e0315c81: Status 404 returned error can't find the container with id 26f85518b2758bc2963e2d78158124320a5e1bb6b7e31395e11d1167e0315c81
Jul 02 20:32:39.615295 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:39.614892    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eee63fc_ae15_428d_8a57_390c573de403.slice/crio-4c85833e6d97a95851296f933eace55953ed4968c5ce9806f14c402891902719 WatchSource:0}: Error finding container 4c85833e6d97a95851296f933eace55953ed4968c5ce9806f14c402891902719: Status 404 returned error can't find the container with id 4c85833e6d97a95851296f933eace55953ed4968c5ce9806f14c402891902719
Jul 02 20:32:39.615650 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:39.615516    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6346a1_13f2_49ba_9b76_1fb229b002d3.slice/crio-e2db1b1ff7e5d982f34855b4632ce1980365a2f75b7afac78b0123bbcbea8cf0 WatchSource:0}: Error finding container e2db1b1ff7e5d982f34855b4632ce1980365a2f75b7afac78b0123bbcbea8cf0: Status 404 returned error can't find the container with id e2db1b1ff7e5d982f34855b4632ce1980365a2f75b7afac78b0123bbcbea8cf0
Jul 02 20:32:39.617744 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:32:39.617488    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a9c44e_34ad_4112_a08b_48b27fcf339d.slice/crio-9e70c148a46f8e1035ca6cbde115a5d04c68f7a07f8f8059e7fa7ca5a1e17e4b WatchSource:0}: Error finding container 9e70c148a46f8e1035ca6cbde115a5d04c68f7a07f8f8059e7fa7ca5a1e17e4b: Status 404 returned error can't find the container with id 9e70c148a46f8e1035ca6cbde115a5d04c68f7a07f8f8059e7fa7ca5a1e17e4b
Jul 02 20:32:39.821542 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:39.821217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs\") pod \"network-metrics-daemon-swrg9\" (UID: \"888788da-c29d-4687-a880-bcbbd7bfa01f\") " pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:39.821542 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:39.821409    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:39.821542 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:39.821523    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs podName:888788da-c29d-4687-a880-bcbbd7bfa01f nodeName:}" failed. No retries permitted until 2026-07-02 20:32:41.821507223 +0000 UTC m=+5.944518774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs") pod "network-metrics-daemon-swrg9" (UID: "888788da-c29d-4687-a880-bcbbd7bfa01f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:39.922692 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:39.922659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret\") pod \"global-pull-secret-syncer-n5bj2\" (UID: \"6d77247d-e7bf-42d1-9f3f-310fed10b354\") " pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:39.922881 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:39.922830    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:39.922934 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:39.922890    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret podName:6d77247d-e7bf-42d1-9f3f-310fed10b354 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:41.922876457 +0000 UTC m=+6.045888013 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret") pod "global-pull-secret-syncer-n5bj2" (UID: "6d77247d-e7bf-42d1-9f3f-310fed10b354") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:40.024262 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.024210    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k57b\" (UniqueName: \"kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b\") pod \"network-check-target-sfbr9\" (UID: \"c3e0c687-ff13-4f04-a0b8-a69cc711f130\") " pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:40.024446 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:40.024388    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:32:40.024446 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:40.024413    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:32:40.024446 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:40.024424    2565 projected.go:196] Error preparing data for projected volume kube-api-access-2k57b for pod openshift-network-diagnostics/network-check-target-sfbr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:40.024558 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:40.024478    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b podName:c3e0c687-ff13-4f04-a0b8-a69cc711f130 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:42.024463291 +0000 UTC m=+6.147474842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2k57b" (UniqueName: "kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b") pod "network-check-target-sfbr9" (UID: "c3e0c687-ff13-4f04-a0b8-a69cc711f130") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:40.254992 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.254920    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 20:27:38 +0000 UTC" deadline="2027-12-20 16:35:02.049393667 +0000 UTC"
Jul 02 20:32:40.254992 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.254991    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12860h2m21.794408109s"
Jul 02 20:32:40.293895 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.293140    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:40.293895 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:40.293278    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:32:40.293895 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.293721    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:40.293895 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:40.293844    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:32:40.294464 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.294314    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:40.294464 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:40.294426    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:32:40.313789 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.313699    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q7nrh" event={"ID":"ea72b244-bdcf-4851-b87d-62845cf30403","Type":"ContainerStarted","Data":"e36eff3f9749a3bf4decde41c0d852905f5d749abcd757272c27028879b08ebe"}
Jul 02 20:32:40.331471 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.330334    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf9bn" event={"ID":"1419c726-721f-4fd9-bfb9-7043d578cf0c","Type":"ContainerStarted","Data":"9f9847f3a75c4651f484ce6a02efc71d2b28a4c79d31498125b1e8f2ef844bc8"}
Jul 02 20:32:40.336291 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.335431    2565 generic.go:356] "Generic (PLEG): container finished" podID="2371af2c29d1ce0a80068ede78c8a9e5" containerID="5e874f70a79a2daebe8f94606d058293a34d6c42c70809d3512202970c461ab9" exitCode=0
Jul 02 20:32:40.336291 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.335522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" event={"ID":"2371af2c29d1ce0a80068ede78c8a9e5","Type":"ContainerDied","Data":"5e874f70a79a2daebe8f94606d058293a34d6c42c70809d3512202970c461ab9"}
Jul 02 20:32:40.341189 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.341110    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8r9rr" event={"ID":"58a9c44e-34ad-4112-a08b-48b27fcf339d","Type":"ContainerStarted","Data":"9e70c148a46f8e1035ca6cbde115a5d04c68f7a07f8f8059e7fa7ca5a1e17e4b"}
Jul 02 20:32:40.344858 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.344778    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m5mhl" event={"ID":"1f6346a1-13f2-49ba-9b76-1fb229b002d3","Type":"ContainerStarted","Data":"e2db1b1ff7e5d982f34855b4632ce1980365a2f75b7afac78b0123bbcbea8cf0"}
Jul 02 20:32:40.351480 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.351402    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x26xq" event={"ID":"3eee63fc-ae15-428d-8a57-390c573de403","Type":"ContainerStarted","Data":"4c85833e6d97a95851296f933eace55953ed4968c5ce9806f14c402891902719"}
Jul 02 20:32:40.362120 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.362080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz" event={"ID":"5451dec1-e57e-4836-9797-bb1d91d545e6","Type":"ContainerStarted","Data":"79e72d642296baf71e0bedba8e5cb234ad448c1ab0e7230da866570b6da62f93"}
Jul 02 20:32:40.368361 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.368320    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cnxsl" event={"ID":"3fae3eab-74e9-49d3-b30d-8e453c8ec65b","Type":"ContainerStarted","Data":"e231c9be4338aea61e0aa91d0506bc286d667a50e7ab0450419fa512190a840d"}
Jul 02 20:32:40.376023 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.375940    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k8rtk" event={"ID":"e0d5f826-a176-4167-b921-e05de73d1825","Type":"ContainerStarted","Data":"f66b211a9768b921602346c2c8bedf124357e3664844102aedefa3aa6872cbfe"}
Jul 02 20:32:40.380461 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.379789    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal" event={"ID":"74288498fb0c2498191bac60d7d7a2bd","Type":"ContainerStarted","Data":"a01874b9ad585b640290c2239d76fc3001ca307f397599a8666f727ae80f3759"}
Jul 02 20:32:40.394346 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:40.394230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr" event={"ID":"764de1f9-bd56-4aea-9e76-98452d3ae9a3","Type":"ContainerStarted","Data":"26f85518b2758bc2963e2d78158124320a5e1bb6b7e31395e11d1167e0315c81"}
Jul 02 20:32:41.413882 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:41.413845    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" event={"ID":"2371af2c29d1ce0a80068ede78c8a9e5","Type":"ContainerStarted","Data":"1d52ed6349cb54b8e0af500b7c1be07d563a649c7c37a8c0201c26f12a96ed0e"}
Jul 02 20:32:41.435318 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:41.435230    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal" podStartSLOduration=4.43520269 podStartE2EDuration="4.43520269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:32:40.399053914 +0000 UTC m=+4.522065491" watchObservedRunningTime="2026-07-02 20:32:41.43520269 +0000 UTC m=+5.558214261"
Jul 02 20:32:41.844867 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:41.844246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs\") pod \"network-metrics-daemon-swrg9\" (UID: \"888788da-c29d-4687-a880-bcbbd7bfa01f\") " pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:41.844867 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:41.844398    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:41.844867 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:41.844462    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs podName:888788da-c29d-4687-a880-bcbbd7bfa01f nodeName:}" failed. No retries permitted until 2026-07-02 20:32:45.844443827 +0000 UTC m=+9.967455379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs") pod "network-metrics-daemon-swrg9" (UID: "888788da-c29d-4687-a880-bcbbd7bfa01f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:41.945833 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:41.945400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret\") pod \"global-pull-secret-syncer-n5bj2\" (UID: \"6d77247d-e7bf-42d1-9f3f-310fed10b354\") " pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:41.945833 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:41.945561    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:41.945833 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:41.945637    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret podName:6d77247d-e7bf-42d1-9f3f-310fed10b354 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:45.945616984 +0000 UTC m=+10.068628541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret") pod "global-pull-secret-syncer-n5bj2" (UID: "6d77247d-e7bf-42d1-9f3f-310fed10b354") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:42.046633 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:42.046597    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k57b\" (UniqueName: \"kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b\") pod \"network-check-target-sfbr9\" (UID: \"c3e0c687-ff13-4f04-a0b8-a69cc711f130\") " pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:42.046998 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:42.046936    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:32:42.046998 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:42.046962    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:32:42.046998 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:42.046974    2565 projected.go:196] Error preparing data for projected volume kube-api-access-2k57b for pod openshift-network-diagnostics/network-check-target-sfbr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:42.047195 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:42.047038    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b podName:c3e0c687-ff13-4f04-a0b8-a69cc711f130 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:46.047020793 +0000 UTC m=+10.170032347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2k57b" (UniqueName: "kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b") pod "network-check-target-sfbr9" (UID: "c3e0c687-ff13-4f04-a0b8-a69cc711f130") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:42.294440 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:42.293878    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:42.294440 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:42.293885    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:42.294440 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:42.294022    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:32:42.294440 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:42.294134    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:32:42.294440 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:42.294191    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:42.294440 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:42.294261    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:32:44.295058 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:44.294947    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:44.295058 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:44.294992    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:44.295058 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:44.294947    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:44.295632 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:44.295101    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:32:44.295632 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:44.295185    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:32:44.295632 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:44.295278    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:32:45.882446 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:45.882407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs\") pod \"network-metrics-daemon-swrg9\" (UID: \"888788da-c29d-4687-a880-bcbbd7bfa01f\") " pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:45.882947 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:45.882575    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:45.882947 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:45.882646    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs podName:888788da-c29d-4687-a880-bcbbd7bfa01f nodeName:}" failed. No retries permitted until 2026-07-02 20:32:53.88263243 +0000 UTC m=+18.005643979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs") pod "network-metrics-daemon-swrg9" (UID: "888788da-c29d-4687-a880-bcbbd7bfa01f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:45.983142 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:45.983104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret\") pod \"global-pull-secret-syncer-n5bj2\" (UID: \"6d77247d-e7bf-42d1-9f3f-310fed10b354\") " pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:45.983334 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:45.983280    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:45.983388 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:45.983361    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret podName:6d77247d-e7bf-42d1-9f3f-310fed10b354 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:53.983337367 +0000 UTC m=+18.106348924 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret") pod "global-pull-secret-syncer-n5bj2" (UID: "6d77247d-e7bf-42d1-9f3f-310fed10b354") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:46.084350 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:46.084310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k57b\" (UniqueName: \"kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b\") pod \"network-check-target-sfbr9\" (UID: \"c3e0c687-ff13-4f04-a0b8-a69cc711f130\") " pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:46.084530 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:46.084473    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:32:46.084530 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:46.084491    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:32:46.084530 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:46.084506    2565 projected.go:196] Error preparing data for projected volume kube-api-access-2k57b for pod openshift-network-diagnostics/network-check-target-sfbr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:46.084686 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:46.084560    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b podName:c3e0c687-ff13-4f04-a0b8-a69cc711f130 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:54.084547058 +0000 UTC m=+18.207558627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2k57b" (UniqueName: "kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b") pod "network-check-target-sfbr9" (UID: "c3e0c687-ff13-4f04-a0b8-a69cc711f130") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:46.294076 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:46.293960    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:46.294076 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:46.294047    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:46.294076 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:46.294063    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:32:46.294324 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:46.294156    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:32:46.294324 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:46.294191    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:46.294324 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:46.294277    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:32:48.292816 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:48.292777    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:48.293266 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:48.292778    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:48.293266 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:48.292914    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:32:48.293266 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:48.292785    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:48.293266 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:48.292982    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:32:48.293266 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:48.293047    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:32:50.292822 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:50.292723    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:50.293248 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:50.292723    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:50.293248 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:50.292868    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:32:50.293248 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:50.292961    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:32:50.293248 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:50.293033    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:50.293248 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:50.293120    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:32:51.445604 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:51.445387    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf9bn" event={"ID":"1419c726-721f-4fd9-bfb9-7043d578cf0c","Type":"ContainerStarted","Data":"0abc8b71d7cefebbd3a4f37863a6a6dbebabff56c7aa5de554be6b6f802b283e"}
Jul 02 20:32:51.447431 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:51.447400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8r9rr" event={"ID":"58a9c44e-34ad-4112-a08b-48b27fcf339d","Type":"ContainerStarted","Data":"7c996fb8f535a59f6666640940ae0b154c7aa1898965948b83ca1a840f3a12ba"}
Jul 02 20:32:51.449093 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:51.449052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m5mhl" event={"ID":"1f6346a1-13f2-49ba-9b76-1fb229b002d3","Type":"ContainerStarted","Data":"e162d5671a5e6670ec2adea799c426d9fcaa6f4c4936135fb9c1cb29ab2d4a12"}
Jul 02 20:32:51.450718 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:51.450694    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x26xq" event={"ID":"3eee63fc-ae15-428d-8a57-390c573de403","Type":"ContainerStarted","Data":"5bf3d7e2c7c956939b0e5cec7a34c03c2b86682d1e44684b80658bbe1cb701ba"}
Jul 02 20:32:51.453346 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:51.453322    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz" event={"ID":"5451dec1-e57e-4836-9797-bb1d91d545e6","Type":"ContainerStarted","Data":"c2d64da979c05c1e523de6a5026dfec194619bef049091ad906ed68ced81d419"}
Jul 02 20:32:51.455991 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:51.455959    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cnxsl" event={"ID":"3fae3eab-74e9-49d3-b30d-8e453c8ec65b","Type":"ContainerStarted","Data":"234e257ffd6f389e2782c81ebb382f43bef9c920b0b87c8db6d7d5cb0ccc7090"}
Jul 02 20:32:51.477464 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:51.477416    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" podStartSLOduration=14.477403516 podStartE2EDuration="14.477403516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:32:41.436766405 +0000 UTC m=+5.559777967" watchObservedRunningTime="2026-07-02 20:32:51.477403516 +0000 UTC m=+15.600415087"
Jul 02 20:32:51.496267 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:51.496212    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-x26xq" podStartSLOduration=5.028424455 podStartE2EDuration="15.4961911s" totalImagesPullingTime="10.467766645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:32:51.495691622 +0000 UTC m=+15.618703192" watchObservedRunningTime="2026-07-02 20:32:51.4961911 +0000 UTC m=+15.619202672"
Jul 02 20:32:51.520492 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:51.520436    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m5mhl" podStartSLOduration=4.054360784 podStartE2EDuration="14.520414825s" totalImagesPullingTime="10.466054041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:32:51.519670769 +0000 UTC m=+15.642682337" watchObservedRunningTime="2026-07-02 20:32:51.520414825 +0000 UTC m=+15.643426397"
Jul 02 20:32:51.567637 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:51.567582    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8r9rr" podStartSLOduration=4.126788103 podStartE2EDuration="14.567559242s" totalImagesPullingTime="10.440771139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:32:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:32:51.567096522 +0000 UTC m=+15.690108106" watchObservedRunningTime="2026-07-02 20:32:51.567559242 +0000 UTC m=+15.690570812"
Jul 02 20:32:51.567850 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:51.567776    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cnxsl" podStartSLOduration=4.81100549 podStartE2EDuration="15.567766054s" totalImagesPullingTime="10.756760564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:32:51.547635329 +0000 UTC m=+15.670646901" watchObservedRunningTime="2026-07-02 20:32:51.567766054 +0000 UTC m=+15.690777616"
Jul 02 20:32:52.293597 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:52.293505    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:52.293814 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:52.293513    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:52.293814 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:52.293632    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:32:52.293814 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:52.293650    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:52.293814 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:52.293747    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:32:52.293998 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:52.293837    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:32:52.460103 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:52.460070    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q7nrh" event={"ID":"ea72b244-bdcf-4851-b87d-62845cf30403","Type":"ContainerStarted","Data":"9f841ffcd1254cd8639814d7a9012d11558458fcd5913115e6b0496e964167de"}
Jul 02 20:32:52.478582 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:52.478534    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q7nrh" podStartSLOduration=5.998845491 podStartE2EDuration="16.478515084s" totalImagesPullingTime="10.479669593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:32:52.478293732 +0000 UTC m=+16.601305305" watchObservedRunningTime="2026-07-02 20:32:52.478515084 +0000 UTC m=+16.601526656"
Jul 02 20:32:53.948015 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:53.947962    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs\") pod \"network-metrics-daemon-swrg9\" (UID: \"888788da-c29d-4687-a880-bcbbd7bfa01f\") " pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:53.948610 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:53.948107    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:53.948610 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:53.948176    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs podName:888788da-c29d-4687-a880-bcbbd7bfa01f nodeName:}" failed. No retries permitted until 2026-07-02 20:33:09.948155411 +0000 UTC m=+34.071166982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs") pod "network-metrics-daemon-swrg9" (UID: "888788da-c29d-4687-a880-bcbbd7bfa01f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:54.048814 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:54.048778    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret\") pod \"global-pull-secret-syncer-n5bj2\" (UID: \"6d77247d-e7bf-42d1-9f3f-310fed10b354\") " pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:54.049002 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:54.048934    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:54.049002 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:54.048999    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret podName:6d77247d-e7bf-42d1-9f3f-310fed10b354 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:10.048979102 +0000 UTC m=+34.171990668 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret") pod "global-pull-secret-syncer-n5bj2" (UID: "6d77247d-e7bf-42d1-9f3f-310fed10b354") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:54.149683 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:54.149645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k57b\" (UniqueName: \"kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b\") pod \"network-check-target-sfbr9\" (UID: \"c3e0c687-ff13-4f04-a0b8-a69cc711f130\") " pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:54.149883 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:54.149849    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:32:54.149883 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:54.149880    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:32:54.150073 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:54.149895    2565 projected.go:196] Error preparing data for projected volume kube-api-access-2k57b for pod openshift-network-diagnostics/network-check-target-sfbr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:54.150073 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:54.149958    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b podName:c3e0c687-ff13-4f04-a0b8-a69cc711f130 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:10.149938484 +0000 UTC m=+34.272950036 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2k57b" (UniqueName: "kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b") pod "network-check-target-sfbr9" (UID: "c3e0c687-ff13-4f04-a0b8-a69cc711f130") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:54.292870 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:54.292791    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:54.292870 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:54.292812    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:54.293086 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:54.292792    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:54.293086 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:54.292917    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:32:54.293086 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:54.293001    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:32:54.293242 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:54.293088    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:32:54.928706 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:54.928673    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8r9rr"
Jul 02 20:32:54.929421 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:54.929396    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8r9rr"
Jul 02 20:32:56.294575 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:56.294536    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:56.295370 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:56.294586    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:56.295370 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:56.294644    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:56.295370 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:56.294671    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:32:56.295370 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:56.294720    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:32:56.295370 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:56.294784    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:32:56.996963 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:56.996922    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8r9rr"
Jul 02 20:32:56.997159 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:56.997110    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 02 20:32:56.997598 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:56.997568    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8r9rr"
Jul 02 20:32:58.292967 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:58.292930    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:32:58.293509 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:58.292950    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:32:58.293509 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:58.293062    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:32:58.293509 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:58.293145    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:32:58.293509 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:58.293200    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:32:58.293509 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:32:58.293304    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:32:58.949453 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:58.948872    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 20:32:59.267552 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:59.267456    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T20:32:58.949088522Z","UUID":"255a4269-ac00-4c68-b84a-c4da306703af","Handler":null,"Name":"","Endpoint":""}
Jul 02 20:32:59.269062 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:59.269042    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 20:32:59.269205 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:59.269082    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 20:32:59.476212 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:59.475967    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz" event={"ID":"5451dec1-e57e-4836-9797-bb1d91d545e6","Type":"ContainerStarted","Data":"783641c78178bcdd58a70194733cf6ac1ad013f922d9bf7fe3b0e6a49b8e174d"}
Jul 02 20:32:59.477729 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:59.477699    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k8rtk" event={"ID":"e0d5f826-a176-4167-b921-e05de73d1825","Type":"ContainerStarted","Data":"1a6ef0fef87fa2bba68d090fae17afef9690b057d44cead4f017f8fee3c5df76"}
Jul 02 20:32:59.481004 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:59.480968    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr" event={"ID":"764de1f9-bd56-4aea-9e76-98452d3ae9a3","Type":"ContainerStarted","Data":"04ee11de856e084ec1011be79a3f89c36ac53819e8cda039311ecd6b7fa745e0"}
Jul 02 20:32:59.481133 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:59.481048    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr" event={"ID":"764de1f9-bd56-4aea-9e76-98452d3ae9a3","Type":"ContainerStarted","Data":"1ad575d94d4eda0dc71a37520524f7fb53966ff037cdca3584b7e2b0cbc5e0ef"}
Jul 02 20:32:59.481133 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:59.481098    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr" event={"ID":"764de1f9-bd56-4aea-9e76-98452d3ae9a3","Type":"ContainerStarted","Data":"57ce4f0a245df625c0e16ba23ee9fda96c12a919fdccb266f9079a3c8ec27d48"}
Jul 02 20:32:59.481245 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:59.481146    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr" event={"ID":"764de1f9-bd56-4aea-9e76-98452d3ae9a3","Type":"ContainerStarted","Data":"ec6403e5cc7091994b9fde2f4e196022a30ae2d3378a1a4ce3ee207217a36227"}
Jul 02 20:32:59.481245 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:59.481190    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr" event={"ID":"764de1f9-bd56-4aea-9e76-98452d3ae9a3","Type":"ContainerStarted","Data":"6078a81be9eacbad8764accec1f82fbdfad973aa73cf283c1327de2038b159ef"}
Jul 02 20:32:59.481245 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:59.481239    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr" event={"ID":"764de1f9-bd56-4aea-9e76-98452d3ae9a3","Type":"ContainerStarted","Data":"3d31eed030c64406d22e30bdb968066d256d1c185abab3b7152071491c39a3f8"}
Jul 02 20:32:59.482815 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:59.482787    2565 generic.go:356] "Generic (PLEG): container finished" podID="1419c726-721f-4fd9-bfb9-7043d578cf0c" containerID="0abc8b71d7cefebbd3a4f37863a6a6dbebabff56c7aa5de554be6b6f802b283e" exitCode=0
Jul 02 20:32:59.482928 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:59.482824    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf9bn" event={"ID":"1419c726-721f-4fd9-bfb9-7043d578cf0c","Type":"ContainerDied","Data":"0abc8b71d7cefebbd3a4f37863a6a6dbebabff56c7aa5de554be6b6f802b283e"}
Jul 02 20:32:59.497809 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:32:59.497743    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k8rtk" podStartSLOduration=4.31637796 podStartE2EDuration="23.497729303s" totalImagesPullingTime="19.181351343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:32:59.497100238 +0000 UTC m=+23.620111830" watchObservedRunningTime="2026-07-02 20:32:59.497729303 +0000 UTC m=+23.620740874"
Jul 02 20:33:00.292835 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:00.292745    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:33:00.292835 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:00.292745    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:33:00.293104 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:00.292886    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:33:00.293104 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:00.292892    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:33:00.293104 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:00.292977    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:33:00.293104 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:00.293079    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:33:00.487155 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:00.487121    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz" event={"ID":"5451dec1-e57e-4836-9797-bb1d91d545e6","Type":"ContainerStarted","Data":"1f6a93d69a17156ff05c25d11dd99afaab988fe06fbb3cb7c10c74ee6a6285ff"}
Jul 02 20:33:00.504058 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:00.504012    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fwrz" podStartSLOduration=3.655968059 podStartE2EDuration="23.503993826s" totalImagesPullingTime="19.848025767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:00.503593591 +0000 UTC m=+24.626605163" watchObservedRunningTime="2026-07-02 20:33:00.503993826 +0000 UTC m=+24.627005397"
Jul 02 20:33:01.492006 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:01.491927    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr" event={"ID":"764de1f9-bd56-4aea-9e76-98452d3ae9a3","Type":"ContainerStarted","Data":"301af8734df195b452a3b1a642625cb3c760b64ea8e82cb55b300779eeca763e"}
Jul 02 20:33:02.293669 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:02.293637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:33:02.293894 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:02.293637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:33:02.293894 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:02.293792    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:33:02.293894 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:02.293636    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:33:02.293894 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:02.293876    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:33:02.294112 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:02.293925    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:33:04.293578 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:04.293340    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:33:04.294355 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:04.293371    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:33:04.294355 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:04.293402    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:33:04.294355 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:04.293639    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:33:04.294355 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:04.293703    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:33:04.294355 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:04.293818    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:33:04.506765 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:04.506716    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr" event={"ID":"764de1f9-bd56-4aea-9e76-98452d3ae9a3","Type":"ContainerStarted","Data":"d7ca35bc866b027febe3b25554857323b98554346e1e5cf1b4d4a5510b4fa228"}
Jul 02 20:33:04.507178 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:04.507009    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:33:04.507178 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:04.507083    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:33:04.507178 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:04.507124    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:33:04.524473 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:04.524446    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:33:04.524612 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:04.524604    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:33:04.539223 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:04.539164    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr" podStartSLOduration=9.364999938 podStartE2EDuration="28.539147433s" totalImagesPullingTime="19.174147495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:04.538872922 +0000 UTC m=+28.661884493" watchObservedRunningTime="2026-07-02 20:33:04.539147433 +0000 UTC m=+28.662159006"
Jul 02 20:33:05.493538 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:05.493503    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-swrg9"]
Jul 02 20:33:05.493977 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:05.493682    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:33:05.493977 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:05.493819    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:33:05.495903 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:05.495879    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sfbr9"]
Jul 02 20:33:05.496044 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:05.495986    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:33:05.496115 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:05.496088    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:33:05.510937 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:05.510778    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n5bj2"]
Jul 02 20:33:05.510937 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:05.510879    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:33:05.511165 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:05.510975    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:33:06.513455 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:06.513370    2565 generic.go:356] "Generic (PLEG): container finished" podID="1419c726-721f-4fd9-bfb9-7043d578cf0c" containerID="9ec93c7f58b0b352a7d90f2e7264b66caa32284f0870bab3fd716e268de8d824" exitCode=0
Jul 02 20:33:06.513455 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:06.513445    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf9bn" event={"ID":"1419c726-721f-4fd9-bfb9-7043d578cf0c","Type":"ContainerDied","Data":"9ec93c7f58b0b352a7d90f2e7264b66caa32284f0870bab3fd716e268de8d824"}
Jul 02 20:33:07.293101 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:07.293064    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:33:07.293263 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:07.293169    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:33:07.293263 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:07.293078    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:33:07.293263 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:07.293196    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:33:07.293377 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:07.293286    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:33:07.293377 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:07.293356    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:33:07.518485 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:07.518452    2565 generic.go:356] "Generic (PLEG): container finished" podID="1419c726-721f-4fd9-bfb9-7043d578cf0c" containerID="8b23609c9de6c550305549bbaac8e006a91bdef3487ade389f7f2eafebd781cb" exitCode=0
Jul 02 20:33:07.518851 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:07.518501    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf9bn" event={"ID":"1419c726-721f-4fd9-bfb9-7043d578cf0c","Type":"ContainerDied","Data":"8b23609c9de6c550305549bbaac8e006a91bdef3487ade389f7f2eafebd781cb"}
Jul 02 20:33:08.523071 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:08.523039    2565 generic.go:356] "Generic (PLEG): container finished" podID="1419c726-721f-4fd9-bfb9-7043d578cf0c" containerID="853aee4d7c380c33d6c85a3b2a45d0e32e9cc513de5048639e1da30f9519f0d1" exitCode=0
Jul 02 20:33:08.523436 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:08.523096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf9bn" event={"ID":"1419c726-721f-4fd9-bfb9-7043d578cf0c","Type":"ContainerDied","Data":"853aee4d7c380c33d6c85a3b2a45d0e32e9cc513de5048639e1da30f9519f0d1"}
Jul 02 20:33:09.293366 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:09.293306    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:33:09.293366 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:09.293344    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:33:09.293599 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:09.293314    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:33:09.293599 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:09.293435    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:33:09.293599 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:09.293492    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:33:09.293599 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:09.293581    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:33:09.962978 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:09.962895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs\") pod \"network-metrics-daemon-swrg9\" (UID: \"888788da-c29d-4687-a880-bcbbd7bfa01f\") " pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:33:09.963361 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:09.963045    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:33:09.963361 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:09.963112    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs podName:888788da-c29d-4687-a880-bcbbd7bfa01f nodeName:}" failed. No retries permitted until 2026-07-02 20:33:41.963096105 +0000 UTC m=+66.086107657 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs") pod "network-metrics-daemon-swrg9" (UID: "888788da-c29d-4687-a880-bcbbd7bfa01f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:33:10.063483 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:10.063441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret\") pod \"global-pull-secret-syncer-n5bj2\" (UID: \"6d77247d-e7bf-42d1-9f3f-310fed10b354\") " pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:33:10.063655 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:10.063591    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:33:10.063655 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:10.063643    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret podName:6d77247d-e7bf-42d1-9f3f-310fed10b354 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:42.063631244 +0000 UTC m=+66.186642793 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret") pod "global-pull-secret-syncer-n5bj2" (UID: "6d77247d-e7bf-42d1-9f3f-310fed10b354") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:33:10.164341 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:10.164311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k57b\" (UniqueName: \"kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b\") pod \"network-check-target-sfbr9\" (UID: \"c3e0c687-ff13-4f04-a0b8-a69cc711f130\") " pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:33:10.164482 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:10.164453    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:33:10.164482 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:10.164469    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:33:10.164482 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:10.164478    2565 projected.go:196] Error preparing data for projected volume kube-api-access-2k57b for pod openshift-network-diagnostics/network-check-target-sfbr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:33:10.164593 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:10.164530    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b podName:c3e0c687-ff13-4f04-a0b8-a69cc711f130 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:42.164517146 +0000 UTC m=+66.287528695 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2k57b" (UniqueName: "kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b") pod "network-check-target-sfbr9" (UID: "c3e0c687-ff13-4f04-a0b8-a69cc711f130") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:33:11.293330 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.293299    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:33:11.293330 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.293321    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:33:11.293906 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:11.293440    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrg9" podUID="888788da-c29d-4687-a880-bcbbd7bfa01f"
Jul 02 20:33:11.293906 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.293468    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:33:11.293906 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:11.293551    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfbr9" podUID="c3e0c687-ff13-4f04-a0b8-a69cc711f130"
Jul 02 20:33:11.293906 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:11.293749    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n5bj2" podUID="6d77247d-e7bf-42d1-9f3f-310fed10b354"
Jul 02 20:33:11.605026 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.604996    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeReady"
Jul 02 20:33:11.605214 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.605152    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 20:33:11.642468 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.642434    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cdbbccf58-hhzk5"]
Jul 02 20:33:11.666790 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.666740    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nbfbm"]
Jul 02 20:33:11.666965 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.666872    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.671011 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.670966    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 20:33:11.671011 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.671006    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 20:33:11.671263 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.671005    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 20:33:11.671378 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.671367    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kxfdk\""
Jul 02 20:33:11.679789 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.678724    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 20:33:11.682565 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.682544    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-glq7r"]
Jul 02 20:33:11.682683 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.682667    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nbfbm"
Jul 02 20:33:11.685385 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.685363    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 20:33:11.685471 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.685396    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 20:33:11.685681 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.685661    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h2bvt\""
Jul 02 20:33:11.685774 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.685661    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 20:33:11.702565 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.702540    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cdbbccf58-hhzk5"]
Jul 02 20:33:11.702679 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.702574    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nbfbm"]
Jul 02 20:33:11.702679 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.702593    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-glq7r"]
Jul 02 20:33:11.702679 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.702652    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:11.705010 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.704993    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 20:33:11.705105 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.705017    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 20:33:11.705154 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.705144    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w7dxd\""
Jul 02 20:33:11.777237 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.777205    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-bound-sa-token\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.777237 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.777243    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9g4w\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-kube-api-access-t9g4w\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.777461 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.777270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-tmp-dir\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:11.777461 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.777319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx7kn\" (UniqueName: \"kubernetes.io/projected/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-kube-api-access-gx7kn\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:11.777461 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.777384    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a523904c-ccf1-4bb8-9dd8-9be32d8492da-cert\") pod \"ingress-canary-nbfbm\" (UID: \"a523904c-ccf1-4bb8-9dd8-9be32d8492da\") " pod="openshift-ingress-canary/ingress-canary-nbfbm"
Jul 02 20:33:11.777461 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.777406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-config-volume\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:11.777621 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.777463    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e9d32f7-b789-4219-8cde-e1594be4cad0-image-registry-private-configuration\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.777621 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.777480    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.777621 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.777502    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvkm5\" (UniqueName: \"kubernetes.io/projected/a523904c-ccf1-4bb8-9dd8-9be32d8492da-kube-api-access-zvkm5\") pod \"ingress-canary-nbfbm\" (UID: \"a523904c-ccf1-4bb8-9dd8-9be32d8492da\") " pod="openshift-ingress-canary/ingress-canary-nbfbm"
Jul 02 20:33:11.777621 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.777564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e9d32f7-b789-4219-8cde-e1594be4cad0-installation-pull-secrets\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.777621 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.777599    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-certificates\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.777832 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.777624    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:11.777832 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.777643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e9d32f7-b789-4219-8cde-e1594be4cad0-trusted-ca\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.777832 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.777718    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e9d32f7-b789-4219-8cde-e1594be4cad0-ca-trust-extracted\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.814823 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.814787    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:11.878385 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.878295    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a523904c-ccf1-4bb8-9dd8-9be32d8492da-cert\") pod \"ingress-canary-nbfbm\" (UID: \"a523904c-ccf1-4bb8-9dd8-9be32d8492da\") " pod="openshift-ingress-canary/ingress-canary-nbfbm"
Jul 02 20:33:11.878385 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.878332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-config-volume\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:11.878385 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.878357    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e9d32f7-b789-4219-8cde-e1594be4cad0-image-registry-private-configuration\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.878385 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.878376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.878713 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.878405    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvkm5\" (UniqueName: \"kubernetes.io/projected/a523904c-ccf1-4bb8-9dd8-9be32d8492da-kube-api-access-zvkm5\") pod \"ingress-canary-nbfbm\" (UID: \"a523904c-ccf1-4bb8-9dd8-9be32d8492da\") " pod="openshift-ingress-canary/ingress-canary-nbfbm"
Jul 02 20:33:11.878713 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.878435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e9d32f7-b789-4219-8cde-e1594be4cad0-installation-pull-secrets\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.878713 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:11.878483    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 20:33:11.878713 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.878490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-certificates\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.878713 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:11.878499    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdbbccf58-hhzk5: secret "image-registry-tls" not found
Jul 02 20:33:11.878713 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.878515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:11.878713 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.878537    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e9d32f7-b789-4219-8cde-e1594be4cad0-trusted-ca\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.878713 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:11.878571    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls podName:0e9d32f7-b789-4219-8cde-e1594be4cad0 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:12.378548714 +0000 UTC m=+36.501560286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls") pod "image-registry-6cdbbccf58-hhzk5" (UID: "0e9d32f7-b789-4219-8cde-e1594be4cad0") : secret "image-registry-tls" not found
Jul 02 20:33:11.878713 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.878628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e9d32f7-b789-4219-8cde-e1594be4cad0-ca-trust-extracted\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.878713 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.878696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-bound-sa-token\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.879201 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.878723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9g4w\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-kube-api-access-t9g4w\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.879201 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.878746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-tmp-dir\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:11.879201 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.878792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx7kn\" (UniqueName: \"kubernetes.io/projected/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-kube-api-access-gx7kn\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:11.879201 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:11.878996    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:11.879201 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.879025    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-config-volume\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:11.879201 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:11.879061    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls podName:d85f6511-daa2-4d28-a33d-d9e1b2efc9de nodeName:}" failed. No retries permitted until 2026-07-02 20:33:12.379043445 +0000 UTC m=+36.502055009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls") pod "dns-default-glq7r" (UID: "d85f6511-daa2-4d28-a33d-d9e1b2efc9de") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:11.879509 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.879248    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e9d32f7-b789-4219-8cde-e1594be4cad0-ca-trust-extracted\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.879509 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.879383    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-tmp-dir\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:11.879651 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.879621    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-certificates\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.879651 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.879645    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e9d32f7-b789-4219-8cde-e1594be4cad0-trusted-ca\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.883134 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.883112    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a523904c-ccf1-4bb8-9dd8-9be32d8492da-cert\") pod \"ingress-canary-nbfbm\" (UID: \"a523904c-ccf1-4bb8-9dd8-9be32d8492da\") " pod="openshift-ingress-canary/ingress-canary-nbfbm"
Jul 02 20:33:11.883251 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.883113    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e9d32f7-b789-4219-8cde-e1594be4cad0-image-registry-private-configuration\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.883251 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.883122    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e9d32f7-b789-4219-8cde-e1594be4cad0-installation-pull-secrets\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.888859 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.888811    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-bound-sa-token\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.889117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.889089    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx7kn\" (UniqueName: \"kubernetes.io/projected/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-kube-api-access-gx7kn\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:11.889407 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.889383    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9g4w\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-kube-api-access-t9g4w\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:11.889890 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.889870    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvkm5\" (UniqueName: \"kubernetes.io/projected/a523904c-ccf1-4bb8-9dd8-9be32d8492da-kube-api-access-zvkm5\") pod \"ingress-canary-nbfbm\" (UID: \"a523904c-ccf1-4bb8-9dd8-9be32d8492da\") " pod="openshift-ingress-canary/ingress-canary-nbfbm"
Jul 02 20:33:11.900294 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.900267    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:11.990674 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:11.990643    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nbfbm"
Jul 02 20:33:12.188705 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:12.188672    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nbfbm"]
Jul 02 20:33:12.192627 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:33:12.192593    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda523904c_ccf1_4bb8_9dd8_9be32d8492da.slice/crio-08c9f6acae722cd3df450afd20ed990980771c42ae8b7140c8995614c190d51a WatchSource:0}: Error finding container 08c9f6acae722cd3df450afd20ed990980771c42ae8b7140c8995614c190d51a: Status 404 returned error can't find the container with id 08c9f6acae722cd3df450afd20ed990980771c42ae8b7140c8995614c190d51a
Jul 02 20:33:12.381722 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:12.381688    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:12.382511 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:12.381732    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:12.382511 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:12.381861    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:12.382511 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:12.381871    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 20:33:12.382511 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:12.381890    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdbbccf58-hhzk5: secret "image-registry-tls" not found
Jul 02 20:33:12.382511 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:12.381916    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls podName:d85f6511-daa2-4d28-a33d-d9e1b2efc9de nodeName:}" failed. No retries permitted until 2026-07-02 20:33:13.381901095 +0000 UTC m=+37.504912645 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls") pod "dns-default-glq7r" (UID: "d85f6511-daa2-4d28-a33d-d9e1b2efc9de") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:12.382511 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:12.381951    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls podName:0e9d32f7-b789-4219-8cde-e1594be4cad0 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:13.381935213 +0000 UTC m=+37.504946781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls") pod "image-registry-6cdbbccf58-hhzk5" (UID: "0e9d32f7-b789-4219-8cde-e1594be4cad0") : secret "image-registry-tls" not found
Jul 02 20:33:12.533171 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:12.533087    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nbfbm" event={"ID":"a523904c-ccf1-4bb8-9dd8-9be32d8492da","Type":"ContainerStarted","Data":"08c9f6acae722cd3df450afd20ed990980771c42ae8b7140c8995614c190d51a"}
Jul 02 20:33:13.293172 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:13.292932    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:33:13.293345 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:13.292949    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:33:13.293658 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:13.292989    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:33:13.296388 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:13.296360    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 20:33:13.296493 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:13.296369    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 20:33:13.297716 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:13.297627    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 20:33:13.297716 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:13.297638    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zddh5\""
Jul 02 20:33:13.297716 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:13.297650    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w2d5j\""
Jul 02 20:33:13.297919 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:13.297651    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 20:33:13.391984 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:13.391947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:13.392418 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:13.392013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:13.392418 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:13.392135    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:13.392418 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:13.392197    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls podName:d85f6511-daa2-4d28-a33d-d9e1b2efc9de nodeName:}" failed. No retries permitted until 2026-07-02 20:33:15.392178599 +0000 UTC m=+39.515190156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls") pod "dns-default-glq7r" (UID: "d85f6511-daa2-4d28-a33d-d9e1b2efc9de") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:13.392418 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:13.392219    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 20:33:13.392418 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:13.392235    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdbbccf58-hhzk5: secret "image-registry-tls" not found
Jul 02 20:33:13.392418 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:13.392288    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls podName:0e9d32f7-b789-4219-8cde-e1594be4cad0 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:15.392271003 +0000 UTC m=+39.515282568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls") pod "image-registry-6cdbbccf58-hhzk5" (UID: "0e9d32f7-b789-4219-8cde-e1594be4cad0") : secret "image-registry-tls" not found
Jul 02 20:33:15.407241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:15.407201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:15.407241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:15.407252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:15.407651 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:15.407348    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:15.407651 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:15.407360    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 20:33:15.407651 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:15.407380    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdbbccf58-hhzk5: secret "image-registry-tls" not found
Jul 02 20:33:15.407651 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:15.407398    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls podName:d85f6511-daa2-4d28-a33d-d9e1b2efc9de nodeName:}" failed. No retries permitted until 2026-07-02 20:33:19.407385661 +0000 UTC m=+43.530397209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls") pod "dns-default-glq7r" (UID: "d85f6511-daa2-4d28-a33d-d9e1b2efc9de") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:15.407651 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:15.407424    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls podName:0e9d32f7-b789-4219-8cde-e1594be4cad0 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:19.40741026 +0000 UTC m=+43.530421809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls") pod "image-registry-6cdbbccf58-hhzk5" (UID: "0e9d32f7-b789-4219-8cde-e1594be4cad0") : secret "image-registry-tls" not found
Jul 02 20:33:16.542808 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:16.542770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nbfbm" event={"ID":"a523904c-ccf1-4bb8-9dd8-9be32d8492da","Type":"ContainerStarted","Data":"c41822aa6620ead13d18ec88b0ae4b9f2071bb62d20995867fd4945e667749ab"}
Jul 02 20:33:16.545309 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:16.545284    2565 generic.go:356] "Generic (PLEG): container finished" podID="1419c726-721f-4fd9-bfb9-7043d578cf0c" containerID="476b70bb0341983868c007429290370ce0088056f2c8c29dafb2541053cd82d5" exitCode=0
Jul 02 20:33:16.545442 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:16.545330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf9bn" event={"ID":"1419c726-721f-4fd9-bfb9-7043d578cf0c","Type":"ContainerDied","Data":"476b70bb0341983868c007429290370ce0088056f2c8c29dafb2541053cd82d5"}
Jul 02 20:33:16.558653 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:16.558610    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nbfbm" podStartSLOduration=2.00150723 podStartE2EDuration="5.558597093s" totalImagesPullingTime="3.557089863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:16.557697193 +0000 UTC m=+40.680708764" watchObservedRunningTime="2026-07-02 20:33:16.558597093 +0000 UTC m=+40.681608664"
Jul 02 20:33:17.546069 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:17.546021    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:17.549859 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:17.549833    2565 generic.go:356] "Generic (PLEG): container finished" podID="1419c726-721f-4fd9-bfb9-7043d578cf0c" containerID="db818c20a14b226726da364451189e658e504ba08628a80af220c5d23bae89b2" exitCode=0
Jul 02 20:33:17.550002 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:17.549902    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf9bn" event={"ID":"1419c726-721f-4fd9-bfb9-7043d578cf0c","Type":"ContainerDied","Data":"db818c20a14b226726da364451189e658e504ba08628a80af220c5d23bae89b2"}
Jul 02 20:33:17.619369 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:17.619336    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:18.402910 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:18.402737    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:18.555408 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:18.555376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf9bn" event={"ID":"1419c726-721f-4fd9-bfb9-7043d578cf0c","Type":"ContainerStarted","Data":"73cf37fa2687179f1caae4e991ab43d6d73a84c745fdbc8b0c74ed773d2fdffd"}
Jul 02 20:33:18.582727 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:18.582584    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zf9bn" podStartSLOduration=16.61728141 podStartE2EDuration="42.582564586s" totalImagesPullingTime="25.965283176s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:18.580922471 +0000 UTC m=+42.703934064" watchObservedRunningTime="2026-07-02 20:33:18.582564586 +0000 UTC m=+42.705576159"
Jul 02 20:33:19.437771 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:19.437722    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:19.437771 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:19.437779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:19.437949 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:19.437861    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:19.437949 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:19.437870    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 20:33:19.437949 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:19.437889    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdbbccf58-hhzk5: secret "image-registry-tls" not found
Jul 02 20:33:19.437949 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:19.437910    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls podName:d85f6511-daa2-4d28-a33d-d9e1b2efc9de nodeName:}" failed. No retries permitted until 2026-07-02 20:33:27.437898618 +0000 UTC m=+51.560910168 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls") pod "dns-default-glq7r" (UID: "d85f6511-daa2-4d28-a33d-d9e1b2efc9de") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:19.437949 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:19.437933    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls podName:0e9d32f7-b789-4219-8cde-e1594be4cad0 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:27.437920643 +0000 UTC m=+51.560932191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls") pod "image-registry-6cdbbccf58-hhzk5" (UID: "0e9d32f7-b789-4219-8cde-e1594be4cad0") : secret "image-registry-tls" not found
Jul 02 20:33:19.794973 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:19.794899    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:22.418546 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:22.418513    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:22.476865 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:22.476837    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:24.135128 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:24.135102    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:24.187949 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:24.187917    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:24.891294 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:24.891265    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:24.965265 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:24.965237    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:25.076020 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:25.075991    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:25.172462 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:25.172377    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:25.272213 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:25.272179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:26.077269 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:26.077233    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:26.331818 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:26.331724    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:26.431049 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:26.431015    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:27.261805 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:27.261742    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:27.498493 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:27.498450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:27.498904 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:27.498577    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 20:33:27.498904 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:27.498595    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdbbccf58-hhzk5: secret "image-registry-tls" not found
Jul 02 20:33:27.498904 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:27.498578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:27.498904 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:27.498650    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls podName:0e9d32f7-b789-4219-8cde-e1594be4cad0 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:43.498630967 +0000 UTC m=+67.621642516 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls") pod "image-registry-6cdbbccf58-hhzk5" (UID: "0e9d32f7-b789-4219-8cde-e1594be4cad0") : secret "image-registry-tls" not found
Jul 02 20:33:27.498904 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:27.498650    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:27.498904 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:27.498697    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls podName:d85f6511-daa2-4d28-a33d-d9e1b2efc9de nodeName:}" failed. No retries permitted until 2026-07-02 20:33:43.49868134 +0000 UTC m=+67.621692889 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls") pod "dns-default-glq7r" (UID: "d85f6511-daa2-4d28-a33d-d9e1b2efc9de") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:36.533216 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:36.533190    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pknqr"
Jul 02 20:33:36.685565 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:36.685529    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:36.785435 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:36.785354    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:38.580010 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:38.579978    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:41.999019 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:41.998975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs\") pod \"network-metrics-daemon-swrg9\" (UID: \"888788da-c29d-4687-a880-bcbbd7bfa01f\") " pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:33:42.001926 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.001906    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 20:33:42.009980 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:42.009961    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 20:33:42.010041 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:42.010025    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs podName:888788da-c29d-4687-a880-bcbbd7bfa01f nodeName:}" failed. No retries permitted until 2026-07-02 20:34:46.010009522 +0000 UTC m=+130.133021070 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs") pod "network-metrics-daemon-swrg9" (UID: "888788da-c29d-4687-a880-bcbbd7bfa01f") : secret "metrics-daemon-secret" not found
Jul 02 20:33:42.050476 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.050443    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:42.099719 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.099674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret\") pod \"global-pull-secret-syncer-n5bj2\" (UID: \"6d77247d-e7bf-42d1-9f3f-310fed10b354\") " pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:33:42.102314 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.102298    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 20:33:42.114363 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.114338    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d77247d-e7bf-42d1-9f3f-310fed10b354-original-pull-secret\") pod \"global-pull-secret-syncer-n5bj2\" (UID: \"6d77247d-e7bf-42d1-9f3f-310fed10b354\") " pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:33:42.150739 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.150701    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:42.200632 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.200604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k57b\" (UniqueName: \"kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b\") pod \"network-check-target-sfbr9\" (UID: \"c3e0c687-ff13-4f04-a0b8-a69cc711f130\") " pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:33:42.209036 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.209007    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:42.209173 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.209122    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 20:33:42.213487 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.213469    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 20:33:42.223951 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.223931    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k57b\" (UniqueName: \"kubernetes.io/projected/c3e0c687-ff13-4f04-a0b8-a69cc711f130-kube-api-access-2k57b\") pod \"network-check-target-sfbr9\" (UID: \"c3e0c687-ff13-4f04-a0b8-a69cc711f130\") " pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:33:42.410545 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.410522    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w2d5j\""
Jul 02 20:33:42.414687 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.414673    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n5bj2"
Jul 02 20:33:42.418579 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.418565    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:33:42.541453 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.541418    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n5bj2"]
Jul 02 20:33:42.544861 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:33:42.544836    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d77247d_e7bf_42d1_9f3f_310fed10b354.slice/crio-ac392c0c1878bf1ddc5231e96183b74d6fd17c0e5b8e2b3dc93817367761314b WatchSource:0}: Error finding container ac392c0c1878bf1ddc5231e96183b74d6fd17c0e5b8e2b3dc93817367761314b: Status 404 returned error can't find the container with id ac392c0c1878bf1ddc5231e96183b74d6fd17c0e5b8e2b3dc93817367761314b
Jul 02 20:33:42.556823 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.556800    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sfbr9"]
Jul 02 20:33:42.560628 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:33:42.560586    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e0c687_ff13_4f04_a0b8_a69cc711f130.slice/crio-8f3967cb240339465345e07d42fdca8c9d5b9bf06dd29414427102985ea848f8 WatchSource:0}: Error finding container 8f3967cb240339465345e07d42fdca8c9d5b9bf06dd29414427102985ea848f8: Status 404 returned error can't find the container with id 8f3967cb240339465345e07d42fdca8c9d5b9bf06dd29414427102985ea848f8
Jul 02 20:33:42.613813 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.613779    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sfbr9" event={"ID":"c3e0c687-ff13-4f04-a0b8-a69cc711f130","Type":"ContainerStarted","Data":"8f3967cb240339465345e07d42fdca8c9d5b9bf06dd29414427102985ea848f8"}
Jul 02 20:33:42.614819 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:42.614797    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n5bj2" event={"ID":"6d77247d-e7bf-42d1-9f3f-310fed10b354","Type":"ContainerStarted","Data":"ac392c0c1878bf1ddc5231e96183b74d6fd17c0e5b8e2b3dc93817367761314b"}
Jul 02 20:33:43.508252 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:43.508211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:33:43.508714 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:43.508317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:33:43.508714 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:43.508323    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:43.508714 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:43.508396    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls podName:d85f6511-daa2-4d28-a33d-d9e1b2efc9de nodeName:}" failed. No retries permitted until 2026-07-02 20:34:15.508377263 +0000 UTC m=+99.631388823 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls") pod "dns-default-glq7r" (UID: "d85f6511-daa2-4d28-a33d-d9e1b2efc9de") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:43.508714 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:43.508417    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 20:33:43.508714 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:43.508428    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdbbccf58-hhzk5: secret "image-registry-tls" not found
Jul 02 20:33:43.508714 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:43.508460    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls podName:0e9d32f7-b789-4219-8cde-e1594be4cad0 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:15.508450444 +0000 UTC m=+99.631462007 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls") pod "image-registry-6cdbbccf58-hhzk5" (UID: "0e9d32f7-b789-4219-8cde-e1594be4cad0") : secret "image-registry-tls" not found
Jul 02 20:33:44.784913 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:44.784874    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:44.838395 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:44.838361    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:47.628921 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:47.628866    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sfbr9" event={"ID":"c3e0c687-ff13-4f04-a0b8-a69cc711f130","Type":"ContainerStarted","Data":"730d67e2be3a65d33f7ada488b597cbc0018e5c79630e72348550528de85b925"}
Jul 02 20:33:47.629290 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:47.629001    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:33:47.630397 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:47.630368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n5bj2" event={"ID":"6d77247d-e7bf-42d1-9f3f-310fed10b354","Type":"ContainerStarted","Data":"d9ea4ed85f4a3a6c3f0f14726c962e1279fe661a6e384f05bd2f1574a7d19fb6"}
Jul 02 20:33:47.645640 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:47.645596    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sfbr9" podStartSLOduration=66.710257355 podStartE2EDuration="1m11.645583365s" totalImagesPullingTime="4.93532601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:32:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:47.644665092 +0000 UTC m=+71.767676664" watchObservedRunningTime="2026-07-02 20:33:47.645583365 +0000 UTC m=+71.768594956"
Jul 02 20:33:47.658094 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:47.657974    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n5bj2" podStartSLOduration=65.701226953 podStartE2EDuration="1m10.65795673s" totalImagesPullingTime="4.956729777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:47.65761949 +0000 UTC m=+71.780631074" watchObservedRunningTime="2026-07-02 20:33:47.65795673 +0000 UTC m=+71.780968306"
Jul 02 20:33:55.013090 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.013056    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp"]
Jul 02 20:33:55.017192 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.017171    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-424b9"]
Jul 02 20:33:55.017320 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.017289    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp"
Jul 02 20:33:55.019969 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.019947    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:33:55.020925 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.020907    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-b8nhd\""
Jul 02 20:33:55.021935 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.021921    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:33:55.022883 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.022864    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 02 20:33:55.022988 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.022966    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 02 20:33:55.023052 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.022995    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rbgwh\""
Jul 02 20:33:55.023240 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.023224    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 02 20:33:55.023320 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.023291    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 02 20:33:55.023320 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.023294    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 02 20:33:55.024418 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.024400    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:33:55.030353 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.030329    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 02 20:33:55.037991 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.037961    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp"]
Jul 02 20:33:55.038868 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.038849    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-424b9"]
Jul 02 20:33:55.091239 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.091201    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mjpsp\" (UID: \"e899212f-6ac8-49bc-be02-969ebd39a92c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp"
Jul 02 20:33:55.091239 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.091239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f72c892a-6de0-401e-9db4-aa036b2a4164-config\") pod \"console-operator-68b757fb67-424b9\" (UID: \"f72c892a-6de0-401e-9db4-aa036b2a4164\") " pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:33:55.091453 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.091265    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f72c892a-6de0-401e-9db4-aa036b2a4164-serving-cert\") pod \"console-operator-68b757fb67-424b9\" (UID: \"f72c892a-6de0-401e-9db4-aa036b2a4164\") " pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:33:55.091453 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.091353    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f72c892a-6de0-401e-9db4-aa036b2a4164-trusted-ca\") pod \"console-operator-68b757fb67-424b9\" (UID: \"f72c892a-6de0-401e-9db4-aa036b2a4164\") " pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:33:55.091453 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.091385    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldz8l\" (UniqueName: \"kubernetes.io/projected/f72c892a-6de0-401e-9db4-aa036b2a4164-kube-api-access-ldz8l\") pod \"console-operator-68b757fb67-424b9\" (UID: \"f72c892a-6de0-401e-9db4-aa036b2a4164\") " pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:33:55.091453 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.091405    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gtm9\" (UniqueName: \"kubernetes.io/projected/e899212f-6ac8-49bc-be02-969ebd39a92c-kube-api-access-9gtm9\") pod \"cluster-samples-operator-56fcf86bf-mjpsp\" (UID: \"e899212f-6ac8-49bc-be02-969ebd39a92c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp"
Jul 02 20:33:55.173482 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.173450    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:55.192138 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.192108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f72c892a-6de0-401e-9db4-aa036b2a4164-config\") pod \"console-operator-68b757fb67-424b9\" (UID: \"f72c892a-6de0-401e-9db4-aa036b2a4164\") " pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:33:55.192228 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.192154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f72c892a-6de0-401e-9db4-aa036b2a4164-serving-cert\") pod \"console-operator-68b757fb67-424b9\" (UID: \"f72c892a-6de0-401e-9db4-aa036b2a4164\") " pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:33:55.192228 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.192174    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f72c892a-6de0-401e-9db4-aa036b2a4164-trusted-ca\") pod \"console-operator-68b757fb67-424b9\" (UID: \"f72c892a-6de0-401e-9db4-aa036b2a4164\") " pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:33:55.192228 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.192193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldz8l\" (UniqueName: \"kubernetes.io/projected/f72c892a-6de0-401e-9db4-aa036b2a4164-kube-api-access-ldz8l\") pod \"console-operator-68b757fb67-424b9\" (UID: \"f72c892a-6de0-401e-9db4-aa036b2a4164\") " pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:33:55.192228 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.192209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gtm9\" (UniqueName: \"kubernetes.io/projected/e899212f-6ac8-49bc-be02-969ebd39a92c-kube-api-access-9gtm9\") pod \"cluster-samples-operator-56fcf86bf-mjpsp\" (UID: \"e899212f-6ac8-49bc-be02-969ebd39a92c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp"
Jul 02 20:33:55.192363 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.192260    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mjpsp\" (UID: \"e899212f-6ac8-49bc-be02-969ebd39a92c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp"
Jul 02 20:33:55.192401 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:55.192361    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 20:33:55.192449 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:55.192429    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls podName:e899212f-6ac8-49bc-be02-969ebd39a92c nodeName:}" failed. No retries permitted until 2026-07-02 20:33:55.692410511 +0000 UTC m=+79.815422062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mjpsp" (UID: "e899212f-6ac8-49bc-be02-969ebd39a92c") : secret "samples-operator-tls" not found
Jul 02 20:33:55.192871 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.192840    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f72c892a-6de0-401e-9db4-aa036b2a4164-config\") pod \"console-operator-68b757fb67-424b9\" (UID: \"f72c892a-6de0-401e-9db4-aa036b2a4164\") " pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:33:55.193018 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.193000    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f72c892a-6de0-401e-9db4-aa036b2a4164-trusted-ca\") pod \"console-operator-68b757fb67-424b9\" (UID: \"f72c892a-6de0-401e-9db4-aa036b2a4164\") " pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:33:55.194471 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.194455    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f72c892a-6de0-401e-9db4-aa036b2a4164-serving-cert\") pod \"console-operator-68b757fb67-424b9\" (UID: \"f72c892a-6de0-401e-9db4-aa036b2a4164\") " pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:33:55.203779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.203732    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gtm9\" (UniqueName: \"kubernetes.io/projected/e899212f-6ac8-49bc-be02-969ebd39a92c-kube-api-access-9gtm9\") pod \"cluster-samples-operator-56fcf86bf-mjpsp\" (UID: \"e899212f-6ac8-49bc-be02-969ebd39a92c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp"
Jul 02 20:33:55.203882 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.203797    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldz8l\" (UniqueName: \"kubernetes.io/projected/f72c892a-6de0-401e-9db4-aa036b2a4164-kube-api-access-ldz8l\") pod \"console-operator-68b757fb67-424b9\" (UID: \"f72c892a-6de0-401e-9db4-aa036b2a4164\") " pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:33:55.275994 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.275904    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:55.332945 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.332914    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:33:55.458471 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.458439    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-424b9"]
Jul 02 20:33:55.462032 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:33:55.462004    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf72c892a_6de0_401e_9db4_aa036b2a4164.slice/crio-206a0efe0c1e91861e9f98cf8f478fcf465477e5c404df1eaf4933f1fd8504d4 WatchSource:0}: Error finding container 206a0efe0c1e91861e9f98cf8f478fcf465477e5c404df1eaf4933f1fd8504d4: Status 404 returned error can't find the container with id 206a0efe0c1e91861e9f98cf8f478fcf465477e5c404df1eaf4933f1fd8504d4
Jul 02 20:33:55.651994 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.651959    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-424b9" event={"ID":"f72c892a-6de0-401e-9db4-aa036b2a4164","Type":"ContainerStarted","Data":"206a0efe0c1e91861e9f98cf8f478fcf465477e5c404df1eaf4933f1fd8504d4"}
Jul 02 20:33:55.695723 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:55.695684    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mjpsp\" (UID: \"e899212f-6ac8-49bc-be02-969ebd39a92c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp"
Jul 02 20:33:55.695896 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:55.695825    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 20:33:55.695896 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:55.695879    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls podName:e899212f-6ac8-49bc-be02-969ebd39a92c nodeName:}" failed. No retries permitted until 2026-07-02 20:33:56.695864947 +0000 UTC m=+80.818876497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mjpsp" (UID: "e899212f-6ac8-49bc-be02-969ebd39a92c") : secret "samples-operator-tls" not found
Jul 02 20:33:56.703331 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:56.703290    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mjpsp\" (UID: \"e899212f-6ac8-49bc-be02-969ebd39a92c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp"
Jul 02 20:33:56.703851 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:56.703456    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 20:33:56.703851 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:56.703539    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls podName:e899212f-6ac8-49bc-be02-969ebd39a92c nodeName:}" failed. No retries permitted until 2026-07-02 20:33:58.703518245 +0000 UTC m=+82.826529796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mjpsp" (UID: "e899212f-6ac8-49bc-be02-969ebd39a92c") : secret "samples-operator-tls" not found
Jul 02 20:33:57.658473 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:57.658398    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/0.log"
Jul 02 20:33:57.658473 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:57.658435    2565 generic.go:356] "Generic (PLEG): container finished" podID="f72c892a-6de0-401e-9db4-aa036b2a4164" containerID="1ce883914d5839614a8ce68da50fd6d915cc0db13a189352ae043dc43534ecbe" exitCode=255
Jul 02 20:33:57.658642 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:57.658482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-424b9" event={"ID":"f72c892a-6de0-401e-9db4-aa036b2a4164","Type":"ContainerDied","Data":"1ce883914d5839614a8ce68da50fd6d915cc0db13a189352ae043dc43534ecbe"}
Jul 02 20:33:57.658692 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:57.658680    2565 scope.go:117] "RemoveContainer" containerID="1ce883914d5839614a8ce68da50fd6d915cc0db13a189352ae043dc43534ecbe"
Jul 02 20:33:58.137387 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:58.137353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:58.191204 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:58.191172    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:58.662480 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:58.662456    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 20:33:58.662880 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:58.662866    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/0.log"
Jul 02 20:33:58.662957 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:58.662902    2565 generic.go:356] "Generic (PLEG): container finished" podID="f72c892a-6de0-401e-9db4-aa036b2a4164" containerID="e9537dd56c29997390faaefd12cebb46ae1a8efd59c18274c24fa7e4dbb05cd1" exitCode=255
Jul 02 20:33:58.662957 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:58.662931    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-424b9" event={"ID":"f72c892a-6de0-401e-9db4-aa036b2a4164","Type":"ContainerDied","Data":"e9537dd56c29997390faaefd12cebb46ae1a8efd59c18274c24fa7e4dbb05cd1"}
Jul 02 20:33:58.663039 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:58.662991    2565 scope.go:117] "RemoveContainer" containerID="1ce883914d5839614a8ce68da50fd6d915cc0db13a189352ae043dc43534ecbe"
Jul 02 20:33:58.663178 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:58.663159    2565 scope.go:117] "RemoveContainer" containerID="e9537dd56c29997390faaefd12cebb46ae1a8efd59c18274c24fa7e4dbb05cd1"
Jul 02 20:33:58.663342 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:58.663310    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-424b9_openshift-console-operator(f72c892a-6de0-401e-9db4-aa036b2a4164)\"" pod="openshift-console-operator/console-operator-68b757fb67-424b9" podUID="f72c892a-6de0-401e-9db4-aa036b2a4164"
Jul 02 20:33:58.720343 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:58.720310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mjpsp\" (UID: \"e899212f-6ac8-49bc-be02-969ebd39a92c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp"
Jul 02 20:33:58.720524 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:58.720467    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 20:33:58.720606 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:58.720547    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls podName:e899212f-6ac8-49bc-be02-969ebd39a92c nodeName:}" failed. No retries permitted until 2026-07-02 20:34:02.720523835 +0000 UTC m=+86.843535383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mjpsp" (UID: "e899212f-6ac8-49bc-be02-969ebd39a92c") : secret "samples-operator-tls" not found
Jul 02 20:33:59.667097 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:59.667072    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 20:33:59.667548 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:33:59.667454    2565 scope.go:117] "RemoveContainer" containerID="e9537dd56c29997390faaefd12cebb46ae1a8efd59c18274c24fa7e4dbb05cd1"
Jul 02 20:33:59.667652 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:33:59.667629    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-424b9_openshift-console-operator(f72c892a-6de0-401e-9db4-aa036b2a4164)\"" pod="openshift-console-operator/console-operator-68b757fb67-424b9" podUID="f72c892a-6de0-401e-9db4-aa036b2a4164"
Jul 02 20:34:00.026110 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.026027    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:00.082326 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.082292    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:00.263843 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.263803    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:00.365036 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.365007    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:00.497260 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.497234    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:00.547951 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.547923    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jkczh"]
Jul 02 20:34:00.552358 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.552340    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:00.554960 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.554941    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 20:34:00.555049 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.554941    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 20:34:00.555283 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.555268    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 20:34:00.556195 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.556180    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 20:34:00.556243 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.556182    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p6z6g\""
Jul 02 20:34:00.562174 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.562154    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jkczh"]
Jul 02 20:34:00.587623 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.587593    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:00.634918 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.634855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rw6r\" (UniqueName: \"kubernetes.io/projected/8975be29-803c-4f6d-a631-c7b09c812664-kube-api-access-4rw6r\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:00.634918 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.634885    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:00.635036 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.634935    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8975be29-803c-4f6d-a631-c7b09c812664-crio-socket\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:00.635036 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.634963    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:00.635036 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.634983    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8975be29-803c-4f6d-a631-c7b09c812664-data-volume\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:00.648269 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.648245    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:00.736005 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.735975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8975be29-803c-4f6d-a631-c7b09c812664-crio-socket\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:00.736330 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.736015    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:00.736330 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.736034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8975be29-803c-4f6d-a631-c7b09c812664-data-volume\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:00.736330 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.736075    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rw6r\" (UniqueName: \"kubernetes.io/projected/8975be29-803c-4f6d-a631-c7b09c812664-kube-api-access-4rw6r\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:00.736330 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.736092    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8975be29-803c-4f6d-a631-c7b09c812664-crio-socket\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:00.736330 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.736095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:00.736330 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:00.736133    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:34:00.736330 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:00.736224    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 20:34:00.736330 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:00.736228    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls podName:8975be29-803c-4f6d-a631-c7b09c812664 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:01.236207763 +0000 UTC m=+85.359219324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jkczh" (UID: "8975be29-803c-4f6d-a631-c7b09c812664") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:34:00.736330 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:00.736303    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm podName:8975be29-803c-4f6d-a631-c7b09c812664 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:01.236283923 +0000 UTC m=+85.359295482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jkczh" (UID: "8975be29-803c-4f6d-a631-c7b09c812664") : configmap "kube-rbac-proxy" not found
Jul 02 20:34:00.736330 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.736327    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8975be29-803c-4f6d-a631-c7b09c812664-data-volume\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:00.745224 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.745207    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rw6r\" (UniqueName: \"kubernetes.io/projected/8975be29-803c-4f6d-a631-c7b09c812664-kube-api-access-4rw6r\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:00.981624 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:00.981553    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:01.071888 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:01.071861    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:01.172496 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:01.172468    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:01.239028 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:01.238968    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:01.239028 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:01.239023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:01.239164 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:01.239091    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 20:34:01.239164 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:01.239105    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:34:01.239164 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:01.239156    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm podName:8975be29-803c-4f6d-a631-c7b09c812664 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:02.239139961 +0000 UTC m=+86.362151535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jkczh" (UID: "8975be29-803c-4f6d-a631-c7b09c812664") : configmap "kube-rbac-proxy" not found
Jul 02 20:34:01.239261 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:01.239169    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls podName:8975be29-803c-4f6d-a631-c7b09c812664 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:02.239163428 +0000 UTC m=+86.362174978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jkczh" (UID: "8975be29-803c-4f6d-a631-c7b09c812664") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:34:02.248434 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:02.248382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:02.248858 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:02.248487    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:02.248858 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:02.248510    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 20:34:02.248858 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:02.248576    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm podName:8975be29-803c-4f6d-a631-c7b09c812664 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:04.2485585 +0000 UTC m=+88.371570065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jkczh" (UID: "8975be29-803c-4f6d-a631-c7b09c812664") : configmap "kube-rbac-proxy" not found
Jul 02 20:34:02.248858 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:02.248633    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:34:02.248858 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:02.248684    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls podName:8975be29-803c-4f6d-a631-c7b09c812664 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:04.248672078 +0000 UTC m=+88.371683626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jkczh" (UID: "8975be29-803c-4f6d-a631-c7b09c812664") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:34:02.538139 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:02.538068    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m5mhl_1f6346a1-13f2-49ba-9b76-1fb229b002d3/dns-node-resolver/0.log"
Jul 02 20:34:02.635864 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:02.635833    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:02.702014 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:02.701982    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:02.752928 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:02.752901    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mjpsp\" (UID: \"e899212f-6ac8-49bc-be02-969ebd39a92c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp"
Jul 02 20:34:02.753066 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:02.753050    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 20:34:02.753119 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:02.753111    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls podName:e899212f-6ac8-49bc-be02-969ebd39a92c nodeName:}" failed. No retries permitted until 2026-07-02 20:34:10.753096236 +0000 UTC m=+94.876107785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mjpsp" (UID: "e899212f-6ac8-49bc-be02-969ebd39a92c") : secret "samples-operator-tls" not found
Jul 02 20:34:03.129719 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:03.129682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:03.223673 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:03.223641    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:03.568373 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:03.568294    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:03.738289 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:03.738259    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x26xq_3eee63fc-ae15-428d-8a57-390c573de403/node-ca/0.log"
Jul 02 20:34:04.185346 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:04.185312    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:04.263873 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:04.263847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:04.264000 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:04.263917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:04.264043 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:04.264007    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 20:34:04.264076 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:04.264069    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm podName:8975be29-803c-4f6d-a631-c7b09c812664 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:08.264051261 +0000 UTC m=+92.387062824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jkczh" (UID: "8975be29-803c-4f6d-a631-c7b09c812664") : configmap "kube-rbac-proxy" not found
Jul 02 20:34:04.264137 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:04.264009    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:34:04.264137 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:04.264136    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls podName:8975be29-803c-4f6d-a631-c7b09c812664 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:08.264123236 +0000 UTC m=+92.387134785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jkczh" (UID: "8975be29-803c-4f6d-a631-c7b09c812664") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:34:04.340660 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:04.340635    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nbfbm_a523904c-ccf1-4bb8-9dd8-9be32d8492da/serve-healthcheck-canary/0.log"
Jul 02 20:34:04.549575 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:04.549500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:04.650785 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:04.650741    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:04.752829 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:04.752794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:04.948911 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:04.948884    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:05.333231 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:05.333124    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:34:05.333231 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:05.333196    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:34:05.333591 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:05.333572    2565 scope.go:117] "RemoveContainer" containerID="e9537dd56c29997390faaefd12cebb46ae1a8efd59c18274c24fa7e4dbb05cd1"
Jul 02 20:34:05.333799 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:05.333736    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-424b9_openshift-console-operator(f72c892a-6de0-401e-9db4-aa036b2a4164)\"" pod="openshift-console-operator/console-operator-68b757fb67-424b9" podUID="f72c892a-6de0-401e-9db4-aa036b2a4164"
Jul 02 20:34:05.684514 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:05.684488    2565 scope.go:117] "RemoveContainer" containerID="e9537dd56c29997390faaefd12cebb46ae1a8efd59c18274c24fa7e4dbb05cd1"
Jul 02 20:34:05.684867 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:05.684636    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-424b9_openshift-console-operator(f72c892a-6de0-401e-9db4-aa036b2a4164)\"" pod="openshift-console-operator/console-operator-68b757fb67-424b9" podUID="f72c892a-6de0-401e-9db4-aa036b2a4164"
Jul 02 20:34:06.141296 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:06.141265    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:06.241433 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:06.241401    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:06.353122 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:06.353086    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:06.547226 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:06.547141    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:06.744038 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:06.744006    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:06.954214 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:06.954179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:07.755073 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:07.755038    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:07.975795 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:07.975745    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:08.156020 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:08.155988    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:08.254851 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:08.254818    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:08.294662 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:08.294635    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:08.294829 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:08.294703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:08.294829 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:08.294748    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 20:34:08.294829 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:08.294813    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:34:08.294829 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:08.294824    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm podName:8975be29-803c-4f6d-a631-c7b09c812664 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:16.294806421 +0000 UTC m=+100.417817969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jkczh" (UID: "8975be29-803c-4f6d-a631-c7b09c812664") : configmap "kube-rbac-proxy" not found
Jul 02 20:34:08.294986 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:08.294854    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls podName:8975be29-803c-4f6d-a631-c7b09c812664 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:16.294843406 +0000 UTC m=+100.417854955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jkczh" (UID: "8975be29-803c-4f6d-a631-c7b09c812664") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:34:08.374527 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:08.374491    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:08.955930 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:08.955894    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:09.056869 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:09.056831    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:09.346978 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:09.346943    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:09.743173 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:09.743089    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:09.943748 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:09.943720    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:10.345274 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:10.345247    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:10.812185 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:10.812087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mjpsp\" (UID: \"e899212f-6ac8-49bc-be02-969ebd39a92c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp"
Jul 02 20:34:10.814482 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:10.814456    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e899212f-6ac8-49bc-be02-969ebd39a92c-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mjpsp\" (UID: \"e899212f-6ac8-49bc-be02-969ebd39a92c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp"
Jul 02 20:34:10.928462 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:10.928425    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp"
Jul 02 20:34:11.046700 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:11.046668    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp"]
Jul 02 20:34:11.149920 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:11.149888    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:11.249200 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:11.249170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:11.546913 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:11.546882    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:11.700002 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:11.699951    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp" event={"ID":"e899212f-6ac8-49bc-be02-969ebd39a92c","Type":"ContainerStarted","Data":"eee13c9027f77524c1f8290807a8ec9bef39cf13d7eb3700e69ddee89bea8055"}
Jul 02 20:34:11.740729 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:11.740694    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:11.940179 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:11.940151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:12.141678 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:12.141643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:13.148138 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:13.148105    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:13.245819 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:13.245789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:13.345811 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:13.345782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:13.539542 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:13.539449    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:13.710000 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:13.709963    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp" event={"ID":"e899212f-6ac8-49bc-be02-969ebd39a92c","Type":"ContainerStarted","Data":"d477a396c41fa06b9cbf5e844cd77f295f0f99e535b87fdd71ccff0723989f90"}
Jul 02 20:34:13.710192 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:13.710052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp" event={"ID":"e899212f-6ac8-49bc-be02-969ebd39a92c","Type":"ContainerStarted","Data":"0003485b9f81dd10d04e2a04837fbbfce320d7eb80b89c429367b0687a3cb3b0"}
Jul 02 20:34:13.726471 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:13.726421    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mjpsp" podStartSLOduration=18.039045674 podStartE2EDuration="19.72640712s" totalImagesPullingTime="1.687361446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:13.725677326 +0000 UTC m=+97.848688898" watchObservedRunningTime="2026-07-02 20:34:13.72640712 +0000 UTC m=+97.849418691"
Jul 02 20:34:13.952776 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:13.952731    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:14.542290 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:14.542259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:14.693200 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:14.693165    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:14.793530 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:14.793449    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:14.949524 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:14.949494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:15.552475 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:15.552438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:34:15.552886 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:15.552516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:34:15.554773 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:15.554733    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d85f6511-daa2-4d28-a33d-d9e1b2efc9de-metrics-tls\") pod \"dns-default-glq7r\" (UID: \"d85f6511-daa2-4d28-a33d-d9e1b2efc9de\") " pod="openshift-dns/dns-default-glq7r"
Jul 02 20:34:15.554878 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:15.554822    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls\") pod \"image-registry-6cdbbccf58-hhzk5\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") " pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:34:15.581576 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:15.581547    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kxfdk\""
Jul 02 20:34:15.589813 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:15.589786    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:34:15.613146 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:15.613119    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w7dxd\""
Jul 02 20:34:15.620348 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:15.620324    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-glq7r"
Jul 02 20:34:15.736923 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:15.736875    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cdbbccf58-hhzk5"]
Jul 02 20:34:15.740107 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:34:15.740082    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9d32f7_b789_4219_8cde_e1594be4cad0.slice/crio-83f31c8e0d5a0cfccf92706980c1d54d137d7eb86a1bb13d1a5301eb82ccc247 WatchSource:0}: Error finding container 83f31c8e0d5a0cfccf92706980c1d54d137d7eb86a1bb13d1a5301eb82ccc247: Status 404 returned error can't find the container with id 83f31c8e0d5a0cfccf92706980c1d54d137d7eb86a1bb13d1a5301eb82ccc247
Jul 02 20:34:15.753212 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:15.753186    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-glq7r"]
Jul 02 20:34:15.757356 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:34:15.757333    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd85f6511_daa2_4d28_a33d_d9e1b2efc9de.slice/crio-96b124897d3dc55d6c2991905c4f3686d8611ffe31400c12ac26a311d9482ff1 WatchSource:0}: Error finding container 96b124897d3dc55d6c2991905c4f3686d8611ffe31400c12ac26a311d9482ff1: Status 404 returned error can't find the container with id 96b124897d3dc55d6c2991905c4f3686d8611ffe31400c12ac26a311d9482ff1
Jul 02 20:34:16.357336 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:16.357303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:16.357607 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:16.357372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:16.357964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:16.357940    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8975be29-803c-4f6d-a631-c7b09c812664-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:16.359889 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:16.359862    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8975be29-803c-4f6d-a631-c7b09c812664-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jkczh\" (UID: \"8975be29-803c-4f6d-a631-c7b09c812664\") " pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:16.460596 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:16.460562    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jkczh"
Jul 02 20:34:16.611268 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:16.611176    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jkczh"]
Jul 02 20:34:16.618749 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:34:16.618694    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8975be29_803c_4f6d_a631_c7b09c812664.slice/crio-5eba4834b75adf74008ca9cc35f8099c2fe49e5f76dcc183da6e73e8ed044c0d WatchSource:0}: Error finding container 5eba4834b75adf74008ca9cc35f8099c2fe49e5f76dcc183da6e73e8ed044c0d: Status 404 returned error can't find the container with id 5eba4834b75adf74008ca9cc35f8099c2fe49e5f76dcc183da6e73e8ed044c0d
Jul 02 20:34:16.722041 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:16.721998    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jkczh" event={"ID":"8975be29-803c-4f6d-a631-c7b09c812664","Type":"ContainerStarted","Data":"5eba4834b75adf74008ca9cc35f8099c2fe49e5f76dcc183da6e73e8ed044c0d"}
Jul 02 20:34:16.723817 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:16.723786    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5" event={"ID":"0e9d32f7-b789-4219-8cde-e1594be4cad0","Type":"ContainerStarted","Data":"7394512a485e1a21c07139dd427039a40580b22e599283f50f0ef019fe3b789e"}
Jul 02 20:34:16.723965 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:16.723837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5" event={"ID":"0e9d32f7-b789-4219-8cde-e1594be4cad0","Type":"ContainerStarted","Data":"83f31c8e0d5a0cfccf92706980c1d54d137d7eb86a1bb13d1a5301eb82ccc247"}
Jul 02 20:34:16.723965 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:16.723874    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:34:16.724909 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:16.724877    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-glq7r" event={"ID":"d85f6511-daa2-4d28-a33d-d9e1b2efc9de","Type":"ContainerStarted","Data":"96b124897d3dc55d6c2991905c4f3686d8611ffe31400c12ac26a311d9482ff1"}
Jul 02 20:34:16.744462 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:16.744412    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5" podStartSLOduration=99.744398051 podStartE2EDuration="1m39.744398051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:32:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:16.744335072 +0000 UTC m=+100.867346642" watchObservedRunningTime="2026-07-02 20:34:16.744398051 +0000 UTC m=+100.867409599"
Jul 02 20:34:18.404428 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:18.404384    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:18.456307 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:18.456271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:18.635891 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:18.635864    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sfbr9"
Jul 02 20:34:18.732810 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:18.732708    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-glq7r" event={"ID":"d85f6511-daa2-4d28-a33d-d9e1b2efc9de","Type":"ContainerStarted","Data":"c2e92b247e565321a014809a724659575f0bbe578fe57c7797e2cc99c2bc98b6"}
Jul 02 20:34:18.732810 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:18.732792    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-glq7r"
Jul 02 20:34:18.732810 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:18.732811    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-glq7r" event={"ID":"d85f6511-daa2-4d28-a33d-d9e1b2efc9de","Type":"ContainerStarted","Data":"dff83aa0eba76219f393779ea767499ca7d35d560eb5e44cb79cdfa000db4fa3"}
Jul 02 20:34:18.749219 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:18.749093    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-glq7r" podStartSLOduration=65.787543605 podStartE2EDuration="1m7.749071923s" totalImagesPullingTime="1.961528318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:18.748651585 +0000 UTC m=+102.871663180" watchObservedRunningTime="2026-07-02 20:34:18.749071923 +0000 UTC m=+102.872083496"
Jul 02 20:34:19.293093 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:19.293063    2565 scope.go:117] "RemoveContainer" containerID="e9537dd56c29997390faaefd12cebb46ae1a8efd59c18274c24fa7e4dbb05cd1"
Jul 02 20:34:21.746142 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:21.746068    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 20:34:21.746591 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:21.746157    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-424b9" event={"ID":"f72c892a-6de0-401e-9db4-aa036b2a4164","Type":"ContainerStarted","Data":"eb76a9c31f5716def853a2670d41653bc9888dec143fc61d56e772ff6a89df77"}
Jul 02 20:34:21.746591 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:21.746496    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:34:21.747865 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:21.747842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jkczh" event={"ID":"8975be29-803c-4f6d-a631-c7b09c812664","Type":"ContainerStarted","Data":"cc698ca9f1020299f55032e6c5feeb03d0201aa25e6e6f094064bc1a1213b862"}
Jul 02 20:34:21.764238 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:21.764193    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-424b9" podStartSLOduration=25.831435052 podStartE2EDuration="27.764179684s" totalImagesPullingTime="1.932744632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:21.762301765 +0000 UTC m=+105.885313337" watchObservedRunningTime="2026-07-02 20:34:21.764179684 +0000 UTC m=+105.887191254"
Jul 02 20:34:22.186019 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:22.185986    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-424b9"
Jul 02 20:34:22.360894 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:22.360860    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:22.462382 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:22.462345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:22.515194 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:22.515084    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:22.662303 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:22.662212    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:22.753487 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:22.753445    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jkczh" event={"ID":"8975be29-803c-4f6d-a631-c7b09c812664","Type":"ContainerStarted","Data":"4772b2db87d7ac38032f4b97e63d441aaf3eaec3a3b871982784eadd676a409e"}
Jul 02 20:34:23.071745 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:23.071662    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:23.173079 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:23.173045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:23.451627 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:23.451599    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:23.668210 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:23.668180    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:23.727704 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:23.727636    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:23.889265 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:23.889232    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6"]
Jul 02 20:34:23.897052 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:23.897029    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6"
Jul 02 20:34:23.902414 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:23.902170    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 20:34:23.902414 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:23.902171    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 02 20:34:23.902414 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:23.902171    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 20:34:23.902414 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:23.902269    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 20:34:23.902704 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:23.902544    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-l6pv8\""
Jul 02 20:34:23.909596 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:23.909553    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6"]
Jul 02 20:34:24.023557 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:24.023476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2lk5\" (UniqueName: \"kubernetes.io/projected/dc6c7832-b74f-47f0-a45d-6332d57bc7fb-kube-api-access-b2lk5\") pod \"managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6\" (UID: \"dc6c7832-b74f-47f0-a45d-6332d57bc7fb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6"
Jul 02 20:34:24.023557 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:24.023547    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc6c7832-b74f-47f0-a45d-6332d57bc7fb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6\" (UID: \"dc6c7832-b74f-47f0-a45d-6332d57bc7fb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6"
Jul 02 20:34:24.049198 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:24.049091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:24.124359 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:24.124330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc6c7832-b74f-47f0-a45d-6332d57bc7fb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6\" (UID: \"dc6c7832-b74f-47f0-a45d-6332d57bc7fb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6"
Jul 02 20:34:24.124540 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:24.124408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2lk5\" (UniqueName: \"kubernetes.io/projected/dc6c7832-b74f-47f0-a45d-6332d57bc7fb-kube-api-access-b2lk5\") pod \"managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6\" (UID: \"dc6c7832-b74f-47f0-a45d-6332d57bc7fb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6"
Jul 02 20:34:24.127210 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:24.127184    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc6c7832-b74f-47f0-a45d-6332d57bc7fb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6\" (UID: \"dc6c7832-b74f-47f0-a45d-6332d57bc7fb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6"
Jul 02 20:34:24.136047 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:24.136017    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2lk5\" (UniqueName: \"kubernetes.io/projected/dc6c7832-b74f-47f0-a45d-6332d57bc7fb-kube-api-access-b2lk5\") pod \"managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6\" (UID: \"dc6c7832-b74f-47f0-a45d-6332d57bc7fb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6"
Jul 02 20:34:24.144964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:24.144936    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:24.215552 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:24.215506    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6"
Jul 02 20:34:24.266957 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:24.266926    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:24.610882 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:24.610856    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6"]
Jul 02 20:34:24.613456 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:34:24.613427    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc6c7832_b74f_47f0_a45d_6332d57bc7fb.slice/crio-d6f6ab5ddb411974ef75e130631b3a4ef050af6649da3e1159bb1cab534e99dc WatchSource:0}: Error finding container d6f6ab5ddb411974ef75e130631b3a4ef050af6649da3e1159bb1cab534e99dc: Status 404 returned error can't find the container with id d6f6ab5ddb411974ef75e130631b3a4ef050af6649da3e1159bb1cab534e99dc
Jul 02 20:34:24.615969 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:24.615942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:24.760827 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:24.760716    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jkczh" event={"ID":"8975be29-803c-4f6d-a631-c7b09c812664","Type":"ContainerStarted","Data":"dacf2facaf58a4da8dcabc3ce2e326028c61dcec48eaf9111bef7df842fd7c9f"}
Jul 02 20:34:24.761750 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:24.761724    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6" event={"ID":"dc6c7832-b74f-47f0-a45d-6332d57bc7fb","Type":"ContainerStarted","Data":"d6f6ab5ddb411974ef75e130631b3a4ef050af6649da3e1159bb1cab534e99dc"}
Jul 02 20:34:24.777513 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:24.777424    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jkczh" podStartSLOduration=16.994356225 podStartE2EDuration="24.777408274s" totalImagesPullingTime="7.783052049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:34:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:24.777240432 +0000 UTC m=+108.900252003" watchObservedRunningTime="2026-07-02 20:34:24.777408274 +0000 UTC m=+108.900419847"
Jul 02 20:34:26.972885 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:26.972850    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:27.035934 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.035896    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:27.483014 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.482979    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cd9ff5876-hzpg9"]
Jul 02 20:34:27.485904 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.485884    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.488614 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.488593    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 20:34:27.488746 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.488655    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 20:34:27.488746 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.488600    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 20:34:27.489850 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.489833    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 20:34:27.490121 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.490107    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lqlnz\""
Jul 02 20:34:27.490216 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.490198    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 20:34:27.490273 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.490260    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 20:34:27.490367 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.490355    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 20:34:27.495803 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.495777    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cd9ff5876-hzpg9"]
Jul 02 20:34:27.663902 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.663868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-console-config\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.664041 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.663908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/840e6ff0-fc94-4748-9ada-260a7b07174c-console-serving-cert\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.664041 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.663929    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qh5b\" (UniqueName: \"kubernetes.io/projected/840e6ff0-fc94-4748-9ada-260a7b07174c-kube-api-access-7qh5b\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.664041 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.664010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-oauth-serving-cert\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.664183 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.664068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/840e6ff0-fc94-4748-9ada-260a7b07174c-console-oauth-config\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.664183 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.664101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-service-ca\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.765048 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.764958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-oauth-serving-cert\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.765048 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.765001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/840e6ff0-fc94-4748-9ada-260a7b07174c-console-oauth-config\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.765048 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.765020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-service-ca\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.765048 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.765059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-console-config\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.765360 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.765082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/840e6ff0-fc94-4748-9ada-260a7b07174c-console-serving-cert\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.765360 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.765098    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qh5b\" (UniqueName: \"kubernetes.io/projected/840e6ff0-fc94-4748-9ada-260a7b07174c-kube-api-access-7qh5b\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.765710 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.765680    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-oauth-serving-cert\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.765825 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.765683    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-service-ca\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.765825 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.765815    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-console-config\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.767379 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.767358    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/840e6ff0-fc94-4748-9ada-260a7b07174c-console-oauth-config\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.767457 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.767428    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/840e6ff0-fc94-4748-9ada-260a7b07174c-console-serving-cert\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.773487 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.773453    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qh5b\" (UniqueName: \"kubernetes.io/projected/840e6ff0-fc94-4748-9ada-260a7b07174c-kube-api-access-7qh5b\") pod \"console-7cd9ff5876-hzpg9\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") " pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.774863 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.774834    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6" event={"ID":"dc6c7832-b74f-47f0-a45d-6332d57bc7fb","Type":"ContainerStarted","Data":"677d467cbdc3e856ce5dd74830dbd6f7aa7be30efd83b319e9e538e92d4686eb"}
Jul 02 20:34:27.790229 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.790185    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bc9c7df88-wkwg6" podStartSLOduration=2.262534101 podStartE2EDuration="4.790173896s" totalImagesPullingTime="2.527639795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:27.790021807 +0000 UTC m=+111.913033378" watchObservedRunningTime="2026-07-02 20:34:27.790173896 +0000 UTC m=+111.913185468"
Jul 02 20:34:27.795162 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.795138    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:27.911613 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:27.911587    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cd9ff5876-hzpg9"]
Jul 02 20:34:27.914226 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:34:27.914202    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840e6ff0_fc94_4748_9ada_260a7b07174c.slice/crio-334a59bc17e80a21859db3f5aa42666576177e49b6a9023195f9b8e1099b1e7a WatchSource:0}: Error finding container 334a59bc17e80a21859db3f5aa42666576177e49b6a9023195f9b8e1099b1e7a: Status 404 returned error can't find the container with id 334a59bc17e80a21859db3f5aa42666576177e49b6a9023195f9b8e1099b1e7a
Jul 02 20:34:28.739679 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:28.739647    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-glq7r"
Jul 02 20:34:28.781005 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:28.780975    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd9ff5876-hzpg9" event={"ID":"840e6ff0-fc94-4748-9ada-260a7b07174c","Type":"ContainerStarted","Data":"334a59bc17e80a21859db3f5aa42666576177e49b6a9023195f9b8e1099b1e7a"}
Jul 02 20:34:29.879425 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:29.879389    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:29.983924 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:29.983887    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:30.079152 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:30.079107    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hvdgn"]
Jul 02 20:34:30.079331 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:30.079114    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:30.083572 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:30.083547    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hvdgn"
Jul 02 20:34:30.086693 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:30.086670    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 02 20:34:30.086825 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:30.086803    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-f25nb\""
Jul 02 20:34:30.093585 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:30.093563    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hvdgn"]
Jul 02 20:34:30.171128 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:30.171043    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:30.184483 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:30.184451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f5bab5f6-8643-4700-a643-2e895c0ea899-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-hvdgn\" (UID: \"f5bab5f6-8643-4700-a643-2e895c0ea899\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hvdgn"
Jul 02 20:34:30.285868 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:30.285826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f5bab5f6-8643-4700-a643-2e895c0ea899-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-hvdgn\" (UID: \"f5bab5f6-8643-4700-a643-2e895c0ea899\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hvdgn"
Jul 02 20:34:30.288480 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:30.288456    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f5bab5f6-8643-4700-a643-2e895c0ea899-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-hvdgn\" (UID: \"f5bab5f6-8643-4700-a643-2e895c0ea899\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hvdgn"
Jul 02 20:34:30.396007 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:30.395972    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hvdgn"
Jul 02 20:34:30.659245 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:30.659210    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hvdgn"]
Jul 02 20:34:30.662719 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:34:30.662692    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5bab5f6_8643_4700_a643_2e895c0ea899.slice/crio-306260353c180c51beb4484213e5b2049ff7b5c6b81505b6c5ebcc67cb7355be WatchSource:0}: Error finding container 306260353c180c51beb4484213e5b2049ff7b5c6b81505b6c5ebcc67cb7355be: Status 404 returned error can't find the container with id 306260353c180c51beb4484213e5b2049ff7b5c6b81505b6c5ebcc67cb7355be
Jul 02 20:34:30.789822 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:30.789710    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hvdgn" event={"ID":"f5bab5f6-8643-4700-a643-2e895c0ea899","Type":"ContainerStarted","Data":"306260353c180c51beb4484213e5b2049ff7b5c6b81505b6c5ebcc67cb7355be"}
Jul 02 20:34:30.791077 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:30.791054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd9ff5876-hzpg9" event={"ID":"840e6ff0-fc94-4748-9ada-260a7b07174c","Type":"ContainerStarted","Data":"a27b959ef97d85fede09d7ad1a14bd9d868c9fed016c6b2ff8494b18bc58b870"}
Jul 02 20:34:30.810538 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:30.810491    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cd9ff5876-hzpg9" podStartSLOduration=1.13989354 podStartE2EDuration="3.81047772s" totalImagesPullingTime="2.67058418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:30.809726879 +0000 UTC m=+114.932738450" watchObservedRunningTime="2026-07-02 20:34:30.81047772 +0000 UTC m=+114.933489290"
Jul 02 20:34:32.798813 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:32.798778    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hvdgn" event={"ID":"f5bab5f6-8643-4700-a643-2e895c0ea899","Type":"ContainerStarted","Data":"5741e3307e004a43d492cd93475e308492d77f394028cd1efd59f1f72f574794"}
Jul 02 20:34:32.799305 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:32.798968    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hvdgn"
Jul 02 20:34:32.803544 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:32.803522    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hvdgn"
Jul 02 20:34:32.814854 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:32.814814    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hvdgn" podStartSLOduration=1.682642239 podStartE2EDuration="2.814801722s" totalImagesPullingTime="1.132159483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:32.81423923 +0000 UTC m=+116.937250800" watchObservedRunningTime="2026-07-02 20:34:32.814801722 +0000 UTC m=+116.937813292"
Jul 02 20:34:33.092725 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.092696    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:33.123924 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.123896    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"]
Jul 02 20:34:33.126986 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.126961    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"
Jul 02 20:34:33.129924 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.129905    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 20:34:33.133373 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.133350    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 02 20:34:33.133551 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.133536    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 02 20:34:33.133618 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.133552    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dxz8z\""
Jul 02 20:34:33.133618 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.133579    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 20:34:33.133730 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.133712    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 20:34:33.139436 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.139417    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"]
Jul 02 20:34:33.162726 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.162696    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:33.312750 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.312698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b742864-dee4-40ef-a7a1-6f65a41d16ff-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-fl5dr\" (UID: \"6b742864-dee4-40ef-a7a1-6f65a41d16ff\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"
Jul 02 20:34:33.312937 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.312805    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b742864-dee4-40ef-a7a1-6f65a41d16ff-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-fl5dr\" (UID: \"6b742864-dee4-40ef-a7a1-6f65a41d16ff\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"
Jul 02 20:34:33.312937 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.312839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d6rx\" (UniqueName: \"kubernetes.io/projected/6b742864-dee4-40ef-a7a1-6f65a41d16ff-kube-api-access-4d6rx\") pod \"prometheus-operator-567f7b8b7c-fl5dr\" (UID: \"6b742864-dee4-40ef-a7a1-6f65a41d16ff\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"
Jul 02 20:34:33.312937 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.312910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b742864-dee4-40ef-a7a1-6f65a41d16ff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-fl5dr\" (UID: \"6b742864-dee4-40ef-a7a1-6f65a41d16ff\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"
Jul 02 20:34:33.413889 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.413813    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b742864-dee4-40ef-a7a1-6f65a41d16ff-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-fl5dr\" (UID: \"6b742864-dee4-40ef-a7a1-6f65a41d16ff\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"
Jul 02 20:34:33.413889 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.413875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b742864-dee4-40ef-a7a1-6f65a41d16ff-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-fl5dr\" (UID: \"6b742864-dee4-40ef-a7a1-6f65a41d16ff\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"
Jul 02 20:34:33.414046 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.413907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d6rx\" (UniqueName: \"kubernetes.io/projected/6b742864-dee4-40ef-a7a1-6f65a41d16ff-kube-api-access-4d6rx\") pod \"prometheus-operator-567f7b8b7c-fl5dr\" (UID: \"6b742864-dee4-40ef-a7a1-6f65a41d16ff\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"
Jul 02 20:34:33.414046 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.413934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b742864-dee4-40ef-a7a1-6f65a41d16ff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-fl5dr\" (UID: \"6b742864-dee4-40ef-a7a1-6f65a41d16ff\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"
Jul 02 20:34:33.414046 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:33.414032    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 02 20:34:33.414152 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:33.414105    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b742864-dee4-40ef-a7a1-6f65a41d16ff-prometheus-operator-tls podName:6b742864-dee4-40ef-a7a1-6f65a41d16ff nodeName:}" failed. No retries permitted until 2026-07-02 20:34:33.914087095 +0000 UTC m=+118.037098644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/6b742864-dee4-40ef-a7a1-6f65a41d16ff-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-fl5dr" (UID: "6b742864-dee4-40ef-a7a1-6f65a41d16ff") : secret "prometheus-operator-tls" not found
Jul 02 20:34:33.414576 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.414543    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b742864-dee4-40ef-a7a1-6f65a41d16ff-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-fl5dr\" (UID: \"6b742864-dee4-40ef-a7a1-6f65a41d16ff\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"
Jul 02 20:34:33.416411 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.416380    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b742864-dee4-40ef-a7a1-6f65a41d16ff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-fl5dr\" (UID: \"6b742864-dee4-40ef-a7a1-6f65a41d16ff\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"
Jul 02 20:34:33.422412 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.422391    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d6rx\" (UniqueName: \"kubernetes.io/projected/6b742864-dee4-40ef-a7a1-6f65a41d16ff-kube-api-access-4d6rx\") pod \"prometheus-operator-567f7b8b7c-fl5dr\" (UID: \"6b742864-dee4-40ef-a7a1-6f65a41d16ff\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"
Jul 02 20:34:33.699936 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.699853    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:33.720135 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.720103    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5659854cff-mpp6w"]
Jul 02 20:34:33.723298 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.723277    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.732881 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.732863    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 02 20:34:33.734468 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.734402    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5659854cff-mpp6w"]
Jul 02 20:34:33.816482 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.816453    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-oauth-config\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.816895 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.816500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-trusted-ca-bundle\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.816895 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.816520    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-service-ca\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.816895 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.816540    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-oauth-serving-cert\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.816895 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.816554    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-config\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.816895 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.816590    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v4jh\" (UniqueName: \"kubernetes.io/projected/305e03fa-29be-41cb-a8ce-fcba8607a90f-kube-api-access-8v4jh\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.816895 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.816605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-serving-cert\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.917979 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.917940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-trusted-ca-bundle\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.917979 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.917979    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-service-ca\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.918176 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.917999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-oauth-serving-cert\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.918176 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.918123    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-config\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.918243 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.918191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v4jh\" (UniqueName: \"kubernetes.io/projected/305e03fa-29be-41cb-a8ce-fcba8607a90f-kube-api-access-8v4jh\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.918243 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.918222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-serving-cert\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.918329 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.918281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b742864-dee4-40ef-a7a1-6f65a41d16ff-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-fl5dr\" (UID: \"6b742864-dee4-40ef-a7a1-6f65a41d16ff\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"
Jul 02 20:34:33.918378 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.918332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-oauth-config\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.918437 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:33.918417    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 02 20:34:33.918510 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:33.918497    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b742864-dee4-40ef-a7a1-6f65a41d16ff-prometheus-operator-tls podName:6b742864-dee4-40ef-a7a1-6f65a41d16ff nodeName:}" failed. No retries permitted until 2026-07-02 20:34:34.918458271 +0000 UTC m=+119.041469826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/6b742864-dee4-40ef-a7a1-6f65a41d16ff-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-fl5dr" (UID: "6b742864-dee4-40ef-a7a1-6f65a41d16ff") : secret "prometheus-operator-tls" not found
Jul 02 20:34:33.918838 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.918801    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-service-ca\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.918838 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.918821    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-oauth-serving-cert\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.919016 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.918892    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-config\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.919215 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.919189    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-trusted-ca-bundle\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.920798 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.920771    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-oauth-config\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.920879 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.920801    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-serving-cert\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:33.926469 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:33.926446    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v4jh\" (UniqueName: \"kubernetes.io/projected/305e03fa-29be-41cb-a8ce-fcba8607a90f-kube-api-access-8v4jh\") pod \"console-5659854cff-mpp6w\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") " pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:34.032713 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:34.032636    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:34.095627 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:34.095599    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:34.155481 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:34.155449    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5659854cff-mpp6w"]
Jul 02 20:34:34.158157 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:34:34.158128    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod305e03fa_29be_41cb_a8ce_fcba8607a90f.slice/crio-b1855cc064b3e05551f4689a6bd7a1b034693bf02486b01a9944f3ec4cff6f77 WatchSource:0}: Error finding container b1855cc064b3e05551f4689a6bd7a1b034693bf02486b01a9944f3ec4cff6f77: Status 404 returned error can't find the container with id b1855cc064b3e05551f4689a6bd7a1b034693bf02486b01a9944f3ec4cff6f77
Jul 02 20:34:34.280542 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:34.280509    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:34.337701 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:34.337623    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:34.806533 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:34.806494    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5659854cff-mpp6w" event={"ID":"305e03fa-29be-41cb-a8ce-fcba8607a90f","Type":"ContainerStarted","Data":"60c469889c7aaab911c238f41805cb4acd57c71fc7884bd5d1cec433602790a6"}
Jul 02 20:34:34.806707 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:34.806544    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5659854cff-mpp6w" event={"ID":"305e03fa-29be-41cb-a8ce-fcba8607a90f","Type":"ContainerStarted","Data":"b1855cc064b3e05551f4689a6bd7a1b034693bf02486b01a9944f3ec4cff6f77"}
Jul 02 20:34:34.824277 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:34.824228    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5659854cff-mpp6w" podStartSLOduration=1.8242136329999998 podStartE2EDuration="1.824213633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:34.823307138 +0000 UTC m=+118.946318737" watchObservedRunningTime="2026-07-02 20:34:34.824213633 +0000 UTC m=+118.947225203"
Jul 02 20:34:34.926982 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:34.926941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b742864-dee4-40ef-a7a1-6f65a41d16ff-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-fl5dr\" (UID: \"6b742864-dee4-40ef-a7a1-6f65a41d16ff\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"
Jul 02 20:34:34.929287 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:34.929264    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b742864-dee4-40ef-a7a1-6f65a41d16ff-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-fl5dr\" (UID: \"6b742864-dee4-40ef-a7a1-6f65a41d16ff\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"
Jul 02 20:34:34.935104 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:34.935082    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"
Jul 02 20:34:35.056214 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:35.056184    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr"]
Jul 02 20:34:35.059567 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:34:35.059543    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b742864_dee4_40ef_a7a1_6f65a41d16ff.slice/crio-fa0f303a9aa7eb615013b6b6da61a845deaff44170bc2b2037c69dd8db7b7f68 WatchSource:0}: Error finding container fa0f303a9aa7eb615013b6b6da61a845deaff44170bc2b2037c69dd8db7b7f68: Status 404 returned error can't find the container with id fa0f303a9aa7eb615013b6b6da61a845deaff44170bc2b2037c69dd8db7b7f68
Jul 02 20:34:35.276890 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:35.276840    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:35.331562 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:35.331486    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:35.811333 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:35.811284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr" event={"ID":"6b742864-dee4-40ef-a7a1-6f65a41d16ff","Type":"ContainerStarted","Data":"fa0f303a9aa7eb615013b6b6da61a845deaff44170bc2b2037c69dd8db7b7f68"}
Jul 02 20:34:36.140576 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:36.140540    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:36.194416 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:36.194385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:36.561537 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:36.561503    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:36.816475 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:36.816392    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr" event={"ID":"6b742864-dee4-40ef-a7a1-6f65a41d16ff","Type":"ContainerStarted","Data":"972c13480bd2e12504d5061fc041adb3d087d4e504af8b11b7ebfd320aef68e8"}
Jul 02 20:34:36.816475 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:36.816474    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr" event={"ID":"6b742864-dee4-40ef-a7a1-6f65a41d16ff","Type":"ContainerStarted","Data":"70478b34cb45fc2527e1421a69891a592a6b96d7fa9dd38bb1d43f037f9545e9"}
Jul 02 20:34:36.833176 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:36.833128    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fl5dr" podStartSLOduration=2.616806039 podStartE2EDuration="3.833113911s" totalImagesPullingTime="1.216307872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:36.831894467 +0000 UTC m=+120.954906039" watchObservedRunningTime="2026-07-02 20:34:36.833113911 +0000 UTC m=+120.956125482"
Jul 02 20:34:37.750876 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:37.750850    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:34:37.795962 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:37.795926    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:37.796132 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:37.795995    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:37.800465 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:37.800437    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:37.824239 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:37.824214    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:34:37.942192 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:37.942157    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:38.043204 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.043091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:38.223019 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.222954    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:38.452532 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.452500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:38.477918 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.477877    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"]
Jul 02 20:34:38.481370 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.481351    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"
Jul 02 20:34:38.484141 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.484116    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 02 20:34:38.484270 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.484255    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9qnsd\""
Jul 02 20:34:38.484343 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.484328    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 02 20:34:38.508152 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.508115    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"]
Jul 02 20:34:38.515482 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.515455    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2n4rx"]
Jul 02 20:34:38.518702 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.518677    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.523733 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.523711    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 20:34:38.523913 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.523854    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 20:34:38.524275 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.524261    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 20:34:38.524448 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.524435    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l8f5g\""
Jul 02 20:34:38.555856 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.555821    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0020b6e1-8347-4c48-ac8f-195e9c28784e-root\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.555856 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.555856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-textfile\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.556046 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.555885    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fc6k\" (UniqueName: \"kubernetes.io/projected/0020b6e1-8347-4c48-ac8f-195e9c28784e-kube-api-access-5fc6k\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.556046 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.555935    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-tls\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.556046 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.555993    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f00184a1-06cf-48ee-8f8c-1aeafef5a7e7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ttbcz\" (UID: \"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"
Jul 02 20:34:38.556046 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.556011    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0020b6e1-8347-4c48-ac8f-195e9c28784e-sys\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.556046 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.556031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f00184a1-06cf-48ee-8f8c-1aeafef5a7e7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ttbcz\" (UID: \"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"
Jul 02 20:34:38.556270 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.556065    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkt4c\" (UniqueName: \"kubernetes.io/projected/f00184a1-06cf-48ee-8f8c-1aeafef5a7e7-kube-api-access-qkt4c\") pod \"openshift-state-metrics-54cf96dfcf-ttbcz\" (UID: \"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"
Jul 02 20:34:38.556270 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.556100    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.556270 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.556172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f00184a1-06cf-48ee-8f8c-1aeafef5a7e7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ttbcz\" (UID: \"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"
Jul 02 20:34:38.556270 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.556199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0020b6e1-8347-4c48-ac8f-195e9c28784e-metrics-client-ca\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.556270 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.556221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-wtmp\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.556270 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.556235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-accelerators-collector-config\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.559166 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.559145    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:38.656774 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.656733    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0020b6e1-8347-4c48-ac8f-195e9c28784e-root\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.656942 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.656787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-textfile\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.656942 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.656846    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0020b6e1-8347-4c48-ac8f-195e9c28784e-root\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.656942 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.656890    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fc6k\" (UniqueName: \"kubernetes.io/projected/0020b6e1-8347-4c48-ac8f-195e9c28784e-kube-api-access-5fc6k\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.656942 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.656917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-tls\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.656942 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.656940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f00184a1-06cf-48ee-8f8c-1aeafef5a7e7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ttbcz\" (UID: \"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"
Jul 02 20:34:38.657171 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.656956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0020b6e1-8347-4c48-ac8f-195e9c28784e-sys\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.657171 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.656977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f00184a1-06cf-48ee-8f8c-1aeafef5a7e7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ttbcz\" (UID: \"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"
Jul 02 20:34:38.657171 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.657005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkt4c\" (UniqueName: \"kubernetes.io/projected/f00184a1-06cf-48ee-8f8c-1aeafef5a7e7-kube-api-access-qkt4c\") pod \"openshift-state-metrics-54cf96dfcf-ttbcz\" (UID: \"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"
Jul 02 20:34:38.657171 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.657032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.657171 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.657040    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-textfile\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.657171 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.657034    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0020b6e1-8347-4c48-ac8f-195e9c28784e-sys\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.657171 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:38.657099    2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 02 20:34:38.657171 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:38.657174    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00184a1-06cf-48ee-8f8c-1aeafef5a7e7-openshift-state-metrics-tls podName:f00184a1-06cf-48ee-8f8c-1aeafef5a7e7 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:39.157154963 +0000 UTC m=+123.280166512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f00184a1-06cf-48ee-8f8c-1aeafef5a7e7-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-ttbcz" (UID: "f00184a1-06cf-48ee-8f8c-1aeafef5a7e7") : secret "openshift-state-metrics-tls" not found
Jul 02 20:34:38.657525 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.657104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f00184a1-06cf-48ee-8f8c-1aeafef5a7e7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ttbcz\" (UID: \"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"
Jul 02 20:34:38.657525 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:38.657189    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 20:34:38.657525 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.657224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0020b6e1-8347-4c48-ac8f-195e9c28784e-metrics-client-ca\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.657525 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:38.657238    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-tls podName:0020b6e1-8347-4c48-ac8f-195e9c28784e nodeName:}" failed. No retries permitted until 2026-07-02 20:34:39.157220944 +0000 UTC m=+123.280232492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-tls") pod "node-exporter-2n4rx" (UID: "0020b6e1-8347-4c48-ac8f-195e9c28784e") : secret "node-exporter-tls" not found
Jul 02 20:34:38.657525 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.657275    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-wtmp\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.657525 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.657301    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-accelerators-collector-config\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.657525 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.657417    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-wtmp\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.657782 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.657705    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0020b6e1-8347-4c48-ac8f-195e9c28784e-metrics-client-ca\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.657782 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.657705    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f00184a1-06cf-48ee-8f8c-1aeafef5a7e7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ttbcz\" (UID: \"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"
Jul 02 20:34:38.657876 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.657853    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-accelerators-collector-config\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.659252 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.659232    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.659458 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.659443    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f00184a1-06cf-48ee-8f8c-1aeafef5a7e7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ttbcz\" (UID: \"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"
Jul 02 20:34:38.669973 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.669955    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fc6k\" (UniqueName: \"kubernetes.io/projected/0020b6e1-8347-4c48-ac8f-195e9c28784e-kube-api-access-5fc6k\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:38.670092 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.670076    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkt4c\" (UniqueName: \"kubernetes.io/projected/f00184a1-06cf-48ee-8f8c-1aeafef5a7e7-kube-api-access-qkt4c\") pod \"openshift-state-metrics-54cf96dfcf-ttbcz\" (UID: \"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"
Jul 02 20:34:38.677830 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.677775    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:38.797233 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.797158    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:38.894044 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.894008    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:38.994071 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:38.994040    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:39.161814 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.161782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-tls\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:39.161978 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.161835    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f00184a1-06cf-48ee-8f8c-1aeafef5a7e7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ttbcz\" (UID: \"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"
Jul 02 20:34:39.161978 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:39.161930    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 20:34:39.162056 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:39.161996    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-tls podName:0020b6e1-8347-4c48-ac8f-195e9c28784e nodeName:}" failed. No retries permitted until 2026-07-02 20:34:40.161977673 +0000 UTC m=+124.284989226 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-tls") pod "node-exporter-2n4rx" (UID: "0020b6e1-8347-4c48-ac8f-195e9c28784e") : secret "node-exporter-tls" not found
Jul 02 20:34:39.164294 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.164263    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f00184a1-06cf-48ee-8f8c-1aeafef5a7e7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ttbcz\" (UID: \"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"
Jul 02 20:34:39.253696 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.253645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:39.390710 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.390670    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"
Jul 02 20:34:39.487367 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.487313    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:39.534195 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.534170    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz"]
Jul 02 20:34:39.536588 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:34:39.536561    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00184a1_06cf_48ee_8f8c_1aeafef5a7e7.slice/crio-7e7917681aad4b739d66c7a70e7fe9b8a7abdf5a75116270919543866e8146d6 WatchSource:0}: Error finding container 7e7917681aad4b739d66c7a70e7fe9b8a7abdf5a75116270919543866e8146d6: Status 404 returned error can't find the container with id 7e7917681aad4b739d66c7a70e7fe9b8a7abdf5a75116270919543866e8146d6
Jul 02 20:34:39.586526 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.586425    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 20:34:39.591218 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.591191    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:39.592967 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.592947    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.597597 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.597551    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 02 20:34:39.597694 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.597611    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 02 20:34:39.597868 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.597852    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 02 20:34:39.597914 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.597875    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 02 20:34:39.597914 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.597907    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 02 20:34:39.598144 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.598124    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 02 20:34:39.598209 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.598148    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7hs4d\""
Jul 02 20:34:39.598247 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.598228    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 02 20:34:39.598456 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.598434    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 02 20:34:39.603153 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.603130    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 02 20:34:39.611906 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.611881    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 20:34:39.666339 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.666308    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.666513 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.666343    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px6lz\" (UniqueName: \"kubernetes.io/projected/51b83f38-cd03-4e4e-8966-b8cd71e68e38-kube-api-access-px6lz\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.666513 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.666379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.666513 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.666473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-config-volume\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.666672 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.666517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.666672 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.666545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51b83f38-cd03-4e4e-8966-b8cd71e68e38-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.666672 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.666603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/51b83f38-cd03-4e4e-8966-b8cd71e68e38-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.666672 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.666652    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51b83f38-cd03-4e4e-8966-b8cd71e68e38-tls-assets\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.666843 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.666680    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51b83f38-cd03-4e4e-8966-b8cd71e68e38-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.666843 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.666744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-web-config\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.666843 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.666780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.666843 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.666807    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51b83f38-cd03-4e4e-8966-b8cd71e68e38-config-out\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.666843 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.666827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.695308 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.695228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:39.768182 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.768147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.768182 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.768182    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px6lz\" (UniqueName: \"kubernetes.io/projected/51b83f38-cd03-4e4e-8966-b8cd71e68e38-kube-api-access-px6lz\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.768429 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.768213    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.768429 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.768250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-config-volume\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.768429 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.768297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.768429 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.768323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51b83f38-cd03-4e4e-8966-b8cd71e68e38-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.768429 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.768364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/51b83f38-cd03-4e4e-8966-b8cd71e68e38-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.768429 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.768411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51b83f38-cd03-4e4e-8966-b8cd71e68e38-tls-assets\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.768429 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.768431    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51b83f38-cd03-4e4e-8966-b8cd71e68e38-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.768837 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.768471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-web-config\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.768837 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.768493    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.768944 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.768908    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/51b83f38-cd03-4e4e-8966-b8cd71e68e38-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.769751 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.769412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51b83f38-cd03-4e4e-8966-b8cd71e68e38-config-out\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.769751 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.769504    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51b83f38-cd03-4e4e-8966-b8cd71e68e38-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.769751 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.769547    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51b83f38-cd03-4e4e-8966-b8cd71e68e38-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.769751 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:39.769701    2565 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 02 20:34:39.770102 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.770061    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.770212 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:34:39.770163    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-secret-alertmanager-main-tls podName:51b83f38-cd03-4e4e-8966-b8cd71e68e38 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:40.270139352 +0000 UTC m=+124.393150901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "51b83f38-cd03-4e4e-8966-b8cd71e68e38") : secret "alertmanager-main-tls" not found
Jul 02 20:34:39.771286 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.771240    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-config-volume\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.771576 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.771554    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51b83f38-cd03-4e4e-8966-b8cd71e68e38-tls-assets\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.771690 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.771670    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.771892 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.771870    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.771938 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.771906    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.772005 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.771986    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-web-config\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.772420 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.772405    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.772840 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.772824    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51b83f38-cd03-4e4e-8966-b8cd71e68e38-config-out\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.776611 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.776589    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px6lz\" (UniqueName: \"kubernetes.io/projected/51b83f38-cd03-4e4e-8966-b8cd71e68e38-kube-api-access-px6lz\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:39.796048 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.796003    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:39.830266 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.830228    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz" event={"ID":"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7","Type":"ContainerStarted","Data":"c0a9b256ba347c278056b70c6548be9c93341a39fadd8314725f2927ae8bfe3e"}
Jul 02 20:34:39.830609 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.830282    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz" event={"ID":"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7","Type":"ContainerStarted","Data":"6c6b47cab7c6606735ec17f18d340d9367c4ad677c5b297d8493c84189317b6f"}
Jul 02 20:34:39.830609 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:39.830302    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz" event={"ID":"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7","Type":"ContainerStarted","Data":"7e7917681aad4b739d66c7a70e7fe9b8a7abdf5a75116270919543866e8146d6"}
Jul 02 20:34:40.173417 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:40.173380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-tls\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:40.176006 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:40.175982    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0020b6e1-8347-4c48-ac8f-195e9c28784e-node-exporter-tls\") pod \"node-exporter-2n4rx\" (UID: \"0020b6e1-8347-4c48-ac8f-195e9c28784e\") " pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:40.193961 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:40.193928    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:40.274513 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:40.274475    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:40.277504 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:40.277449    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51b83f38-cd03-4e4e-8966-b8cd71e68e38-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"51b83f38-cd03-4e4e-8966-b8cd71e68e38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:40.328427 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:40.328389    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2n4rx"
Jul 02 20:34:40.338693 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:34:40.338666    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0020b6e1_8347_4c48_ac8f_195e9c28784e.slice/crio-a58642f5cc8ad35ee348b198e512ee78e9ade8cec5a55ab0de81ff4d8f4e1d2e WatchSource:0}: Error finding container a58642f5cc8ad35ee348b198e512ee78e9ade8cec5a55ab0de81ff4d8f4e1d2e: Status 404 returned error can't find the container with id a58642f5cc8ad35ee348b198e512ee78e9ade8cec5a55ab0de81ff4d8f4e1d2e
Jul 02 20:34:40.506439 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:40.506348    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 20:34:40.791786 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:34:40.791433    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b83f38_cd03_4e4e_8966_b8cd71e68e38.slice/crio-61a05127a40ddf26b859ed95db1c2eb339b0fe99157bad7c4fd7cd853e0c369e WatchSource:0}: Error finding container 61a05127a40ddf26b859ed95db1c2eb339b0fe99157bad7c4fd7cd853e0c369e: Status 404 returned error can't find the container with id 61a05127a40ddf26b859ed95db1c2eb339b0fe99157bad7c4fd7cd853e0c369e
Jul 02 20:34:40.791786 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:40.791735    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 20:34:40.836441 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:40.836397    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz" event={"ID":"f00184a1-06cf-48ee-8f8c-1aeafef5a7e7","Type":"ContainerStarted","Data":"61a35153871f27dab6c5e5bc1358d7cd64e81fed3bade85a6c558329ef312e5d"}
Jul 02 20:34:40.837749 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:40.837709    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2n4rx" event={"ID":"0020b6e1-8347-4c48-ac8f-195e9c28784e","Type":"ContainerStarted","Data":"a58642f5cc8ad35ee348b198e512ee78e9ade8cec5a55ab0de81ff4d8f4e1d2e"}
Jul 02 20:34:40.838923 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:40.838899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51b83f38-cd03-4e4e-8966-b8cd71e68e38","Type":"ContainerStarted","Data":"61a05127a40ddf26b859ed95db1c2eb339b0fe99157bad7c4fd7cd853e0c369e"}
Jul 02 20:34:40.853529 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:40.853479    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ttbcz" podStartSLOduration=1.851334346 podStartE2EDuration="2.8534624s" totalImagesPullingTime="1.002128054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:40.853057844 +0000 UTC m=+124.976069448" watchObservedRunningTime="2026-07-02 20:34:40.8534624 +0000 UTC m=+124.976473971"
Jul 02 20:34:41.457847 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:41.457771    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:41.536915 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:41.536881    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:41.783729 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:41.783700    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:41.845037 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:41.845000    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51b83f38-cd03-4e4e-8966-b8cd71e68e38","Type":"ContainerStarted","Data":"d4aafee96d4f1c96d34f9b238c775ae8cf3ebd9ff425f05ee5f36ed1922ac96b"}
Jul 02 20:34:41.846682 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:41.846657    2565 generic.go:356] "Generic (PLEG): container finished" podID="0020b6e1-8347-4c48-ac8f-195e9c28784e" containerID="30fda1163608d445258a11972326d49239a23a2b5b1b452cda550d697bd27407" exitCode=0
Jul 02 20:34:41.846803 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:41.846688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2n4rx" event={"ID":"0020b6e1-8347-4c48-ac8f-195e9c28784e","Type":"ContainerDied","Data":"30fda1163608d445258a11972326d49239a23a2b5b1b452cda550d697bd27407"}
Jul 02 20:34:42.100643 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.100609    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:42.194362 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.194328    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:42.785247 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.785218    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"]
Jul 02 20:34:42.788391 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.788368    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:42.792738 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.792718    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-67tlq\""
Jul 02 20:34:42.792858 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.792743    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-82bp5e68tfu9m\""
Jul 02 20:34:42.792858 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.792743    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 02 20:34:42.793112 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.793091    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 02 20:34:42.793216 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.793116    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 02 20:34:42.793216 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.793135    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 20:34:42.798967 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.798946    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"]
Jul 02 20:34:42.851655 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.851619    2565 generic.go:356] "Generic (PLEG): container finished" podID="51b83f38-cd03-4e4e-8966-b8cd71e68e38" containerID="d4aafee96d4f1c96d34f9b238c775ae8cf3ebd9ff425f05ee5f36ed1922ac96b" exitCode=0
Jul 02 20:34:42.851655 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.851650    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51b83f38-cd03-4e4e-8966-b8cd71e68e38","Type":"ContainerDied","Data":"d4aafee96d4f1c96d34f9b238c775ae8cf3ebd9ff425f05ee5f36ed1922ac96b"}
Jul 02 20:34:42.853911 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.853891    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2n4rx" event={"ID":"0020b6e1-8347-4c48-ac8f-195e9c28784e","Type":"ContainerStarted","Data":"4a73986ca1c27d39827b5435f58730aaa5a67f650b3e619ddb4dcd731624d2bd"}
Jul 02 20:34:42.853983 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.853932    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2n4rx" event={"ID":"0020b6e1-8347-4c48-ac8f-195e9c28784e","Type":"ContainerStarted","Data":"215f5cd69925d5996de6340876c41ca9b57bfc03b40143ddb16e9494bb77d6bb"}
Jul 02 20:34:42.899347 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.899298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e3407905-9d1f-48e3-b8f5-f962456bcbf3-audit-log\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:42.899540 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.899441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e3407905-9d1f-48e3-b8f5-f962456bcbf3-metrics-server-audit-profiles\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:42.899540 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.899473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e3407905-9d1f-48e3-b8f5-f962456bcbf3-secret-metrics-server-tls\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:42.899703 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.899677    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e3407905-9d1f-48e3-b8f5-f962456bcbf3-secret-metrics-server-client-certs\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:42.899803 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.899719    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3407905-9d1f-48e3-b8f5-f962456bcbf3-client-ca-bundle\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:42.899865 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.899804    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wlsh\" (UniqueName: \"kubernetes.io/projected/e3407905-9d1f-48e3-b8f5-f962456bcbf3-kube-api-access-7wlsh\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:42.899916 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.899869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3407905-9d1f-48e3-b8f5-f962456bcbf3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:42.900470 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:42.900426    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2n4rx" podStartSLOduration=3.965560242 podStartE2EDuration="4.900412619s" totalImagesPullingTime="861.533197ms" totalInitContainerRuntime="73.31918ms" isStatefulPod=true podCreationTimestamp="2026-07-02 20:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:42.899265421 +0000 UTC m=+127.022276992" watchObservedRunningTime="2026-07-02 20:34:42.900412619 +0000 UTC m=+127.023424236"
Jul 02 20:34:43.001508 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.001466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e3407905-9d1f-48e3-b8f5-f962456bcbf3-audit-log\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:43.001672 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.001518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e3407905-9d1f-48e3-b8f5-f962456bcbf3-metrics-server-audit-profiles\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:43.001672 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.001536    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e3407905-9d1f-48e3-b8f5-f962456bcbf3-secret-metrics-server-tls\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:43.001672 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.001583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e3407905-9d1f-48e3-b8f5-f962456bcbf3-secret-metrics-server-client-certs\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:43.001672 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.001601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3407905-9d1f-48e3-b8f5-f962456bcbf3-client-ca-bundle\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:43.001672 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.001621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wlsh\" (UniqueName: \"kubernetes.io/projected/e3407905-9d1f-48e3-b8f5-f962456bcbf3-kube-api-access-7wlsh\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:43.001672 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.001650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3407905-9d1f-48e3-b8f5-f962456bcbf3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:43.001985 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.001970    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e3407905-9d1f-48e3-b8f5-f962456bcbf3-audit-log\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:43.002414 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.002378    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3407905-9d1f-48e3-b8f5-f962456bcbf3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:43.002572 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.002550    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e3407905-9d1f-48e3-b8f5-f962456bcbf3-metrics-server-audit-profiles\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:43.004219 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.004200    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e3407905-9d1f-48e3-b8f5-f962456bcbf3-secret-metrics-server-client-certs\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:43.004291 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.004250    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e3407905-9d1f-48e3-b8f5-f962456bcbf3-secret-metrics-server-tls\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:43.004431 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.004411    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3407905-9d1f-48e3-b8f5-f962456bcbf3-client-ca-bundle\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:43.011516 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.011492    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wlsh\" (UniqueName: \"kubernetes.io/projected/e3407905-9d1f-48e3-b8f5-f962456bcbf3-kube-api-access-7wlsh\") pod \"metrics-server-7c7fccbd7c-8hfvh\" (UID: \"e3407905-9d1f-48e3-b8f5-f962456bcbf3\") " pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:43.097587 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.097553    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:34:43.238322 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.238294    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"]
Jul 02 20:34:43.240574 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:34:43.240543    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3407905_9d1f_48e3_b8f5_f962456bcbf3.slice/crio-3f65275d7411b9a9c45f7dab07b0b0e16d3272a8b75eb0aa5b5f0d0b19dc3857 WatchSource:0}: Error finding container 3f65275d7411b9a9c45f7dab07b0b0e16d3272a8b75eb0aa5b5f0d0b19dc3857: Status 404 returned error can't find the container with id 3f65275d7411b9a9c45f7dab07b0b0e16d3272a8b75eb0aa5b5f0d0b19dc3857
Jul 02 20:34:43.248321 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.248284    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:43.352505 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.352427    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:43.716804 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.716710    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-567fbf45cd-rmth6"]
Jul 02 20:34:43.720184 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.720156    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.722931 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.722904    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 02 20:34:43.723138 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.723120    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9smd7\""
Jul 02 20:34:43.723230 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.723140    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 02 20:34:43.723230 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.723120    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 02 20:34:43.723454 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.723436    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 02 20:34:43.723656 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.723641    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 02 20:34:43.733421 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.730878    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 02 20:34:43.737995 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.737971    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-567fbf45cd-rmth6"]
Jul 02 20:34:43.809664 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.809629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93126da-ce01-442c-bfc3-bb2e943622a5-serving-certs-ca-bundle\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.809838 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.809668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f93126da-ce01-442c-bfc3-bb2e943622a5-federate-client-tls\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.809838 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.809708    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f93126da-ce01-442c-bfc3-bb2e943622a5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.809838 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.809751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f93126da-ce01-442c-bfc3-bb2e943622a5-metrics-client-ca\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.809838 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.809786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f93126da-ce01-442c-bfc3-bb2e943622a5-telemeter-client-tls\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.809963 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.809865    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f93126da-ce01-442c-bfc3-bb2e943622a5-secret-telemeter-client\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.809963 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.809898    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d8p8\" (UniqueName: \"kubernetes.io/projected/f93126da-ce01-442c-bfc3-bb2e943622a5-kube-api-access-6d8p8\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.809963 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.809921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93126da-ce01-442c-bfc3-bb2e943622a5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.860128 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.860092    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh" event={"ID":"e3407905-9d1f-48e3-b8f5-f962456bcbf3","Type":"ContainerStarted","Data":"3f65275d7411b9a9c45f7dab07b0b0e16d3272a8b75eb0aa5b5f0d0b19dc3857"}
Jul 02 20:34:43.910722 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.910677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93126da-ce01-442c-bfc3-bb2e943622a5-serving-certs-ca-bundle\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.910907 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.910731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f93126da-ce01-442c-bfc3-bb2e943622a5-federate-client-tls\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.910907 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.910799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f93126da-ce01-442c-bfc3-bb2e943622a5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.910907 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.910847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f93126da-ce01-442c-bfc3-bb2e943622a5-metrics-client-ca\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.910907 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.910887    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f93126da-ce01-442c-bfc3-bb2e943622a5-telemeter-client-tls\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.911117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.910950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f93126da-ce01-442c-bfc3-bb2e943622a5-secret-telemeter-client\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.911117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.910977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d8p8\" (UniqueName: \"kubernetes.io/projected/f93126da-ce01-442c-bfc3-bb2e943622a5-kube-api-access-6d8p8\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.911117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.911009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93126da-ce01-442c-bfc3-bb2e943622a5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.911592 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.911559    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93126da-ce01-442c-bfc3-bb2e943622a5-serving-certs-ca-bundle\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.912139 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.912089    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93126da-ce01-442c-bfc3-bb2e943622a5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.912341 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.912319    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f93126da-ce01-442c-bfc3-bb2e943622a5-metrics-client-ca\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.914977 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.914956    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f93126da-ce01-442c-bfc3-bb2e943622a5-telemeter-client-tls\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.915088 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.915012    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f93126da-ce01-442c-bfc3-bb2e943622a5-federate-client-tls\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.915686 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.915658    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f93126da-ce01-442c-bfc3-bb2e943622a5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.916420 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.916398    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f93126da-ce01-442c-bfc3-bb2e943622a5-secret-telemeter-client\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:43.921648 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:43.921622    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d8p8\" (UniqueName: \"kubernetes.io/projected/f93126da-ce01-442c-bfc3-bb2e943622a5-kube-api-access-6d8p8\") pod \"telemeter-client-567fbf45cd-rmth6\" (UID: \"f93126da-ce01-442c-bfc3-bb2e943622a5\") " pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:44.033574 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:44.033446    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:44.033574 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:44.033520    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:44.034267 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:44.034241    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6"
Jul 02 20:34:44.039130 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:44.039063    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:44.440278 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:44.440246    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-567fbf45cd-rmth6"]
Jul 02 20:34:44.757000 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:44.756963    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:44.806485 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:34:44.806454    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93126da_ce01_442c_bfc3_bb2e943622a5.slice/crio-7a7826bf17fca3b0ba4f1cefff7f6294d2eb82a7a2cc3dc5e83b5d478e70235e WatchSource:0}: Error finding container 7a7826bf17fca3b0ba4f1cefff7f6294d2eb82a7a2cc3dc5e83b5d478e70235e: Status 404 returned error can't find the container with id 7a7826bf17fca3b0ba4f1cefff7f6294d2eb82a7a2cc3dc5e83b5d478e70235e
Jul 02 20:34:44.866022 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:44.865997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6" event={"ID":"f93126da-ce01-442c-bfc3-bb2e943622a5","Type":"ContainerStarted","Data":"7a7826bf17fca3b0ba4f1cefff7f6294d2eb82a7a2cc3dc5e83b5d478e70235e"}
Jul 02 20:34:44.875159 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:44.875097    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:34:44.933241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:44.933217    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cd9ff5876-hzpg9"]
Jul 02 20:34:45.249346 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:45.249282    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:45.321937 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:45.321860    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:45.876714 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:45.876677    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh" event={"ID":"e3407905-9d1f-48e3-b8f5-f962456bcbf3","Type":"ContainerStarted","Data":"65348838da04fb3685f0044f45bb8fa4ebb8b96c0a82e048cd461cfb85e43a9b"}
Jul 02 20:34:45.882657 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:45.881747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51b83f38-cd03-4e4e-8966-b8cd71e68e38","Type":"ContainerStarted","Data":"020552f5fb0bbf742ef336313d09bb6e3f9cb3ac7bb584462f199d1c3878503c"}
Jul 02 20:34:45.882657 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:45.881876    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51b83f38-cd03-4e4e-8966-b8cd71e68e38","Type":"ContainerStarted","Data":"15f11ed97afd54d8c52f9d31a2c02b8f3f6d95b34973c41a47e2dfeb530b18a3"}
Jul 02 20:34:45.882657 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:45.882034    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51b83f38-cd03-4e4e-8966-b8cd71e68e38","Type":"ContainerStarted","Data":"5602422c82a9f8716e37ec1a4173592b412e78854b30cfc49baecb104af113c8"}
Jul 02 20:34:45.882657 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:45.882097    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51b83f38-cd03-4e4e-8966-b8cd71e68e38","Type":"ContainerStarted","Data":"c43c05f5b45d324b283c06bfbb9b85b324a7a8331cb0cc7500b9230f15aa38ff"}
Jul 02 20:34:45.882657 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:45.882152    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51b83f38-cd03-4e4e-8966-b8cd71e68e38","Type":"ContainerStarted","Data":"9b5b6421efdd2b9b5bc52eeb4e7226a7044a84adae947435754d55af5316270f"}
Jul 02 20:34:45.899050 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:45.898988    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh" podStartSLOduration=2.277400566 podStartE2EDuration="3.898967807s" totalImagesPullingTime="1.621567241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:45.898267909 +0000 UTC m=+130.021279481" watchObservedRunningTime="2026-07-02 20:34:45.898967807 +0000 UTC m=+130.021979378"
Jul 02 20:34:46.030270 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:46.030239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs\") pod \"network-metrics-daemon-swrg9\" (UID: \"888788da-c29d-4687-a880-bcbbd7bfa01f\") " pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:34:46.032806 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:46.032777    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/888788da-c29d-4687-a880-bcbbd7bfa01f-metrics-certs\") pod \"network-metrics-daemon-swrg9\" (UID: \"888788da-c29d-4687-a880-bcbbd7bfa01f\") " pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:34:46.324443 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:46.324367    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zddh5\""
Jul 02 20:34:46.331918 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:46.331889    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrg9"
Jul 02 20:34:46.518551 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:46.518524    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-swrg9"]
Jul 02 20:34:46.521917 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:34:46.521890    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod888788da_c29d_4687_a880_bcbbd7bfa01f.slice/crio-4e0ed61d04dd87cdb422a6991b59b34b82fd3ff8f404a856dcf9fc43963f1618 WatchSource:0}: Error finding container 4e0ed61d04dd87cdb422a6991b59b34b82fd3ff8f404a856dcf9fc43963f1618: Status 404 returned error can't find the container with id 4e0ed61d04dd87cdb422a6991b59b34b82fd3ff8f404a856dcf9fc43963f1618
Jul 02 20:34:46.889164 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:46.889127    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51b83f38-cd03-4e4e-8966-b8cd71e68e38","Type":"ContainerStarted","Data":"63872ddb00a6323333dec4aa65615ad9fbfd870b6b2e6eef527b385d668db313"}
Jul 02 20:34:46.890332 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:46.890310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-swrg9" event={"ID":"888788da-c29d-4687-a880-bcbbd7bfa01f","Type":"ContainerStarted","Data":"4e0ed61d04dd87cdb422a6991b59b34b82fd3ff8f404a856dcf9fc43963f1618"}
Jul 02 20:34:46.892195 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:46.892171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6" event={"ID":"f93126da-ce01-442c-bfc3-bb2e943622a5","Type":"ContainerStarted","Data":"9fb9b0fb91c2ecec37b2e63c67f16942f4d62174db279328c94bd794a8c0376b"}
Jul 02 20:34:46.892305 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:46.892219    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6" event={"ID":"f93126da-ce01-442c-bfc3-bb2e943622a5","Type":"ContainerStarted","Data":"5ea3b4500391409e6960481595d6d2acf3b57f1aa7ba08d5170c2e66663fa71b"}
Jul 02 20:34:46.892305 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:46.892237    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6" event={"ID":"f93126da-ce01-442c-bfc3-bb2e943622a5","Type":"ContainerStarted","Data":"d0962ff469badac284268c9678633fa40177ceb45107e17a40a46444a3df48aa"}
Jul 02 20:34:46.923094 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:46.923047    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.243886582 podStartE2EDuration="7.923028439s" totalImagesPullingTime="3.659875252s" totalInitContainerRuntime="19.266605ms" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:46.920740537 +0000 UTC m=+131.043752121" watchObservedRunningTime="2026-07-02 20:34:46.923028439 +0000 UTC m=+131.046040025"
Jul 02 20:34:46.948774 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:46.946707    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-567fbf45cd-rmth6" podStartSLOduration=2.3218073 podStartE2EDuration="3.946686479s" totalImagesPullingTime="1.624879179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:46.945739473 +0000 UTC m=+131.068751045" watchObservedRunningTime="2026-07-02 20:34:46.946686479 +0000 UTC m=+131.069698051"
Jul 02 20:34:47.901094 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:47.901064    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-swrg9" event={"ID":"888788da-c29d-4687-a880-bcbbd7bfa01f","Type":"ContainerStarted","Data":"3561a4f066404ef27cb1f8d95e528da1e4ee0e018583f73ee2eb0aba0e376406"}
Jul 02 20:34:47.929540 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:47.929515    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cdbbccf58-hhzk5"]
Jul 02 20:34:48.022081 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:48.021997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:48.219979 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:48.219948    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:48.322246 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:48.322160    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:48.421397 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:48.421365    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:48.483605 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:48.483572    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:48.907619 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:48.907583    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-swrg9" event={"ID":"888788da-c29d-4687-a880-bcbbd7bfa01f","Type":"ContainerStarted","Data":"bc48bef5dc4165b5b9601c3ebcca1fc9bc32bb1c5e8bc6eaa36c20e48a889ed8"}
Jul 02 20:34:48.925157 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:48.925111    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-swrg9" podStartSLOduration=131.7563516 podStartE2EDuration="2m12.925095703s" totalImagesPullingTime="1.168744103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:32:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:48.923484466 +0000 UTC m=+133.046496053" watchObservedRunningTime="2026-07-02 20:34:48.925095703 +0000 UTC m=+133.048107274"
Jul 02 20:34:49.023400 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:49.023366    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:49.100463 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:49.100420    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:49.920567 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:49.920529    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6586df5dc7-s26dn"]
Jul 02 20:34:49.923914 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:49.923887    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:49.952344 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:49.952312    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6586df5dc7-s26dn"]
Jul 02 20:34:49.966137 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:49.966102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-config\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:49.966408 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:49.966392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-oauth-config\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:49.966528 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:49.966516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-service-ca\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:49.966704 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:49.966689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2ssd\" (UniqueName: \"kubernetes.io/projected/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-kube-api-access-v2ssd\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:49.967052 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:49.967016    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-oauth-serving-cert\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:49.967183 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:49.967073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-serving-cert\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:49.967183 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:49.967096    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-trusted-ca-bundle\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:50.068120 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.068083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-oauth-config\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:50.068120 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.068122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-service-ca\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:50.068311 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.068247    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2ssd\" (UniqueName: \"kubernetes.io/projected/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-kube-api-access-v2ssd\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:50.068311 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.068303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-oauth-serving-cert\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:50.068525 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.068486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-serving-cert\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:50.068649 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.068532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-trusted-ca-bundle\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:50.068649 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.068584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-config\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:50.068936 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.068915    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-service-ca\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:50.069022 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.068915    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-oauth-serving-cert\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:50.069280 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.069256    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-config\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:50.069373 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.069354    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-trusted-ca-bundle\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:50.070553 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.070533    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-oauth-config\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:50.070740 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.070722    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-serving-cert\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:50.079385 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.079356    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2ssd\" (UniqueName: \"kubernetes.io/projected/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-kube-api-access-v2ssd\") pod \"console-6586df5dc7-s26dn\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") " pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:50.233949 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.233855    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:34:50.365123 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.365099    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6586df5dc7-s26dn"]
Jul 02 20:34:50.367429 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:34:50.367404    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podead42bbb_8c35_48d3_98f1_3d4befe0f6a4.slice/crio-baebde226296685dccffcf54f57c692c340c0030aaec83c5c638cadb1b2a622c WatchSource:0}: Error finding container baebde226296685dccffcf54f57c692c340c0030aaec83c5c638cadb1b2a622c: Status 404 returned error can't find the container with id baebde226296685dccffcf54f57c692c340c0030aaec83c5c638cadb1b2a622c
Jul 02 20:34:50.918923 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.918883    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6586df5dc7-s26dn" event={"ID":"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4","Type":"ContainerStarted","Data":"79b8e1e971ac0e26d0b8b9b214297cf6b3e17fadba3c5b1e130b1da62ead0d51"}
Jul 02 20:34:50.919100 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.918941    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6586df5dc7-s26dn" event={"ID":"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4","Type":"ContainerStarted","Data":"baebde226296685dccffcf54f57c692c340c0030aaec83c5c638cadb1b2a622c"}
Jul 02 20:34:50.936270 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:50.936218    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6586df5dc7-s26dn" podStartSLOduration=1.936200439 podStartE2EDuration="1.936200439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:50.936094791 +0000 UTC m=+135.059106360" watchObservedRunningTime="2026-07-02 20:34:50.936200439 +0000 UTC m=+135.059212010"
Jul 02 20:34:51.288351 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:51.288264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:51.376565 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:51.376534    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:53.484261 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:53.484230    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:53.543486 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:53.543454    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:55.222514 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:55.222479    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:55.280858 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:34:55.280824    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:00.234034 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:00.233999    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:35:00.234398 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:00.234096    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:35:00.238871 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:00.238851    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:35:00.960975 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:00.960949    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:35:01.008339 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:01.008305    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5659854cff-mpp6w"]
Jul 02 20:35:01.126887 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:01.126846    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:01.225030 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:01.224954    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:01.324931 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:01.324898    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:03.097879 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:03.097840    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:35:03.098268 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:03.097896    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:35:03.410490 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:03.410411    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:03.477166 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:03.477133    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:09.964103 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:09.964043    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7cd9ff5876-hzpg9" podUID="840e6ff0-fc94-4748-9ada-260a7b07174c" containerName="console" containerID="cri-o://a27b959ef97d85fede09d7ad1a14bd9d868c9fed016c6b2ff8494b18bc58b870" gracePeriod=15
Jul 02 20:35:10.204210 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.204183    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:35:10.342339 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.342310    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-oauth-serving-cert\") pod \"840e6ff0-fc94-4748-9ada-260a7b07174c\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") "
Jul 02 20:35:10.342522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.342364    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/840e6ff0-fc94-4748-9ada-260a7b07174c-console-oauth-config\") pod \"840e6ff0-fc94-4748-9ada-260a7b07174c\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") "
Jul 02 20:35:10.342522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.342394    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-service-ca\") pod \"840e6ff0-fc94-4748-9ada-260a7b07174c\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") "
Jul 02 20:35:10.342522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.342494    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/840e6ff0-fc94-4748-9ada-260a7b07174c-console-serving-cert\") pod \"840e6ff0-fc94-4748-9ada-260a7b07174c\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") "
Jul 02 20:35:10.342681 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.342577    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qh5b\" (UniqueName: \"kubernetes.io/projected/840e6ff0-fc94-4748-9ada-260a7b07174c-kube-api-access-7qh5b\") pod \"840e6ff0-fc94-4748-9ada-260a7b07174c\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") "
Jul 02 20:35:10.342681 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.342607    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-console-config\") pod \"840e6ff0-fc94-4748-9ada-260a7b07174c\" (UID: \"840e6ff0-fc94-4748-9ada-260a7b07174c\") "
Jul 02 20:35:10.342872 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.342827    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-service-ca" (OuterVolumeSpecName: "service-ca") pod "840e6ff0-fc94-4748-9ada-260a7b07174c" (UID: "840e6ff0-fc94-4748-9ada-260a7b07174c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:35:10.343015 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.342869    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "840e6ff0-fc94-4748-9ada-260a7b07174c" (UID: "840e6ff0-fc94-4748-9ada-260a7b07174c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:35:10.343113 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.343052    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-console-config" (OuterVolumeSpecName: "console-config") pod "840e6ff0-fc94-4748-9ada-260a7b07174c" (UID: "840e6ff0-fc94-4748-9ada-260a7b07174c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:35:10.343113 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.343079    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-oauth-serving-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:10.343113 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.343099    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-service-ca\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:10.344687 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.344664    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/840e6ff0-fc94-4748-9ada-260a7b07174c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "840e6ff0-fc94-4748-9ada-260a7b07174c" (UID: "840e6ff0-fc94-4748-9ada-260a7b07174c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:35:10.344793 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.344774    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/840e6ff0-fc94-4748-9ada-260a7b07174c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "840e6ff0-fc94-4748-9ada-260a7b07174c" (UID: "840e6ff0-fc94-4748-9ada-260a7b07174c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:35:10.344878 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.344859    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/840e6ff0-fc94-4748-9ada-260a7b07174c-kube-api-access-7qh5b" (OuterVolumeSpecName: "kube-api-access-7qh5b") pod "840e6ff0-fc94-4748-9ada-260a7b07174c" (UID: "840e6ff0-fc94-4748-9ada-260a7b07174c"). InnerVolumeSpecName "kube-api-access-7qh5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:35:10.444439 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.444399    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/840e6ff0-fc94-4748-9ada-260a7b07174c-console-oauth-config\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:10.444624 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.444533    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/840e6ff0-fc94-4748-9ada-260a7b07174c-console-serving-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:10.444624 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.444562    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qh5b\" (UniqueName: \"kubernetes.io/projected/840e6ff0-fc94-4748-9ada-260a7b07174c-kube-api-access-7qh5b\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:10.444624 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:10.444577    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/840e6ff0-fc94-4748-9ada-260a7b07174c-console-config\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:11.004279 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:11.004249    2565 generic.go:356] "Generic (PLEG): container finished" podID="840e6ff0-fc94-4748-9ada-260a7b07174c" containerID="a27b959ef97d85fede09d7ad1a14bd9d868c9fed016c6b2ff8494b18bc58b870" exitCode=0
Jul 02 20:35:11.004708 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:11.004289    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd9ff5876-hzpg9"
Jul 02 20:35:11.004708 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:11.004293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd9ff5876-hzpg9" event={"ID":"840e6ff0-fc94-4748-9ada-260a7b07174c","Type":"ContainerDied","Data":"a27b959ef97d85fede09d7ad1a14bd9d868c9fed016c6b2ff8494b18bc58b870"}
Jul 02 20:35:11.004708 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:11.004437    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd9ff5876-hzpg9" event={"ID":"840e6ff0-fc94-4748-9ada-260a7b07174c","Type":"ContainerDied","Data":"334a59bc17e80a21859db3f5aa42666576177e49b6a9023195f9b8e1099b1e7a"}
Jul 02 20:35:11.004708 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:11.004474    2565 scope.go:117] "RemoveContainer" containerID="a27b959ef97d85fede09d7ad1a14bd9d868c9fed016c6b2ff8494b18bc58b870"
Jul 02 20:35:11.013268 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:11.013249    2565 scope.go:117] "RemoveContainer" containerID="a27b959ef97d85fede09d7ad1a14bd9d868c9fed016c6b2ff8494b18bc58b870"
Jul 02 20:35:11.013533 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:35:11.013511    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a27b959ef97d85fede09d7ad1a14bd9d868c9fed016c6b2ff8494b18bc58b870\": container with ID starting with a27b959ef97d85fede09d7ad1a14bd9d868c9fed016c6b2ff8494b18bc58b870 not found: ID does not exist" containerID="a27b959ef97d85fede09d7ad1a14bd9d868c9fed016c6b2ff8494b18bc58b870"
Jul 02 20:35:11.013602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:11.013540    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27b959ef97d85fede09d7ad1a14bd9d868c9fed016c6b2ff8494b18bc58b870"} err="failed to get container status \"a27b959ef97d85fede09d7ad1a14bd9d868c9fed016c6b2ff8494b18bc58b870\": rpc error: code = NotFound desc = could not find container \"a27b959ef97d85fede09d7ad1a14bd9d868c9fed016c6b2ff8494b18bc58b870\": container with ID starting with a27b959ef97d85fede09d7ad1a14bd9d868c9fed016c6b2ff8494b18bc58b870 not found: ID does not exist"
Jul 02 20:35:11.024152 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:11.024130    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cd9ff5876-hzpg9"]
Jul 02 20:35:11.028049 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:11.028030    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cd9ff5876-hzpg9"]
Jul 02 20:35:11.906585 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:11.906556    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:12.302490 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:12.298526    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="840e6ff0-fc94-4748-9ada-260a7b07174c" path="/var/lib/kubelet/pods/840e6ff0-fc94-4748-9ada-260a7b07174c/volumes"
Jul 02 20:35:12.953603 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:12.953562    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5" podUID="0e9d32f7-b789-4219-8cde-e1594be4cad0" containerName="registry" containerID="cri-o://7394512a485e1a21c07139dd427039a40580b22e599283f50f0ef019fe3b789e" gracePeriod=30
Jul 02 20:35:13.203328 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.203303    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:35:13.369392 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.369365    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9g4w\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-kube-api-access-t9g4w\") pod \"0e9d32f7-b789-4219-8cde-e1594be4cad0\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") "
Jul 02 20:35:13.369833 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.369422    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-bound-sa-token\") pod \"0e9d32f7-b789-4219-8cde-e1594be4cad0\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") "
Jul 02 20:35:13.369833 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.369447    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls\") pod \"0e9d32f7-b789-4219-8cde-e1594be4cad0\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") "
Jul 02 20:35:13.369833 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.369499    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e9d32f7-b789-4219-8cde-e1594be4cad0-trusted-ca\") pod \"0e9d32f7-b789-4219-8cde-e1594be4cad0\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") "
Jul 02 20:35:13.369833 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.369519    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-certificates\") pod \"0e9d32f7-b789-4219-8cde-e1594be4cad0\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") "
Jul 02 20:35:13.369833 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.369549    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e9d32f7-b789-4219-8cde-e1594be4cad0-image-registry-private-configuration\") pod \"0e9d32f7-b789-4219-8cde-e1594be4cad0\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") "
Jul 02 20:35:13.369833 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.369576    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e9d32f7-b789-4219-8cde-e1594be4cad0-ca-trust-extracted\") pod \"0e9d32f7-b789-4219-8cde-e1594be4cad0\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") "
Jul 02 20:35:13.369833 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.369609    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e9d32f7-b789-4219-8cde-e1594be4cad0-installation-pull-secrets\") pod \"0e9d32f7-b789-4219-8cde-e1594be4cad0\" (UID: \"0e9d32f7-b789-4219-8cde-e1594be4cad0\") "
Jul 02 20:35:13.370209 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.370054    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e9d32f7-b789-4219-8cde-e1594be4cad0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0e9d32f7-b789-4219-8cde-e1594be4cad0" (UID: "0e9d32f7-b789-4219-8cde-e1594be4cad0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:35:13.370209 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.370172    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0e9d32f7-b789-4219-8cde-e1594be4cad0" (UID: "0e9d32f7-b789-4219-8cde-e1594be4cad0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:35:13.372190 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.372138    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0e9d32f7-b789-4219-8cde-e1594be4cad0" (UID: "0e9d32f7-b789-4219-8cde-e1594be4cad0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:35:13.372297 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.372239    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0e9d32f7-b789-4219-8cde-e1594be4cad0" (UID: "0e9d32f7-b789-4219-8cde-e1594be4cad0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:35:13.372297 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.372249    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-kube-api-access-t9g4w" (OuterVolumeSpecName: "kube-api-access-t9g4w") pod "0e9d32f7-b789-4219-8cde-e1594be4cad0" (UID: "0e9d32f7-b789-4219-8cde-e1594be4cad0"). InnerVolumeSpecName "kube-api-access-t9g4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:35:13.372391 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.372377    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e9d32f7-b789-4219-8cde-e1594be4cad0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0e9d32f7-b789-4219-8cde-e1594be4cad0" (UID: "0e9d32f7-b789-4219-8cde-e1594be4cad0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:35:13.372460 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.372441    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e9d32f7-b789-4219-8cde-e1594be4cad0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0e9d32f7-b789-4219-8cde-e1594be4cad0" (UID: "0e9d32f7-b789-4219-8cde-e1594be4cad0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:35:13.377813 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.377785    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9d32f7-b789-4219-8cde-e1594be4cad0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0e9d32f7-b789-4219-8cde-e1594be4cad0" (UID: "0e9d32f7-b789-4219-8cde-e1594be4cad0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:35:13.470852 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.470799    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e9d32f7-b789-4219-8cde-e1594be4cad0-trusted-ca\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:13.470852 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.470845    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-certificates\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:13.470852 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.470858    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e9d32f7-b789-4219-8cde-e1594be4cad0-image-registry-private-configuration\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:13.470852 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.470869    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e9d32f7-b789-4219-8cde-e1594be4cad0-ca-trust-extracted\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:13.471105 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.470877    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e9d32f7-b789-4219-8cde-e1594be4cad0-installation-pull-secrets\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:13.471105 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.470886    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9g4w\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-kube-api-access-t9g4w\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:13.471105 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.470893    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-bound-sa-token\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:13.471105 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:13.470901    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e9d32f7-b789-4219-8cde-e1594be4cad0-registry-tls\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:14.017796 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:14.017734    2565 generic.go:356] "Generic (PLEG): container finished" podID="0e9d32f7-b789-4219-8cde-e1594be4cad0" containerID="7394512a485e1a21c07139dd427039a40580b22e599283f50f0ef019fe3b789e" exitCode=0
Jul 02 20:35:14.017965 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:14.017801    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5"
Jul 02 20:35:14.017965 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:14.017835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5" event={"ID":"0e9d32f7-b789-4219-8cde-e1594be4cad0","Type":"ContainerDied","Data":"7394512a485e1a21c07139dd427039a40580b22e599283f50f0ef019fe3b789e"}
Jul 02 20:35:14.017965 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:14.017901    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cdbbccf58-hhzk5" event={"ID":"0e9d32f7-b789-4219-8cde-e1594be4cad0","Type":"ContainerDied","Data":"83f31c8e0d5a0cfccf92706980c1d54d137d7eb86a1bb13d1a5301eb82ccc247"}
Jul 02 20:35:14.017965 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:14.017928    2565 scope.go:117] "RemoveContainer" containerID="7394512a485e1a21c07139dd427039a40580b22e599283f50f0ef019fe3b789e"
Jul 02 20:35:14.026428 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:14.026408    2565 scope.go:117] "RemoveContainer" containerID="7394512a485e1a21c07139dd427039a40580b22e599283f50f0ef019fe3b789e"
Jul 02 20:35:14.026707 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:35:14.026689    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7394512a485e1a21c07139dd427039a40580b22e599283f50f0ef019fe3b789e\": container with ID starting with 7394512a485e1a21c07139dd427039a40580b22e599283f50f0ef019fe3b789e not found: ID does not exist" containerID="7394512a485e1a21c07139dd427039a40580b22e599283f50f0ef019fe3b789e"
Jul 02 20:35:14.026783 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:14.026716    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7394512a485e1a21c07139dd427039a40580b22e599283f50f0ef019fe3b789e"} err="failed to get container status \"7394512a485e1a21c07139dd427039a40580b22e599283f50f0ef019fe3b789e\": rpc error: code = NotFound desc = could not find container \"7394512a485e1a21c07139dd427039a40580b22e599283f50f0ef019fe3b789e\": container with ID starting with 7394512a485e1a21c07139dd427039a40580b22e599283f50f0ef019fe3b789e not found: ID does not exist"
Jul 02 20:35:14.037553 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:14.037523    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cdbbccf58-hhzk5"]
Jul 02 20:35:14.041481 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:14.041459    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6cdbbccf58-hhzk5"]
Jul 02 20:35:14.297529 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:14.297453    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e9d32f7-b789-4219-8cde-e1594be4cad0" path="/var/lib/kubelet/pods/0e9d32f7-b789-4219-8cde-e1594be4cad0/volumes"
Jul 02 20:35:14.434642 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:14.434612    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:14.495684 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:14.495637    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:18.245663 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:18.245625    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:18.346407 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:18.346362    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:18.401007 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:18.400979    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:23.103824 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:23.103792    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:35:23.107584 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:23.107562    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7c7fccbd7c-8hfvh"
Jul 02 20:35:26.028975 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.028910    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5659854cff-mpp6w" podUID="305e03fa-29be-41cb-a8ce-fcba8607a90f" containerName="console" containerID="cri-o://60c469889c7aaab911c238f41805cb4acd57c71fc7884bd5d1cec433602790a6" gracePeriod=15
Jul 02 20:35:26.294508 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.294482    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:35:26.379563 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.379526    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-trusted-ca-bundle\") pod \"305e03fa-29be-41cb-a8ce-fcba8607a90f\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") "
Jul 02 20:35:26.379723 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.379592    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-serving-cert\") pod \"305e03fa-29be-41cb-a8ce-fcba8607a90f\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") "
Jul 02 20:35:26.379723 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.379619    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-oauth-config\") pod \"305e03fa-29be-41cb-a8ce-fcba8607a90f\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") "
Jul 02 20:35:26.379854 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.379727    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v4jh\" (UniqueName: \"kubernetes.io/projected/305e03fa-29be-41cb-a8ce-fcba8607a90f-kube-api-access-8v4jh\") pod \"305e03fa-29be-41cb-a8ce-fcba8607a90f\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") "
Jul 02 20:35:26.379854 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.379800    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-config\") pod \"305e03fa-29be-41cb-a8ce-fcba8607a90f\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") "
Jul 02 20:35:26.379854 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.379846    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-oauth-serving-cert\") pod \"305e03fa-29be-41cb-a8ce-fcba8607a90f\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") "
Jul 02 20:35:26.380008 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.379873    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-service-ca\") pod \"305e03fa-29be-41cb-a8ce-fcba8607a90f\" (UID: \"305e03fa-29be-41cb-a8ce-fcba8607a90f\") "
Jul 02 20:35:26.380061 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.380021    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "305e03fa-29be-41cb-a8ce-fcba8607a90f" (UID: "305e03fa-29be-41cb-a8ce-fcba8607a90f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:35:26.380232 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.380208    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-config" (OuterVolumeSpecName: "console-config") pod "305e03fa-29be-41cb-a8ce-fcba8607a90f" (UID: "305e03fa-29be-41cb-a8ce-fcba8607a90f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:35:26.380300 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.380257    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-service-ca" (OuterVolumeSpecName: "service-ca") pod "305e03fa-29be-41cb-a8ce-fcba8607a90f" (UID: "305e03fa-29be-41cb-a8ce-fcba8607a90f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:35:26.380300 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.380247    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "305e03fa-29be-41cb-a8ce-fcba8607a90f" (UID: "305e03fa-29be-41cb-a8ce-fcba8607a90f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:35:26.380434 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.380368    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-config\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:26.380434 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.380384    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-oauth-serving-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:26.380434 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.380398    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-service-ca\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:26.380434 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.380407    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/305e03fa-29be-41cb-a8ce-fcba8607a90f-trusted-ca-bundle\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:26.381824 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.381795    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "305e03fa-29be-41cb-a8ce-fcba8607a90f" (UID: "305e03fa-29be-41cb-a8ce-fcba8607a90f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:35:26.382181 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.382155    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "305e03fa-29be-41cb-a8ce-fcba8607a90f" (UID: "305e03fa-29be-41cb-a8ce-fcba8607a90f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:35:26.382181 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.382155    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/305e03fa-29be-41cb-a8ce-fcba8607a90f-kube-api-access-8v4jh" (OuterVolumeSpecName: "kube-api-access-8v4jh") pod "305e03fa-29be-41cb-a8ce-fcba8607a90f" (UID: "305e03fa-29be-41cb-a8ce-fcba8607a90f"). InnerVolumeSpecName "kube-api-access-8v4jh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:35:26.481168 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.481137    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-serving-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:26.481168 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.481164    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/305e03fa-29be-41cb-a8ce-fcba8607a90f-console-oauth-config\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:26.481168 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:26.481173    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v4jh\" (UniqueName: \"kubernetes.io/projected/305e03fa-29be-41cb-a8ce-fcba8607a90f-kube-api-access-8v4jh\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:35:27.070545 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:27.070513    2565 generic.go:356] "Generic (PLEG): container finished" podID="305e03fa-29be-41cb-a8ce-fcba8607a90f" containerID="60c469889c7aaab911c238f41805cb4acd57c71fc7884bd5d1cec433602790a6" exitCode=0
Jul 02 20:35:27.070920 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:27.070561    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5659854cff-mpp6w"
Jul 02 20:35:27.070920 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:27.070602    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5659854cff-mpp6w" event={"ID":"305e03fa-29be-41cb-a8ce-fcba8607a90f","Type":"ContainerDied","Data":"60c469889c7aaab911c238f41805cb4acd57c71fc7884bd5d1cec433602790a6"}
Jul 02 20:35:27.070920 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:27.070654    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5659854cff-mpp6w" event={"ID":"305e03fa-29be-41cb-a8ce-fcba8607a90f","Type":"ContainerDied","Data":"b1855cc064b3e05551f4689a6bd7a1b034693bf02486b01a9944f3ec4cff6f77"}
Jul 02 20:35:27.070920 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:27.070678    2565 scope.go:117] "RemoveContainer" containerID="60c469889c7aaab911c238f41805cb4acd57c71fc7884bd5d1cec433602790a6"
Jul 02 20:35:27.079256 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:27.079240    2565 scope.go:117] "RemoveContainer" containerID="60c469889c7aaab911c238f41805cb4acd57c71fc7884bd5d1cec433602790a6"
Jul 02 20:35:27.079511 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:35:27.079493    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60c469889c7aaab911c238f41805cb4acd57c71fc7884bd5d1cec433602790a6\": container with ID starting with 60c469889c7aaab911c238f41805cb4acd57c71fc7884bd5d1cec433602790a6 not found: ID does not exist" containerID="60c469889c7aaab911c238f41805cb4acd57c71fc7884bd5d1cec433602790a6"
Jul 02 20:35:27.079551 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:27.079520    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c469889c7aaab911c238f41805cb4acd57c71fc7884bd5d1cec433602790a6"} err="failed to get container status \"60c469889c7aaab911c238f41805cb4acd57c71fc7884bd5d1cec433602790a6\": rpc error: code = NotFound desc = could not find container \"60c469889c7aaab911c238f41805cb4acd57c71fc7884bd5d1cec433602790a6\": container with ID starting with 60c469889c7aaab911c238f41805cb4acd57c71fc7884bd5d1cec433602790a6 not found: ID does not exist"
Jul 02 20:35:27.091393 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:27.091371    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5659854cff-mpp6w"]
Jul 02 20:35:27.095616 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:27.095594    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5659854cff-mpp6w"]
Jul 02 20:35:28.297292 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:28.297214    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="305e03fa-29be-41cb-a8ce-fcba8607a90f" path="/var/lib/kubelet/pods/305e03fa-29be-41cb-a8ce-fcba8607a90f/volumes"
Jul 02 20:35:33.148812 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:33.148778    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:54.594773 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:54.594729    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:54.647965 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:35:54.647935    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:06.511145 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:06.511112    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:06.570838 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:06.570799    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:18.407959 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:18.407926    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:18.507957 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:18.507929    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:20.513136 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.513096    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-767cd9c89-svs9t"]
Jul 02 20:36:20.513920 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.513898    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="840e6ff0-fc94-4748-9ada-260a7b07174c" containerName="console"
Jul 02 20:36:20.513920 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.513921    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="840e6ff0-fc94-4748-9ada-260a7b07174c" containerName="console"
Jul 02 20:36:20.514019 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.513934    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e9d32f7-b789-4219-8cde-e1594be4cad0" containerName="registry"
Jul 02 20:36:20.514019 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.513940    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e9d32f7-b789-4219-8cde-e1594be4cad0" containerName="registry"
Jul 02 20:36:20.514019 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.513953    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="305e03fa-29be-41cb-a8ce-fcba8607a90f" containerName="console"
Jul 02 20:36:20.514019 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.513958    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="305e03fa-29be-41cb-a8ce-fcba8607a90f" containerName="console"
Jul 02 20:36:20.514019 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.514011    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="305e03fa-29be-41cb-a8ce-fcba8607a90f" containerName="console"
Jul 02 20:36:20.514019 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.514020    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e9d32f7-b789-4219-8cde-e1594be4cad0" containerName="registry"
Jul 02 20:36:20.514188 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.514026    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="840e6ff0-fc94-4748-9ada-260a7b07174c" containerName="console"
Jul 02 20:36:20.516998 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.516980    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.520117 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.520091    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-767cd9c89-svs9t"]
Jul 02 20:36:20.553868 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.553834    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:20.615008 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.614983    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-config\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.615150 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.615017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwnpd\" (UniqueName: \"kubernetes.io/projected/d17a1ed5-1d8d-4c10-b976-612bf914cfff-kube-api-access-xwnpd\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.615150 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.615044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-service-ca\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.615226 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.615131    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-oauth-serving-cert\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.615226 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.615170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-oauth-config\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.615226 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.615188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-trusted-ca-bundle\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.615312 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.615256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-serving-cert\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.620472 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.620448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:20.716536 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.716502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-config\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.716694 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.716545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwnpd\" (UniqueName: \"kubernetes.io/projected/d17a1ed5-1d8d-4c10-b976-612bf914cfff-kube-api-access-xwnpd\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.716694 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.716635    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-service-ca\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.716694 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.716676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-oauth-serving-cert\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.716886 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.716700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-oauth-config\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.716886 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.716827    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-trusted-ca-bundle\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.717004 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.716908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-serving-cert\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.717384 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.717353    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-service-ca\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.717486 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.717353    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-oauth-serving-cert\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.717486 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.717353    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-config\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.717699 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.717677    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-trusted-ca-bundle\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.719273 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.719243    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-oauth-config\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.719362 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.719321    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-serving-cert\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.724766 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.724736    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwnpd\" (UniqueName: \"kubernetes.io/projected/d17a1ed5-1d8d-4c10-b976-612bf914cfff-kube-api-access-xwnpd\") pod \"console-767cd9c89-svs9t\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") " pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.828011 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.827923    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:20.956480 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:20.956460    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-767cd9c89-svs9t"]
Jul 02 20:36:20.959165 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:36:20.959130    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd17a1ed5_1d8d_4c10_b976_612bf914cfff.slice/crio-cefaaeb4f05d5743cbf1ff879ab3a51903179b5b8fd5a61da358c5a0f0f957f2 WatchSource:0}: Error finding container cefaaeb4f05d5743cbf1ff879ab3a51903179b5b8fd5a61da358c5a0f0f957f2: Status 404 returned error can't find the container with id cefaaeb4f05d5743cbf1ff879ab3a51903179b5b8fd5a61da358c5a0f0f957f2
Jul 02 20:36:21.279804 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:21.279745    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-767cd9c89-svs9t" event={"ID":"d17a1ed5-1d8d-4c10-b976-612bf914cfff","Type":"ContainerStarted","Data":"c2cc9097f279950ed1dbf542a3ec35f2e6f96deee438be41ea54a4e3f0335c1b"}
Jul 02 20:36:21.279943 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:21.279827    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-767cd9c89-svs9t" event={"ID":"d17a1ed5-1d8d-4c10-b976-612bf914cfff","Type":"ContainerStarted","Data":"cefaaeb4f05d5743cbf1ff879ab3a51903179b5b8fd5a61da358c5a0f0f957f2"}
Jul 02 20:36:21.296799 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:21.296732    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-767cd9c89-svs9t" podStartSLOduration=1.296717708 podStartE2EDuration="1.296717708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:36:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:36:21.295976774 +0000 UTC m=+225.418988345" watchObservedRunningTime="2026-07-02 20:36:21.296717708 +0000 UTC m=+225.419729279"
Jul 02 20:36:30.828919 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:30.828866    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:30.829307 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:30.828942    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:30.833617 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:30.833596    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:31.320555 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:31.320525    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:36:31.366224 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:31.366190    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6586df5dc7-s26dn"]
Jul 02 20:36:31.471605 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:31.471570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:31.572569 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:31.572494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:31.627558 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:31.627528    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:56.093038 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.093007    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:56.153670 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.153643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:56.387494 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.387396    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6586df5dc7-s26dn" podUID="ead42bbb-8c35-48d3-98f1-3d4befe0f6a4" containerName="console" containerID="cri-o://79b8e1e971ac0e26d0b8b9b214297cf6b3e17fadba3c5b1e130b1da62ead0d51" gracePeriod=15
Jul 02 20:36:56.634284 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.634261    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:36:56.707175 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.707108    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-oauth-serving-cert\") pod \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") "
Jul 02 20:36:56.707175 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.707171    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-serving-cert\") pod \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") "
Jul 02 20:36:56.707382 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.707195    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-oauth-config\") pod \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") "
Jul 02 20:36:56.707382 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.707319    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2ssd\" (UniqueName: \"kubernetes.io/projected/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-kube-api-access-v2ssd\") pod \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") "
Jul 02 20:36:56.707382 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.707378    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-trusted-ca-bundle\") pod \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") "
Jul 02 20:36:56.707548 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.707408    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-service-ca\") pod \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") "
Jul 02 20:36:56.707548 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.707409    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ead42bbb-8c35-48d3-98f1-3d4befe0f6a4" (UID: "ead42bbb-8c35-48d3-98f1-3d4befe0f6a4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:36:56.707548 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.707438    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-config\") pod \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\" (UID: \"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4\") "
Jul 02 20:36:56.707712 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.707680    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-oauth-serving-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:36:56.707807 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.707779    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ead42bbb-8c35-48d3-98f1-3d4befe0f6a4" (UID: "ead42bbb-8c35-48d3-98f1-3d4befe0f6a4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:36:56.707872 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.707824    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-service-ca" (OuterVolumeSpecName: "service-ca") pod "ead42bbb-8c35-48d3-98f1-3d4befe0f6a4" (UID: "ead42bbb-8c35-48d3-98f1-3d4befe0f6a4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:36:56.707872 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.707830    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-config" (OuterVolumeSpecName: "console-config") pod "ead42bbb-8c35-48d3-98f1-3d4befe0f6a4" (UID: "ead42bbb-8c35-48d3-98f1-3d4befe0f6a4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:36:56.709405 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.709370    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ead42bbb-8c35-48d3-98f1-3d4befe0f6a4" (UID: "ead42bbb-8c35-48d3-98f1-3d4befe0f6a4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:36:56.709405 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.709399    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ead42bbb-8c35-48d3-98f1-3d4befe0f6a4" (UID: "ead42bbb-8c35-48d3-98f1-3d4befe0f6a4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:36:56.709549 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.709415    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-kube-api-access-v2ssd" (OuterVolumeSpecName: "kube-api-access-v2ssd") pod "ead42bbb-8c35-48d3-98f1-3d4befe0f6a4" (UID: "ead42bbb-8c35-48d3-98f1-3d4befe0f6a4"). InnerVolumeSpecName "kube-api-access-v2ssd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:36:56.808587 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.808552    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-serving-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:36:56.808587 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.808581    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-oauth-config\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:36:56.808587 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.808590    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2ssd\" (UniqueName: \"kubernetes.io/projected/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-kube-api-access-v2ssd\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:36:56.808587 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.808599    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-trusted-ca-bundle\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:36:56.808907 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.808608    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-service-ca\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:36:56.808907 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:56.808616    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4-console-config\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:36:57.410656 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:57.410619    2565 generic.go:356] "Generic (PLEG): container finished" podID="ead42bbb-8c35-48d3-98f1-3d4befe0f6a4" containerID="79b8e1e971ac0e26d0b8b9b214297cf6b3e17fadba3c5b1e130b1da62ead0d51" exitCode=0
Jul 02 20:36:57.411062 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:57.410662    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6586df5dc7-s26dn"
Jul 02 20:36:57.411062 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:57.410672    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6586df5dc7-s26dn" event={"ID":"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4","Type":"ContainerDied","Data":"79b8e1e971ac0e26d0b8b9b214297cf6b3e17fadba3c5b1e130b1da62ead0d51"}
Jul 02 20:36:57.411062 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:57.410717    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6586df5dc7-s26dn" event={"ID":"ead42bbb-8c35-48d3-98f1-3d4befe0f6a4","Type":"ContainerDied","Data":"baebde226296685dccffcf54f57c692c340c0030aaec83c5c638cadb1b2a622c"}
Jul 02 20:36:57.411062 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:57.410740    2565 scope.go:117] "RemoveContainer" containerID="79b8e1e971ac0e26d0b8b9b214297cf6b3e17fadba3c5b1e130b1da62ead0d51"
Jul 02 20:36:57.419188 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:57.419172    2565 scope.go:117] "RemoveContainer" containerID="79b8e1e971ac0e26d0b8b9b214297cf6b3e17fadba3c5b1e130b1da62ead0d51"
Jul 02 20:36:57.419427 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:36:57.419410    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79b8e1e971ac0e26d0b8b9b214297cf6b3e17fadba3c5b1e130b1da62ead0d51\": container with ID starting with 79b8e1e971ac0e26d0b8b9b214297cf6b3e17fadba3c5b1e130b1da62ead0d51 not found: ID does not exist" containerID="79b8e1e971ac0e26d0b8b9b214297cf6b3e17fadba3c5b1e130b1da62ead0d51"
Jul 02 20:36:57.419475 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:57.419433    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79b8e1e971ac0e26d0b8b9b214297cf6b3e17fadba3c5b1e130b1da62ead0d51"} err="failed to get container status \"79b8e1e971ac0e26d0b8b9b214297cf6b3e17fadba3c5b1e130b1da62ead0d51\": rpc error: code = NotFound desc = could not find container \"79b8e1e971ac0e26d0b8b9b214297cf6b3e17fadba3c5b1e130b1da62ead0d51\": container with ID starting with 79b8e1e971ac0e26d0b8b9b214297cf6b3e17fadba3c5b1e130b1da62ead0d51 not found: ID does not exist"
Jul 02 20:36:57.430957 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:57.430936    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6586df5dc7-s26dn"]
Jul 02 20:36:57.434587 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:57.434568    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6586df5dc7-s26dn"]
Jul 02 20:36:58.298173 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:36:58.298141    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ead42bbb-8c35-48d3-98f1-3d4befe0f6a4" path="/var/lib/kubelet/pods/ead42bbb-8c35-48d3-98f1-3d4befe0f6a4/volumes"
Jul 02 20:37:05.770544 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:05.770507    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:05.866483 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:05.866449    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:06.624330 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.624297    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97"]
Jul 02 20:37:06.624600 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.624588    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ead42bbb-8c35-48d3-98f1-3d4befe0f6a4" containerName="console"
Jul 02 20:37:06.624646 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.624602    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ead42bbb-8c35-48d3-98f1-3d4befe0f6a4" containerName="console"
Jul 02 20:37:06.624679 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.624658    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ead42bbb-8c35-48d3-98f1-3d4befe0f6a4" containerName="console"
Jul 02 20:37:06.627844 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.627829    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97"
Jul 02 20:37:06.630873 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.630852    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 02 20:37:06.630986 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.630918    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 02 20:37:06.632094 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.632080    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x6pn5\""
Jul 02 20:37:06.640414 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.640395    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97"]
Jul 02 20:37:06.786634 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.786597    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f35eb020-85a5-4a02-9d06-546ea9591c3e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97\" (UID: \"f35eb020-85a5-4a02-9d06-546ea9591c3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97"
Jul 02 20:37:06.787013 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.786654    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spcwf\" (UniqueName: \"kubernetes.io/projected/f35eb020-85a5-4a02-9d06-546ea9591c3e-kube-api-access-spcwf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97\" (UID: \"f35eb020-85a5-4a02-9d06-546ea9591c3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97"
Jul 02 20:37:06.787013 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.786707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f35eb020-85a5-4a02-9d06-546ea9591c3e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97\" (UID: \"f35eb020-85a5-4a02-9d06-546ea9591c3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97"
Jul 02 20:37:06.887509 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.887422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f35eb020-85a5-4a02-9d06-546ea9591c3e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97\" (UID: \"f35eb020-85a5-4a02-9d06-546ea9591c3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97"
Jul 02 20:37:06.887509 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.887484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spcwf\" (UniqueName: \"kubernetes.io/projected/f35eb020-85a5-4a02-9d06-546ea9591c3e-kube-api-access-spcwf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97\" (UID: \"f35eb020-85a5-4a02-9d06-546ea9591c3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97"
Jul 02 20:37:06.887686 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.887514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f35eb020-85a5-4a02-9d06-546ea9591c3e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97\" (UID: \"f35eb020-85a5-4a02-9d06-546ea9591c3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97"
Jul 02 20:37:06.887892 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.887871    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f35eb020-85a5-4a02-9d06-546ea9591c3e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97\" (UID: \"f35eb020-85a5-4a02-9d06-546ea9591c3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97"
Jul 02 20:37:06.887934 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.887876    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f35eb020-85a5-4a02-9d06-546ea9591c3e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97\" (UID: \"f35eb020-85a5-4a02-9d06-546ea9591c3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97"
Jul 02 20:37:06.896384 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.896354    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spcwf\" (UniqueName: \"kubernetes.io/projected/f35eb020-85a5-4a02-9d06-546ea9591c3e-kube-api-access-spcwf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97\" (UID: \"f35eb020-85a5-4a02-9d06-546ea9591c3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97"
Jul 02 20:37:06.936868 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:06.936842    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97"
Jul 02 20:37:07.062899 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:07.062871    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97"]
Jul 02 20:37:07.066363 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:37:07.066331    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf35eb020_85a5_4a02_9d06_546ea9591c3e.slice/crio-21f880d21a3e71b18315baa2226f95897fcdf537e21f7467405a2edbff0b8880 WatchSource:0}: Error finding container 21f880d21a3e71b18315baa2226f95897fcdf537e21f7467405a2edbff0b8880: Status 404 returned error can't find the container with id 21f880d21a3e71b18315baa2226f95897fcdf537e21f7467405a2edbff0b8880
Jul 02 20:37:07.455267 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:07.455220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97" event={"ID":"f35eb020-85a5-4a02-9d06-546ea9591c3e","Type":"ContainerStarted","Data":"21f880d21a3e71b18315baa2226f95897fcdf537e21f7467405a2edbff0b8880"}
Jul 02 20:37:13.141019 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:13.140973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:14.485397 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:14.485364    2565 generic.go:356] "Generic (PLEG): container finished" podID="f35eb020-85a5-4a02-9d06-546ea9591c3e" containerID="36101132a428dca4a5714a490686fefa78661ed493e45413018a7445192494b4" exitCode=0
Jul 02 20:37:14.485397 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:14.485397    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97" event={"ID":"f35eb020-85a5-4a02-9d06-546ea9591c3e","Type":"ContainerDied","Data":"36101132a428dca4a5714a490686fefa78661ed493e45413018a7445192494b4"}
Jul 02 20:37:17.498443 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:17.498401    2565 generic.go:356] "Generic (PLEG): container finished" podID="f35eb020-85a5-4a02-9d06-546ea9591c3e" containerID="09d63a3ed17cd61da4fe5e40feb062221eedf033f4bca6d964759a54d3505bc4" exitCode=0
Jul 02 20:37:17.498821 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:17.498466    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97" event={"ID":"f35eb020-85a5-4a02-9d06-546ea9591c3e","Type":"ContainerDied","Data":"09d63a3ed17cd61da4fe5e40feb062221eedf033f4bca6d964759a54d3505bc4"}
Jul 02 20:37:24.531543 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:24.531509    2565 generic.go:356] "Generic (PLEG): container finished" podID="f35eb020-85a5-4a02-9d06-546ea9591c3e" containerID="9ce4660cb8dd265b0793370ebaae1dafaa7a0fab583568ace8954a87174481a6" exitCode=0
Jul 02 20:37:24.531938 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:24.531569    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97" event={"ID":"f35eb020-85a5-4a02-9d06-546ea9591c3e","Type":"ContainerDied","Data":"9ce4660cb8dd265b0793370ebaae1dafaa7a0fab583568ace8954a87174481a6"}
Jul 02 20:37:25.659739 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:25.659716    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97"
Jul 02 20:37:25.847370 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:25.847340    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f35eb020-85a5-4a02-9d06-546ea9591c3e-util\") pod \"f35eb020-85a5-4a02-9d06-546ea9591c3e\" (UID: \"f35eb020-85a5-4a02-9d06-546ea9591c3e\") "
Jul 02 20:37:25.847521 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:25.847395    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spcwf\" (UniqueName: \"kubernetes.io/projected/f35eb020-85a5-4a02-9d06-546ea9591c3e-kube-api-access-spcwf\") pod \"f35eb020-85a5-4a02-9d06-546ea9591c3e\" (UID: \"f35eb020-85a5-4a02-9d06-546ea9591c3e\") "
Jul 02 20:37:25.847521 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:25.847466    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f35eb020-85a5-4a02-9d06-546ea9591c3e-bundle\") pod \"f35eb020-85a5-4a02-9d06-546ea9591c3e\" (UID: \"f35eb020-85a5-4a02-9d06-546ea9591c3e\") "
Jul 02 20:37:25.848126 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:25.848094    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f35eb020-85a5-4a02-9d06-546ea9591c3e-bundle" (OuterVolumeSpecName: "bundle") pod "f35eb020-85a5-4a02-9d06-546ea9591c3e" (UID: "f35eb020-85a5-4a02-9d06-546ea9591c3e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:37:25.849561 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:25.849540    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f35eb020-85a5-4a02-9d06-546ea9591c3e-kube-api-access-spcwf" (OuterVolumeSpecName: "kube-api-access-spcwf") pod "f35eb020-85a5-4a02-9d06-546ea9591c3e" (UID: "f35eb020-85a5-4a02-9d06-546ea9591c3e"). InnerVolumeSpecName "kube-api-access-spcwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:37:25.853359 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:25.853336    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f35eb020-85a5-4a02-9d06-546ea9591c3e-util" (OuterVolumeSpecName: "util") pod "f35eb020-85a5-4a02-9d06-546ea9591c3e" (UID: "f35eb020-85a5-4a02-9d06-546ea9591c3e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:37:25.948544 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:25.948510    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f35eb020-85a5-4a02-9d06-546ea9591c3e-util\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:37:25.948544 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:25.948540    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spcwf\" (UniqueName: \"kubernetes.io/projected/f35eb020-85a5-4a02-9d06-546ea9591c3e-kube-api-access-spcwf\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:37:25.948544 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:25.948550    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f35eb020-85a5-4a02-9d06-546ea9591c3e-bundle\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:37:26.540590 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:26.540558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97" event={"ID":"f35eb020-85a5-4a02-9d06-546ea9591c3e","Type":"ContainerDied","Data":"21f880d21a3e71b18315baa2226f95897fcdf537e21f7467405a2edbff0b8880"}
Jul 02 20:37:26.540745 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:26.540596    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406mq97"
Jul 02 20:37:26.540745 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:26.540604    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21f880d21a3e71b18315baa2226f95897fcdf537e21f7467405a2edbff0b8880"
Jul 02 20:37:27.439708 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:27.439673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:28.787444 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:28.787410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:29.381584 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.381552    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mxc62"]
Jul 02 20:37:29.381894 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.381880    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f35eb020-85a5-4a02-9d06-546ea9591c3e" containerName="util"
Jul 02 20:37:29.381941 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.381896    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f35eb020-85a5-4a02-9d06-546ea9591c3e" containerName="util"
Jul 02 20:37:29.381941 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.381906    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f35eb020-85a5-4a02-9d06-546ea9591c3e" containerName="pull"
Jul 02 20:37:29.381941 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.381911    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f35eb020-85a5-4a02-9d06-546ea9591c3e" containerName="pull"
Jul 02 20:37:29.381941 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.381926    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f35eb020-85a5-4a02-9d06-546ea9591c3e" containerName="extract"
Jul 02 20:37:29.381941 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.381932    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f35eb020-85a5-4a02-9d06-546ea9591c3e" containerName="extract"
Jul 02 20:37:29.382127 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.381983    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f35eb020-85a5-4a02-9d06-546ea9591c3e" containerName="extract"
Jul 02 20:37:29.428849 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.428818    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mxc62"]
Jul 02 20:37:29.429030 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.428946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mxc62"
Jul 02 20:37:29.431998 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.431980    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 02 20:37:29.432091 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.431996    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:37:29.432349 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.432333    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lnp9k\""
Jul 02 20:37:29.579154 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.579124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3d86c8c-d444-4535-a3d0-0adcd86fe7e1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mxc62\" (UID: \"b3d86c8c-d444-4535-a3d0-0adcd86fe7e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mxc62"
Jul 02 20:37:29.579310 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.579160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbznr\" (UniqueName: \"kubernetes.io/projected/b3d86c8c-d444-4535-a3d0-0adcd86fe7e1-kube-api-access-mbznr\") pod \"cert-manager-operator-controller-manager-55c444bf86-mxc62\" (UID: \"b3d86c8c-d444-4535-a3d0-0adcd86fe7e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mxc62"
Jul 02 20:37:29.679798 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.679702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3d86c8c-d444-4535-a3d0-0adcd86fe7e1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mxc62\" (UID: \"b3d86c8c-d444-4535-a3d0-0adcd86fe7e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mxc62"
Jul 02 20:37:29.679798 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.679741    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbznr\" (UniqueName: \"kubernetes.io/projected/b3d86c8c-d444-4535-a3d0-0adcd86fe7e1-kube-api-access-mbznr\") pod \"cert-manager-operator-controller-manager-55c444bf86-mxc62\" (UID: \"b3d86c8c-d444-4535-a3d0-0adcd86fe7e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mxc62"
Jul 02 20:37:29.680077 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.680059    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3d86c8c-d444-4535-a3d0-0adcd86fe7e1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mxc62\" (UID: \"b3d86c8c-d444-4535-a3d0-0adcd86fe7e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mxc62"
Jul 02 20:37:29.688599 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.688579    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbznr\" (UniqueName: \"kubernetes.io/projected/b3d86c8c-d444-4535-a3d0-0adcd86fe7e1-kube-api-access-mbznr\") pod \"cert-manager-operator-controller-manager-55c444bf86-mxc62\" (UID: \"b3d86c8c-d444-4535-a3d0-0adcd86fe7e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mxc62"
Jul 02 20:37:29.738409 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.738381    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mxc62"
Jul 02 20:37:29.897873 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:29.897838    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mxc62"]
Jul 02 20:37:29.900343 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:37:29.900316    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d86c8c_d444_4535_a3d0_0adcd86fe7e1.slice/crio-ee9883c57f04f301cf0d2118522e707fab160569f2b94e65b55a26a23f00e064 WatchSource:0}: Error finding container ee9883c57f04f301cf0d2118522e707fab160569f2b94e65b55a26a23f00e064: Status 404 returned error can't find the container with id ee9883c57f04f301cf0d2118522e707fab160569f2b94e65b55a26a23f00e064
Jul 02 20:37:30.558040 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:30.558007    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mxc62" event={"ID":"b3d86c8c-d444-4535-a3d0-0adcd86fe7e1","Type":"ContainerStarted","Data":"ee9883c57f04f301cf0d2118522e707fab160569f2b94e65b55a26a23f00e064"}
Jul 02 20:37:31.034658 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:31.034618    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:31.135399 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:31.135359    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:32.569192 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:32.569160    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mxc62" event={"ID":"b3d86c8c-d444-4535-a3d0-0adcd86fe7e1","Type":"ContainerStarted","Data":"1a9b8db1d099881e33adb623c9f74ccb77d9e4c82e5e8836514f2694f321aa8d"}
Jul 02 20:37:32.590054 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:32.589999    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mxc62" podStartSLOduration=1.551855179 podStartE2EDuration="3.589981504s" totalImagesPullingTime="2.038126325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:37:32.58881212 +0000 UTC m=+296.711823692" watchObservedRunningTime="2026-07-02 20:37:32.589981504 +0000 UTC m=+296.712993077"
Jul 02 20:37:32.998698 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:32.998632    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:33.140539 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.140507    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:33.659459 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.659430    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g"]
Jul 02 20:37:33.662126 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.662109    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g"
Jul 02 20:37:33.665164 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.665142    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x6pn5\""
Jul 02 20:37:33.665365 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.665348    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 02 20:37:33.666211 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.666196    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 02 20:37:33.673269 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.673248    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g"]
Jul 02 20:37:33.714879 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.714848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4be57b53-7425-403d-96fd-0a21ac4801d7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g\" (UID: \"4be57b53-7425-403d-96fd-0a21ac4801d7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g"
Jul 02 20:37:33.715022 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.714900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4be57b53-7425-403d-96fd-0a21ac4801d7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g\" (UID: \"4be57b53-7425-403d-96fd-0a21ac4801d7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g"
Jul 02 20:37:33.715022 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.714956    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn5mj\" (UniqueName: \"kubernetes.io/projected/4be57b53-7425-403d-96fd-0a21ac4801d7-kube-api-access-bn5mj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g\" (UID: \"4be57b53-7425-403d-96fd-0a21ac4801d7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g"
Jul 02 20:37:33.815644 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.815615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn5mj\" (UniqueName: \"kubernetes.io/projected/4be57b53-7425-403d-96fd-0a21ac4801d7-kube-api-access-bn5mj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g\" (UID: \"4be57b53-7425-403d-96fd-0a21ac4801d7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g"
Jul 02 20:37:33.815740 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.815670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4be57b53-7425-403d-96fd-0a21ac4801d7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g\" (UID: \"4be57b53-7425-403d-96fd-0a21ac4801d7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g"
Jul 02 20:37:33.815740 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.815704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4be57b53-7425-403d-96fd-0a21ac4801d7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g\" (UID: \"4be57b53-7425-403d-96fd-0a21ac4801d7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g"
Jul 02 20:37:33.816156 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.816136    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4be57b53-7425-403d-96fd-0a21ac4801d7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g\" (UID: \"4be57b53-7425-403d-96fd-0a21ac4801d7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g"
Jul 02 20:37:33.816156 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.816149    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4be57b53-7425-403d-96fd-0a21ac4801d7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g\" (UID: \"4be57b53-7425-403d-96fd-0a21ac4801d7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g"
Jul 02 20:37:33.829205 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.829181    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn5mj\" (UniqueName: \"kubernetes.io/projected/4be57b53-7425-403d-96fd-0a21ac4801d7-kube-api-access-bn5mj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g\" (UID: \"4be57b53-7425-403d-96fd-0a21ac4801d7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g"
Jul 02 20:37:33.971332 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:33.971249    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g"
Jul 02 20:37:34.095334 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:34.095227    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g"]
Jul 02 20:37:34.098895 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:37:34.098867    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4be57b53_7425_403d_96fd_0a21ac4801d7.slice/crio-8d21cd3c5ea53519e9b78f79e536d9d6f0ea63929266b861be3ce8dedd7fbf87 WatchSource:0}: Error finding container 8d21cd3c5ea53519e9b78f79e536d9d6f0ea63929266b861be3ce8dedd7fbf87: Status 404 returned error can't find the container with id 8d21cd3c5ea53519e9b78f79e536d9d6f0ea63929266b861be3ce8dedd7fbf87
Jul 02 20:37:34.581261 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:34.581225    2565 generic.go:356] "Generic (PLEG): container finished" podID="4be57b53-7425-403d-96fd-0a21ac4801d7" containerID="731b2e747210666a194b0bd7b47e6f9437a0735aeb3d19b8ea9b83876cfd9ad5" exitCode=0
Jul 02 20:37:34.581453 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:34.581279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g" event={"ID":"4be57b53-7425-403d-96fd-0a21ac4801d7","Type":"ContainerDied","Data":"731b2e747210666a194b0bd7b47e6f9437a0735aeb3d19b8ea9b83876cfd9ad5"}
Jul 02 20:37:34.581453 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:34.581314    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g" event={"ID":"4be57b53-7425-403d-96fd-0a21ac4801d7","Type":"ContainerStarted","Data":"8d21cd3c5ea53519e9b78f79e536d9d6f0ea63929266b861be3ce8dedd7fbf87"}
Jul 02 20:37:35.387123 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:35.387076    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:35.612784 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:35.612723    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:36.248309 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.248286    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 20:37:36.248589 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.248573    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 20:37:36.258254 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.258236    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 20:37:36.549173 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.549075    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-drqnj"]
Jul 02 20:37:36.552189 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.552175    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-drqnj"
Jul 02 20:37:36.554935 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.554916    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-76tw5\""
Jul 02 20:37:36.556180 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.555440    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 02 20:37:36.556180 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.556088    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 02 20:37:36.560572 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.560544    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-drqnj"]
Jul 02 20:37:36.593838 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.593804    2565 generic.go:356] "Generic (PLEG): container finished" podID="4be57b53-7425-403d-96fd-0a21ac4801d7" containerID="f8426355a7564e3f99c5471e6d589efc9312a3284a569c7b2a0c2cc48126b962" exitCode=0
Jul 02 20:37:36.593962 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.593865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g" event={"ID":"4be57b53-7425-403d-96fd-0a21ac4801d7","Type":"ContainerDied","Data":"f8426355a7564e3f99c5471e6d589efc9312a3284a569c7b2a0c2cc48126b962"}
Jul 02 20:37:36.634526 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.634504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbq9f\" (UniqueName: \"kubernetes.io/projected/bdd193fd-28a1-46d7-b634-2c7bb4ea93f5-kube-api-access-jbq9f\") pod \"cert-manager-cainjector-559cdd8c87-drqnj\" (UID: \"bdd193fd-28a1-46d7-b634-2c7bb4ea93f5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-drqnj"
Jul 02 20:37:36.634628 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.634552    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdd193fd-28a1-46d7-b634-2c7bb4ea93f5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-drqnj\" (UID: \"bdd193fd-28a1-46d7-b634-2c7bb4ea93f5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-drqnj"
Jul 02 20:37:36.735661 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.735622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbq9f\" (UniqueName: \"kubernetes.io/projected/bdd193fd-28a1-46d7-b634-2c7bb4ea93f5-kube-api-access-jbq9f\") pod \"cert-manager-cainjector-559cdd8c87-drqnj\" (UID: \"bdd193fd-28a1-46d7-b634-2c7bb4ea93f5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-drqnj"
Jul 02 20:37:36.735807 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.735682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdd193fd-28a1-46d7-b634-2c7bb4ea93f5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-drqnj\" (UID: \"bdd193fd-28a1-46d7-b634-2c7bb4ea93f5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-drqnj"
Jul 02 20:37:36.744707 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.744675    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdd193fd-28a1-46d7-b634-2c7bb4ea93f5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-drqnj\" (UID: \"bdd193fd-28a1-46d7-b634-2c7bb4ea93f5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-drqnj"
Jul 02 20:37:36.744831 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.744745    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbq9f\" (UniqueName: \"kubernetes.io/projected/bdd193fd-28a1-46d7-b634-2c7bb4ea93f5-kube-api-access-jbq9f\") pod \"cert-manager-cainjector-559cdd8c87-drqnj\" (UID: \"bdd193fd-28a1-46d7-b634-2c7bb4ea93f5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-drqnj"
Jul 02 20:37:36.865856 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:36.865823    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-drqnj"
Jul 02 20:37:37.005504 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:37.005470    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-drqnj"]
Jul 02 20:37:37.009459 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:37:37.009435    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdd193fd_28a1_46d7_b634_2c7bb4ea93f5.slice/crio-ae5067869fd18174d5485388b3d77a7b879bcd0a7aa39cc9949dcfd8195b7664 WatchSource:0}: Error finding container ae5067869fd18174d5485388b3d77a7b879bcd0a7aa39cc9949dcfd8195b7664: Status 404 returned error can't find the container with id ae5067869fd18174d5485388b3d77a7b879bcd0a7aa39cc9949dcfd8195b7664
Jul 02 20:37:37.599447 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:37.599412    2565 generic.go:356] "Generic (PLEG): container finished" podID="4be57b53-7425-403d-96fd-0a21ac4801d7" containerID="427dba2896655d3787abebd48cf74c5ac088d701058208026a25d372e1d0290a" exitCode=0
Jul 02 20:37:37.599879 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:37.599494    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g" event={"ID":"4be57b53-7425-403d-96fd-0a21ac4801d7","Type":"ContainerDied","Data":"427dba2896655d3787abebd48cf74c5ac088d701058208026a25d372e1d0290a"}
Jul 02 20:37:37.600627 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:37.600605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-drqnj" event={"ID":"bdd193fd-28a1-46d7-b634-2c7bb4ea93f5","Type":"ContainerStarted","Data":"ae5067869fd18174d5485388b3d77a7b879bcd0a7aa39cc9949dcfd8195b7664"}
Jul 02 20:37:38.026409 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:38.026330    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:38.126830 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:38.126789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:38.752085 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:38.752052    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g"
Jul 02 20:37:38.852099 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:38.852063    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4be57b53-7425-403d-96fd-0a21ac4801d7-util\") pod \"4be57b53-7425-403d-96fd-0a21ac4801d7\" (UID: \"4be57b53-7425-403d-96fd-0a21ac4801d7\") "
Jul 02 20:37:38.852272 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:38.852125    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bn5mj\" (UniqueName: \"kubernetes.io/projected/4be57b53-7425-403d-96fd-0a21ac4801d7-kube-api-access-bn5mj\") pod \"4be57b53-7425-403d-96fd-0a21ac4801d7\" (UID: \"4be57b53-7425-403d-96fd-0a21ac4801d7\") "
Jul 02 20:37:38.852272 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:38.852175    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4be57b53-7425-403d-96fd-0a21ac4801d7-bundle\") pod \"4be57b53-7425-403d-96fd-0a21ac4801d7\" (UID: \"4be57b53-7425-403d-96fd-0a21ac4801d7\") "
Jul 02 20:37:38.852588 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:38.852529    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4be57b53-7425-403d-96fd-0a21ac4801d7-bundle" (OuterVolumeSpecName: "bundle") pod "4be57b53-7425-403d-96fd-0a21ac4801d7" (UID: "4be57b53-7425-403d-96fd-0a21ac4801d7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:37:38.854474 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:38.854442    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4be57b53-7425-403d-96fd-0a21ac4801d7-kube-api-access-bn5mj" (OuterVolumeSpecName: "kube-api-access-bn5mj") pod "4be57b53-7425-403d-96fd-0a21ac4801d7" (UID: "4be57b53-7425-403d-96fd-0a21ac4801d7"). InnerVolumeSpecName "kube-api-access-bn5mj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:37:38.859382 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:38.859356    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4be57b53-7425-403d-96fd-0a21ac4801d7-util" (OuterVolumeSpecName: "util") pod "4be57b53-7425-403d-96fd-0a21ac4801d7" (UID: "4be57b53-7425-403d-96fd-0a21ac4801d7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:37:38.953616 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:38.953581    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4be57b53-7425-403d-96fd-0a21ac4801d7-bundle\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:37:38.953616 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:38.953609    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4be57b53-7425-403d-96fd-0a21ac4801d7-util\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:37:38.953616 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:38.953618    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bn5mj\" (UniqueName: \"kubernetes.io/projected/4be57b53-7425-403d-96fd-0a21ac4801d7-kube-api-access-bn5mj\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:37:39.613301 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:39.613260    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g" event={"ID":"4be57b53-7425-403d-96fd-0a21ac4801d7","Type":"ContainerDied","Data":"8d21cd3c5ea53519e9b78f79e536d9d6f0ea63929266b861be3ce8dedd7fbf87"}
Jul 02 20:37:39.613301 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:39.613294    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdzq2g"
Jul 02 20:37:39.613523 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:39.613318    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d21cd3c5ea53519e9b78f79e536d9d6f0ea63929266b861be3ce8dedd7fbf87"
Jul 02 20:37:40.618515 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:40.618485    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-drqnj" event={"ID":"bdd193fd-28a1-46d7-b634-2c7bb4ea93f5","Type":"ContainerStarted","Data":"38ec9df07b358a4e00ed9fba78b4c901aa3297d569609e35931d417708be98d0"}
Jul 02 20:37:40.636709 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:40.636659    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-drqnj" podStartSLOduration=1.842871505 podStartE2EDuration="4.636642705s" totalImagesPullingTime="2.7937712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:37:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:37:40.635295342 +0000 UTC m=+304.758306912" watchObservedRunningTime="2026-07-02 20:37:40.636642705 +0000 UTC m=+304.759654275"
Jul 02 20:37:41.162227 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.162189    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c699r"]
Jul 02 20:37:41.162567 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.162549    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be57b53-7425-403d-96fd-0a21ac4801d7" containerName="extract"
Jul 02 20:37:41.162652 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.162570    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be57b53-7425-403d-96fd-0a21ac4801d7" containerName="extract"
Jul 02 20:37:41.162652 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.162591    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be57b53-7425-403d-96fd-0a21ac4801d7" containerName="pull"
Jul 02 20:37:41.162652 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.162599    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be57b53-7425-403d-96fd-0a21ac4801d7" containerName="pull"
Jul 02 20:37:41.162652 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.162625    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be57b53-7425-403d-96fd-0a21ac4801d7" containerName="util"
Jul 02 20:37:41.162652 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.162633    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be57b53-7425-403d-96fd-0a21ac4801d7" containerName="util"
Jul 02 20:37:41.163010 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.162710    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4be57b53-7425-403d-96fd-0a21ac4801d7" containerName="extract"
Jul 02 20:37:41.167703 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.167062    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-c699r"
Jul 02 20:37:41.171827 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.171808    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-8tct7\""
Jul 02 20:37:41.175225 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.175197    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c699r"]
Jul 02 20:37:41.272508 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.272475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4wc8\" (UniqueName: \"kubernetes.io/projected/8e70322e-dff7-481f-ae76-632314a551cd-kube-api-access-p4wc8\") pod \"cert-manager-webhook-6486ffd997-c699r\" (UID: \"8e70322e-dff7-481f-ae76-632314a551cd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c699r"
Jul 02 20:37:41.272508 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.272512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e70322e-dff7-481f-ae76-632314a551cd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c699r\" (UID: \"8e70322e-dff7-481f-ae76-632314a551cd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c699r"
Jul 02 20:37:41.373892 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.373846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4wc8\" (UniqueName: \"kubernetes.io/projected/8e70322e-dff7-481f-ae76-632314a551cd-kube-api-access-p4wc8\") pod \"cert-manager-webhook-6486ffd997-c699r\" (UID: \"8e70322e-dff7-481f-ae76-632314a551cd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c699r"
Jul 02 20:37:41.373892 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.373892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e70322e-dff7-481f-ae76-632314a551cd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c699r\" (UID: \"8e70322e-dff7-481f-ae76-632314a551cd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c699r"
Jul 02 20:37:41.385952 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.385927    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e70322e-dff7-481f-ae76-632314a551cd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c699r\" (UID: \"8e70322e-dff7-481f-ae76-632314a551cd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c699r"
Jul 02 20:37:41.386104 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.386086    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4wc8\" (UniqueName: \"kubernetes.io/projected/8e70322e-dff7-481f-ae76-632314a551cd-kube-api-access-p4wc8\") pod \"cert-manager-webhook-6486ffd997-c699r\" (UID: \"8e70322e-dff7-481f-ae76-632314a551cd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c699r"
Jul 02 20:37:41.477468 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.477398    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-c699r"
Jul 02 20:37:41.615088 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.615060    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c699r"]
Jul 02 20:37:41.617661 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:37:41.617631    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e70322e_dff7_481f_ae76_632314a551cd.slice/crio-22545fe77b7ae34bf101c69f433bd5e87bd9337779e206c9b8a2f25eb99fb5aa WatchSource:0}: Error finding container 22545fe77b7ae34bf101c69f433bd5e87bd9337779e206c9b8a2f25eb99fb5aa: Status 404 returned error can't find the container with id 22545fe77b7ae34bf101c69f433bd5e87bd9337779e206c9b8a2f25eb99fb5aa
Jul 02 20:37:41.623633 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.623603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-c699r" event={"ID":"8e70322e-dff7-481f-ae76-632314a551cd","Type":"ContainerStarted","Data":"22545fe77b7ae34bf101c69f433bd5e87bd9337779e206c9b8a2f25eb99fb5aa"}
Jul 02 20:37:41.862526 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.862492    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:41.962821 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:41.962792    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:42.632183 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:42.632146    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-c699r" event={"ID":"8e70322e-dff7-481f-ae76-632314a551cd","Type":"ContainerStarted","Data":"41bd762323d7418ea26e6e5564df5135d592c34a872cb731d71216b6c6e2462a"}
Jul 02 20:37:42.632566 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:42.632197    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-c699r"
Jul 02 20:37:42.649938 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:42.649889    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-c699r" podStartSLOduration=1.649874292 podStartE2EDuration="1.649874292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:37:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:37:42.647481363 +0000 UTC m=+306.770492928" watchObservedRunningTime="2026-07-02 20:37:42.649874292 +0000 UTC m=+306.772885862"
Jul 02 20:37:43.015977 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:43.015866    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:44.446226 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:44.446194    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:44.546356 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:44.546284    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:48.639501 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:37:48.639474    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-c699r"
Jul 02 20:38:03.801292 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:03.801255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:03.898612 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:03.898577    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:05.435748 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:05.435698    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:06.301811 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.301774    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h"]
Jul 02 20:38:06.308326 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.308295    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h"
Jul 02 20:38:06.310280 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.310253    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h"]
Jul 02 20:38:06.310881 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.310863    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 02 20:38:06.310985 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.310923    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x6pn5\""
Jul 02 20:38:06.311998 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.311981    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 02 20:38:06.371088 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.371063    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsbk4\" (UniqueName: \"kubernetes.io/projected/dba34702-1005-449c-aa7e-f9e4ef137d0b-kube-api-access-jsbk4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h\" (UID: \"dba34702-1005-449c-aa7e-f9e4ef137d0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h"
Jul 02 20:38:06.371221 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.371096    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dba34702-1005-449c-aa7e-f9e4ef137d0b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h\" (UID: \"dba34702-1005-449c-aa7e-f9e4ef137d0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h"
Jul 02 20:38:06.371221 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.371208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dba34702-1005-449c-aa7e-f9e4ef137d0b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h\" (UID: \"dba34702-1005-449c-aa7e-f9e4ef137d0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h"
Jul 02 20:38:06.471867 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.471838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsbk4\" (UniqueName: \"kubernetes.io/projected/dba34702-1005-449c-aa7e-f9e4ef137d0b-kube-api-access-jsbk4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h\" (UID: \"dba34702-1005-449c-aa7e-f9e4ef137d0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h"
Jul 02 20:38:06.472338 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.471870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dba34702-1005-449c-aa7e-f9e4ef137d0b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h\" (UID: \"dba34702-1005-449c-aa7e-f9e4ef137d0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h"
Jul 02 20:38:06.472338 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.471943    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dba34702-1005-449c-aa7e-f9e4ef137d0b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h\" (UID: \"dba34702-1005-449c-aa7e-f9e4ef137d0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h"
Jul 02 20:38:06.472338 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.472290    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dba34702-1005-449c-aa7e-f9e4ef137d0b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h\" (UID: \"dba34702-1005-449c-aa7e-f9e4ef137d0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h"
Jul 02 20:38:06.472338 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.472309    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dba34702-1005-449c-aa7e-f9e4ef137d0b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h\" (UID: \"dba34702-1005-449c-aa7e-f9e4ef137d0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h"
Jul 02 20:38:06.480681 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.480656    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsbk4\" (UniqueName: \"kubernetes.io/projected/dba34702-1005-449c-aa7e-f9e4ef137d0b-kube-api-access-jsbk4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h\" (UID: \"dba34702-1005-449c-aa7e-f9e4ef137d0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h"
Jul 02 20:38:06.618697 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.618661    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h"
Jul 02 20:38:06.772089 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:06.772059    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h"]
Jul 02 20:38:06.775490 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:38:06.775456    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba34702_1005_449c_aa7e_f9e4ef137d0b.slice/crio-96a9ff2f160b72bf48f8a612b3879a318e29dafe364b53913ec3acd1e33afbf7 WatchSource:0}: Error finding container 96a9ff2f160b72bf48f8a612b3879a318e29dafe364b53913ec3acd1e33afbf7: Status 404 returned error can't find the container with id 96a9ff2f160b72bf48f8a612b3879a318e29dafe364b53913ec3acd1e33afbf7
Jul 02 20:38:07.742181 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:07.742101    2565 generic.go:356] "Generic (PLEG): container finished" podID="dba34702-1005-449c-aa7e-f9e4ef137d0b" containerID="f177e4d546fc6ecf3be33ff13e531b322e27fdfb3ae7ca16783cf258944bbc8f" exitCode=0
Jul 02 20:38:07.742181 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:07.742158    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h" event={"ID":"dba34702-1005-449c-aa7e-f9e4ef137d0b","Type":"ContainerDied","Data":"f177e4d546fc6ecf3be33ff13e531b322e27fdfb3ae7ca16783cf258944bbc8f"}
Jul 02 20:38:07.742554 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:07.742202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h" event={"ID":"dba34702-1005-449c-aa7e-f9e4ef137d0b","Type":"ContainerStarted","Data":"96a9ff2f160b72bf48f8a612b3879a318e29dafe364b53913ec3acd1e33afbf7"}
Jul 02 20:38:07.742662 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:07.742647    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:38:08.749634 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:08.749602    2565 generic.go:356] "Generic (PLEG): container finished" podID="dba34702-1005-449c-aa7e-f9e4ef137d0b" containerID="5a193f78060d2af9a3a7d7b336f2668136ffa233b11aeebd8275ef691df30dcb" exitCode=0
Jul 02 20:38:08.750038 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:08.749654    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h" event={"ID":"dba34702-1005-449c-aa7e-f9e4ef137d0b","Type":"ContainerDied","Data":"5a193f78060d2af9a3a7d7b336f2668136ffa233b11aeebd8275ef691df30dcb"}
Jul 02 20:38:09.756503 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:09.756467    2565 generic.go:356] "Generic (PLEG): container finished" podID="dba34702-1005-449c-aa7e-f9e4ef137d0b" containerID="148637a2df56be293f83a7e15329799a6894a87018531ca59eb01b2b816d9ed2" exitCode=0
Jul 02 20:38:09.756892 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:09.756556    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h" event={"ID":"dba34702-1005-449c-aa7e-f9e4ef137d0b","Type":"ContainerDied","Data":"148637a2df56be293f83a7e15329799a6894a87018531ca59eb01b2b816d9ed2"}
Jul 02 20:38:10.885393 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:10.885370    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h"
Jul 02 20:38:11.008281 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:11.008245    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dba34702-1005-449c-aa7e-f9e4ef137d0b-util\") pod \"dba34702-1005-449c-aa7e-f9e4ef137d0b\" (UID: \"dba34702-1005-449c-aa7e-f9e4ef137d0b\") "
Jul 02 20:38:11.008462 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:11.008298    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dba34702-1005-449c-aa7e-f9e4ef137d0b-bundle\") pod \"dba34702-1005-449c-aa7e-f9e4ef137d0b\" (UID: \"dba34702-1005-449c-aa7e-f9e4ef137d0b\") "
Jul 02 20:38:11.008462 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:11.008329    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsbk4\" (UniqueName: \"kubernetes.io/projected/dba34702-1005-449c-aa7e-f9e4ef137d0b-kube-api-access-jsbk4\") pod \"dba34702-1005-449c-aa7e-f9e4ef137d0b\" (UID: \"dba34702-1005-449c-aa7e-f9e4ef137d0b\") "
Jul 02 20:38:11.009021 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:11.008993    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dba34702-1005-449c-aa7e-f9e4ef137d0b-bundle" (OuterVolumeSpecName: "bundle") pod "dba34702-1005-449c-aa7e-f9e4ef137d0b" (UID: "dba34702-1005-449c-aa7e-f9e4ef137d0b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:38:11.010566 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:11.010538    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dba34702-1005-449c-aa7e-f9e4ef137d0b-kube-api-access-jsbk4" (OuterVolumeSpecName: "kube-api-access-jsbk4") pod "dba34702-1005-449c-aa7e-f9e4ef137d0b" (UID: "dba34702-1005-449c-aa7e-f9e4ef137d0b"). InnerVolumeSpecName "kube-api-access-jsbk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:38:11.013790 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:11.013736    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dba34702-1005-449c-aa7e-f9e4ef137d0b-util" (OuterVolumeSpecName: "util") pod "dba34702-1005-449c-aa7e-f9e4ef137d0b" (UID: "dba34702-1005-449c-aa7e-f9e4ef137d0b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:38:11.109603 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:11.109570    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dba34702-1005-449c-aa7e-f9e4ef137d0b-util\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:38:11.109603 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:11.109596    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dba34702-1005-449c-aa7e-f9e4ef137d0b-bundle\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:38:11.109603 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:11.109605    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsbk4\" (UniqueName: \"kubernetes.io/projected/dba34702-1005-449c-aa7e-f9e4ef137d0b-kube-api-access-jsbk4\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:38:11.767095 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:11.767066    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h"
Jul 02 20:38:11.767291 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:11.767093    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd78h" event={"ID":"dba34702-1005-449c-aa7e-f9e4ef137d0b","Type":"ContainerDied","Data":"96a9ff2f160b72bf48f8a612b3879a318e29dafe364b53913ec3acd1e33afbf7"}
Jul 02 20:38:11.767291 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:11.767136    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96a9ff2f160b72bf48f8a612b3879a318e29dafe364b53913ec3acd1e33afbf7"
Jul 02 20:38:17.469549 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.469513    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:17.564065 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.564032    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:17.822537 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.822462    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:17.899443 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.899411    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"]
Jul 02 20:38:17.899746 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.899734    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dba34702-1005-449c-aa7e-f9e4ef137d0b" containerName="extract"
Jul 02 20:38:17.899807 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.899748    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dba34702-1005-449c-aa7e-f9e4ef137d0b" containerName="extract"
Jul 02 20:38:17.899807 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.899769    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dba34702-1005-449c-aa7e-f9e4ef137d0b" containerName="pull"
Jul 02 20:38:17.899807 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.899775    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dba34702-1005-449c-aa7e-f9e4ef137d0b" containerName="pull"
Jul 02 20:38:17.899807 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.899792    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dba34702-1005-449c-aa7e-f9e4ef137d0b" containerName="util"
Jul 02 20:38:17.899807 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.899798    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dba34702-1005-449c-aa7e-f9e4ef137d0b" containerName="util"
Jul 02 20:38:17.899956 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.899848    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dba34702-1005-449c-aa7e-f9e4ef137d0b" containerName="extract"
Jul 02 20:38:17.904055 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.904040    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"
Jul 02 20:38:17.908581 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.908561    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 20:38:17.908979 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.908958    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 20:38:17.909098 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.908982    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 20:38:17.909098 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.908991    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 20:38:17.909769 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.909739    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:38:17.909903 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.909888    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-df8b5\""
Jul 02 20:38:17.914484 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.914460    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"]
Jul 02 20:38:17.931444 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:17.931412    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:18.070627 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.070594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/86898a14-16d6-43f1-a729-119782f64690-manager-config\") pod \"lws-controller-manager-6d6cb4dc5f-959ng\" (UID: \"86898a14-16d6-43f1-a729-119782f64690\") " pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"
Jul 02 20:38:18.070627 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.070630    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/86898a14-16d6-43f1-a729-119782f64690-metrics-cert\") pod \"lws-controller-manager-6d6cb4dc5f-959ng\" (UID: \"86898a14-16d6-43f1-a729-119782f64690\") " pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"
Jul 02 20:38:18.070894 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.070713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgghs\" (UniqueName: \"kubernetes.io/projected/86898a14-16d6-43f1-a729-119782f64690-kube-api-access-sgghs\") pod \"lws-controller-manager-6d6cb4dc5f-959ng\" (UID: \"86898a14-16d6-43f1-a729-119782f64690\") " pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"
Jul 02 20:38:18.070894 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.070737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86898a14-16d6-43f1-a729-119782f64690-cert\") pod \"lws-controller-manager-6d6cb4dc5f-959ng\" (UID: \"86898a14-16d6-43f1-a729-119782f64690\") " pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"
Jul 02 20:38:18.101130 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.101099    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:18.171432 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.171405    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgghs\" (UniqueName: \"kubernetes.io/projected/86898a14-16d6-43f1-a729-119782f64690-kube-api-access-sgghs\") pod \"lws-controller-manager-6d6cb4dc5f-959ng\" (UID: \"86898a14-16d6-43f1-a729-119782f64690\") " pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"
Jul 02 20:38:18.171552 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.171438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86898a14-16d6-43f1-a729-119782f64690-cert\") pod \"lws-controller-manager-6d6cb4dc5f-959ng\" (UID: \"86898a14-16d6-43f1-a729-119782f64690\") " pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"
Jul 02 20:38:18.171552 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.171490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/86898a14-16d6-43f1-a729-119782f64690-manager-config\") pod \"lws-controller-manager-6d6cb4dc5f-959ng\" (UID: \"86898a14-16d6-43f1-a729-119782f64690\") " pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"
Jul 02 20:38:18.171552 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.171505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/86898a14-16d6-43f1-a729-119782f64690-metrics-cert\") pod \"lws-controller-manager-6d6cb4dc5f-959ng\" (UID: \"86898a14-16d6-43f1-a729-119782f64690\") " pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"
Jul 02 20:38:18.172204 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.172180    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/86898a14-16d6-43f1-a729-119782f64690-manager-config\") pod \"lws-controller-manager-6d6cb4dc5f-959ng\" (UID: \"86898a14-16d6-43f1-a729-119782f64690\") " pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"
Jul 02 20:38:18.174112 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.174089    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86898a14-16d6-43f1-a729-119782f64690-cert\") pod \"lws-controller-manager-6d6cb4dc5f-959ng\" (UID: \"86898a14-16d6-43f1-a729-119782f64690\") " pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"
Jul 02 20:38:18.174191 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.174127    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/86898a14-16d6-43f1-a729-119782f64690-metrics-cert\") pod \"lws-controller-manager-6d6cb4dc5f-959ng\" (UID: \"86898a14-16d6-43f1-a729-119782f64690\") " pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"
Jul 02 20:38:18.182049 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.182028    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgghs\" (UniqueName: \"kubernetes.io/projected/86898a14-16d6-43f1-a729-119782f64690-kube-api-access-sgghs\") pod \"lws-controller-manager-6d6cb4dc5f-959ng\" (UID: \"86898a14-16d6-43f1-a729-119782f64690\") " pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"
Jul 02 20:38:18.214006 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.213981    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"
Jul 02 20:38:18.345741 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.345717    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"]
Jul 02 20:38:18.347903 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:38:18.347867    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86898a14_16d6_43f1_a729_119782f64690.slice/crio-0b14a5c100557a41317a8176c8ac395eb2af4e85bf4d95a3c4641ca42aaa328a WatchSource:0}: Error finding container 0b14a5c100557a41317a8176c8ac395eb2af4e85bf4d95a3c4641ca42aaa328a: Status 404 returned error can't find the container with id 0b14a5c100557a41317a8176c8ac395eb2af4e85bf4d95a3c4641ca42aaa328a
Jul 02 20:38:18.516571 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.516532    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:18.611844 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.611744    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:18.657771 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.657735    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"]
Jul 02 20:38:18.662021 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.662002    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.665631 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.665609    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 20:38:18.665747 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.665633    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cc4jb\""
Jul 02 20:38:18.665747 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.665660    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 20:38:18.666321 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.666306    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 20:38:18.666676 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.666660    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 20:38:18.690244 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.690214    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"]
Jul 02 20:38:18.776600 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.776565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/99198449-7006-4215-b8b6-1cb667ba2959-manifests\") pod \"opendatahub-operator-controller-manager-857d77d4-pdgzl\" (UID: \"99198449-7006-4215-b8b6-1cb667ba2959\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.776783 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.776616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99198449-7006-4215-b8b6-1cb667ba2959-tmp\") pod \"opendatahub-operator-controller-manager-857d77d4-pdgzl\" (UID: \"99198449-7006-4215-b8b6-1cb667ba2959\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.776783 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.776672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-888xw\" (UniqueName: \"kubernetes.io/projected/99198449-7006-4215-b8b6-1cb667ba2959-kube-api-access-888xw\") pod \"opendatahub-operator-controller-manager-857d77d4-pdgzl\" (UID: \"99198449-7006-4215-b8b6-1cb667ba2959\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.776783 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.776693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99198449-7006-4215-b8b6-1cb667ba2959-webhook-cert\") pod \"opendatahub-operator-controller-manager-857d77d4-pdgzl\" (UID: \"99198449-7006-4215-b8b6-1cb667ba2959\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.776783 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.776721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/99198449-7006-4215-b8b6-1cb667ba2959-apiservice-cert\") pod \"opendatahub-operator-controller-manager-857d77d4-pdgzl\" (UID: \"99198449-7006-4215-b8b6-1cb667ba2959\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.778328 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.778306    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:18.803083 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.803053    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng" event={"ID":"86898a14-16d6-43f1-a729-119782f64690","Type":"ContainerStarted","Data":"0b14a5c100557a41317a8176c8ac395eb2af4e85bf4d95a3c4641ca42aaa328a"}
Jul 02 20:38:18.877689 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.877618    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/99198449-7006-4215-b8b6-1cb667ba2959-manifests\") pod \"opendatahub-operator-controller-manager-857d77d4-pdgzl\" (UID: \"99198449-7006-4215-b8b6-1cb667ba2959\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.877689 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.877658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99198449-7006-4215-b8b6-1cb667ba2959-tmp\") pod \"opendatahub-operator-controller-manager-857d77d4-pdgzl\" (UID: \"99198449-7006-4215-b8b6-1cb667ba2959\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.877890 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.877811    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-888xw\" (UniqueName: \"kubernetes.io/projected/99198449-7006-4215-b8b6-1cb667ba2959-kube-api-access-888xw\") pod \"opendatahub-operator-controller-manager-857d77d4-pdgzl\" (UID: \"99198449-7006-4215-b8b6-1cb667ba2959\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.877890 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.877851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99198449-7006-4215-b8b6-1cb667ba2959-webhook-cert\") pod \"opendatahub-operator-controller-manager-857d77d4-pdgzl\" (UID: \"99198449-7006-4215-b8b6-1cb667ba2959\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.877890 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.877885    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/99198449-7006-4215-b8b6-1cb667ba2959-apiservice-cert\") pod \"opendatahub-operator-controller-manager-857d77d4-pdgzl\" (UID: \"99198449-7006-4215-b8b6-1cb667ba2959\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.878078 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.878052    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/99198449-7006-4215-b8b6-1cb667ba2959-manifests\") pod \"opendatahub-operator-controller-manager-857d77d4-pdgzl\" (UID: \"99198449-7006-4215-b8b6-1cb667ba2959\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.880050 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.880026    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99198449-7006-4215-b8b6-1cb667ba2959-tmp\") pod \"opendatahub-operator-controller-manager-857d77d4-pdgzl\" (UID: \"99198449-7006-4215-b8b6-1cb667ba2959\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.880136 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.880086    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99198449-7006-4215-b8b6-1cb667ba2959-webhook-cert\") pod \"opendatahub-operator-controller-manager-857d77d4-pdgzl\" (UID: \"99198449-7006-4215-b8b6-1cb667ba2959\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.880232 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.880211    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/99198449-7006-4215-b8b6-1cb667ba2959-apiservice-cert\") pod \"opendatahub-operator-controller-manager-857d77d4-pdgzl\" (UID: \"99198449-7006-4215-b8b6-1cb667ba2959\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.880812 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.880789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:18.886436 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.886411    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-888xw\" (UniqueName: \"kubernetes.io/projected/99198449-7006-4215-b8b6-1cb667ba2959-kube-api-access-888xw\") pod \"opendatahub-operator-controller-manager-857d77d4-pdgzl\" (UID: \"99198449-7006-4215-b8b6-1cb667ba2959\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.972464 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.972434    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:18.987659 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:18.987633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:19.088027 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:19.087997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:19.108572 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:19.108543    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"]
Jul 02 20:38:19.112082 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:38:19.112052    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99198449_7006_4215_b8b6_1cb667ba2959.slice/crio-f61d73c951fe4a9f4966b39b660d7a06ebacf1c80f0e79b740e279ec86a5842f WatchSource:0}: Error finding container f61d73c951fe4a9f4966b39b660d7a06ebacf1c80f0e79b740e279ec86a5842f: Status 404 returned error can't find the container with id f61d73c951fe4a9f4966b39b660d7a06ebacf1c80f0e79b740e279ec86a5842f
Jul 02 20:38:19.162985 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:19.162894    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:19.257578 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:19.257542    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:19.358708 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:19.358657    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:19.461785 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:19.461659    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:19.811120 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:19.810993    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl" event={"ID":"99198449-7006-4215-b8b6-1cb667ba2959","Type":"ContainerStarted","Data":"f61d73c951fe4a9f4966b39b660d7a06ebacf1c80f0e79b740e279ec86a5842f"}
Jul 02 20:38:22.826698 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:22.826665    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng" event={"ID":"86898a14-16d6-43f1-a729-119782f64690","Type":"ContainerStarted","Data":"f5d9544c9677eb06ab2cf4e2bbfa4beaa49aed6dd8041236ba5be32f7fb6f5b6"}
Jul 02 20:38:22.827162 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:22.826800    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"
Jul 02 20:38:22.828396 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:22.828360    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl" event={"ID":"99198449-7006-4215-b8b6-1cb667ba2959","Type":"ContainerStarted","Data":"14c13acf959159df8bea4515d27426adbc2244aa7bb6c95bd9d7c1f7265011f2"}
Jul 02 20:38:22.845768 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:22.845720    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng" podStartSLOduration=2.301859327 podStartE2EDuration="5.845705922s" totalImagesPullingTime="3.543846595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:22.844382826 +0000 UTC m=+346.967394398" watchObservedRunningTime="2026-07-02 20:38:22.845705922 +0000 UTC m=+346.968717493"
Jul 02 20:38:23.833766 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:23.833722    2565 generic.go:356] "Generic (PLEG): container finished" podID="99198449-7006-4215-b8b6-1cb667ba2959" containerID="14c13acf959159df8bea4515d27426adbc2244aa7bb6c95bd9d7c1f7265011f2" exitCode=0
Jul 02 20:38:23.834104 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:23.833808    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl" event={"ID":"99198449-7006-4215-b8b6-1cb667ba2959","Type":"ContainerDied","Data":"14c13acf959159df8bea4515d27426adbc2244aa7bb6c95bd9d7c1f7265011f2"}
Jul 02 20:38:24.840963 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:24.840928    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl" event={"ID":"99198449-7006-4215-b8b6-1cb667ba2959","Type":"ContainerStarted","Data":"6e6ee486c77ce61a014ea4af33d8d9df4319a133562289abb5ac465f02efa30c"}
Jul 02 20:38:24.841359 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:24.841083    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:24.865569 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:24.865522    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl" podStartSLOduration=2.690518393 podStartE2EDuration="6.865506405s" totalImagesPullingTime="3.146564571s" totalInitContainerRuntime="1.028423441s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:24.862742904 +0000 UTC m=+348.985754488" watchObservedRunningTime="2026-07-02 20:38:24.865506405 +0000 UTC m=+348.988517976"
Jul 02 20:38:33.835585 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:33.835555    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d6cb4dc5f-959ng"
Jul 02 20:38:35.847912 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:35.847883    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-pdgzl"
Jul 02 20:38:37.913079 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:37.913043    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:38.731547 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:38.731491    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk"]
Jul 02 20:38:38.736474 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:38.736452    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk"
Jul 02 20:38:38.739525 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:38.739495    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 20:38:38.739525 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:38.739512    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 20:38:38.739705 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:38.739509    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 20:38:38.744401 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:38.743844    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rk67d\""
Jul 02 20:38:38.744401 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:38.744002    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 20:38:38.751161 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:38.751137    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk"]
Jul 02 20:38:38.753096 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:38.753068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f31769c-99ca-426b-958d-587d879f68b7-tls-certs\") pod \"kube-auth-proxy-84bc744f59-5ffgk\" (UID: \"3f31769c-99ca-426b-958d-587d879f68b7\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk"
Jul 02 20:38:38.753207 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:38.753131    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f31769c-99ca-426b-958d-587d879f68b7-tmp\") pod \"kube-auth-proxy-84bc744f59-5ffgk\" (UID: \"3f31769c-99ca-426b-958d-587d879f68b7\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk"
Jul 02 20:38:38.753207 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:38.753162    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkfc9\" (UniqueName: \"kubernetes.io/projected/3f31769c-99ca-426b-958d-587d879f68b7-kube-api-access-rkfc9\") pod \"kube-auth-proxy-84bc744f59-5ffgk\" (UID: \"3f31769c-99ca-426b-958d-587d879f68b7\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk"
Jul 02 20:38:38.854153 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:38.854116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f31769c-99ca-426b-958d-587d879f68b7-tmp\") pod \"kube-auth-proxy-84bc744f59-5ffgk\" (UID: \"3f31769c-99ca-426b-958d-587d879f68b7\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk"
Jul 02 20:38:38.854365 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:38.854168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkfc9\" (UniqueName: \"kubernetes.io/projected/3f31769c-99ca-426b-958d-587d879f68b7-kube-api-access-rkfc9\") pod \"kube-auth-proxy-84bc744f59-5ffgk\" (UID: \"3f31769c-99ca-426b-958d-587d879f68b7\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk"
Jul 02 20:38:38.854365 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:38.854311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f31769c-99ca-426b-958d-587d879f68b7-tls-certs\") pod \"kube-auth-proxy-84bc744f59-5ffgk\" (UID: \"3f31769c-99ca-426b-958d-587d879f68b7\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk"
Jul 02 20:38:38.854478 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:38:38.854425    2565 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 02 20:38:38.854532 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:38:38.854513    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f31769c-99ca-426b-958d-587d879f68b7-tls-certs podName:3f31769c-99ca-426b-958d-587d879f68b7 nodeName:}" failed. No retries permitted until 2026-07-02 20:38:39.354479338 +0000 UTC m=+363.477490894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3f31769c-99ca-426b-958d-587d879f68b7-tls-certs") pod "kube-auth-proxy-84bc744f59-5ffgk" (UID: "3f31769c-99ca-426b-958d-587d879f68b7") : secret "kube-auth-proxy-tls" not found
Jul 02 20:38:38.856418 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:38.856388    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f31769c-99ca-426b-958d-587d879f68b7-tmp\") pod \"kube-auth-proxy-84bc744f59-5ffgk\" (UID: \"3f31769c-99ca-426b-958d-587d879f68b7\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk"
Jul 02 20:38:38.870815 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:38.870785    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkfc9\" (UniqueName: \"kubernetes.io/projected/3f31769c-99ca-426b-958d-587d879f68b7-kube-api-access-rkfc9\") pod \"kube-auth-proxy-84bc744f59-5ffgk\" (UID: \"3f31769c-99ca-426b-958d-587d879f68b7\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk"
Jul 02 20:38:39.288289 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:39.288256    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:39.358345 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:39.358306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f31769c-99ca-426b-958d-587d879f68b7-tls-certs\") pod \"kube-auth-proxy-84bc744f59-5ffgk\" (UID: \"3f31769c-99ca-426b-958d-587d879f68b7\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk"
Jul 02 20:38:39.361100 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:39.361071    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f31769c-99ca-426b-958d-587d879f68b7-tls-certs\") pod \"kube-auth-proxy-84bc744f59-5ffgk\" (UID: \"3f31769c-99ca-426b-958d-587d879f68b7\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk"
Jul 02 20:38:39.647014 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:39.646984    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk"
Jul 02 20:38:39.671672 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:39.671643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:39.801268 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:39.801245    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk"]
Jul 02 20:38:39.803317 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:38:39.803296    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f31769c_99ca_426b_958d_587d879f68b7.slice/crio-5981cb6f44520125254b73a4da069fd4a0038f7aef4a1432b7c5645b87d1b55d WatchSource:0}: Error finding container 5981cb6f44520125254b73a4da069fd4a0038f7aef4a1432b7c5645b87d1b55d: Status 404 returned error can't find the container with id 5981cb6f44520125254b73a4da069fd4a0038f7aef4a1432b7c5645b87d1b55d
Jul 02 20:38:39.909350 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:39.909240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk" event={"ID":"3f31769c-99ca-426b-958d-587d879f68b7","Type":"ContainerStarted","Data":"5981cb6f44520125254b73a4da069fd4a0038f7aef4a1432b7c5645b87d1b55d"}
Jul 02 20:38:40.312750 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:40.312669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:40.377675 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:40.377639    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:40.512491 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:40.512453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:41.351222 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:41.351184    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:42.924196 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:42.924159    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk" event={"ID":"3f31769c-99ca-426b-958d-587d879f68b7","Type":"ContainerStarted","Data":"0b42b1958608007f2e5430a57cc4abcfc85fe98a29ad3101d6990788f60560b2"}
Jul 02 20:38:42.942496 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:42.942447    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-84bc744f59-5ffgk" podStartSLOduration=2.206135878 podStartE2EDuration="4.942429969s" totalImagesPullingTime="2.736294091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:42.94197629 +0000 UTC m=+367.064987863" watchObservedRunningTime="2026-07-02 20:38:42.942429969 +0000 UTC m=+367.065441601"
Jul 02 20:38:46.587121 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:46.587082    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:46.698797 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:46.698765    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:47.124031 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:47.123989    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:47.357814 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:47.357775    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:48.036147 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:48.036082    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:49.267637 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:49.267606    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:49.408316 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:49.408288    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:49.500027 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:49.500002    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:49.655034 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:49.654999    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:49.799846 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:49.799814    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:50.108069 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:38:50.108040    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:39.324716 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:39.324680    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:39.412165 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:39.412136    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:39.529782 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:39.529722    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:52.887118 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:52.887080    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f9f59fbcb-k6ll8"]
Jul 02 20:39:52.890792 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:52.890741    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:52.903024 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:52.902966    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f9f59fbcb-k6ll8"]
Jul 02 20:39:52.941165 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:52.941132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:52.994286 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:52.994240    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:52.994451 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:52.994385    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/699c5a18-73b8-41fb-a41a-12835bfed798-console-config\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:52.994451 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:52.994435    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcfxz\" (UniqueName: \"kubernetes.io/projected/699c5a18-73b8-41fb-a41a-12835bfed798-kube-api-access-jcfxz\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:52.994521 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:52.994485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/699c5a18-73b8-41fb-a41a-12835bfed798-console-serving-cert\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:52.994521 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:52.994502    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/699c5a18-73b8-41fb-a41a-12835bfed798-service-ca\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:52.994626 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:52.994606    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/699c5a18-73b8-41fb-a41a-12835bfed798-trusted-ca-bundle\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:52.994662 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:52.994639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/699c5a18-73b8-41fb-a41a-12835bfed798-console-oauth-config\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:52.994694 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:52.994663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/699c5a18-73b8-41fb-a41a-12835bfed798-oauth-serving-cert\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:53.079026 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.078994    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:53.095076 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.095050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/699c5a18-73b8-41fb-a41a-12835bfed798-oauth-serving-cert\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:53.095184 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.095101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/699c5a18-73b8-41fb-a41a-12835bfed798-console-config\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:53.095184 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.095128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcfxz\" (UniqueName: \"kubernetes.io/projected/699c5a18-73b8-41fb-a41a-12835bfed798-kube-api-access-jcfxz\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:53.095184 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.095151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/699c5a18-73b8-41fb-a41a-12835bfed798-console-serving-cert\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:53.095184 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.095179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/699c5a18-73b8-41fb-a41a-12835bfed798-service-ca\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:53.095377 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.095230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/699c5a18-73b8-41fb-a41a-12835bfed798-trusted-ca-bundle\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:53.095377 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.095248    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/699c5a18-73b8-41fb-a41a-12835bfed798-console-oauth-config\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:53.095939 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.095901    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/699c5a18-73b8-41fb-a41a-12835bfed798-console-config\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:53.095939 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.095901    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/699c5a18-73b8-41fb-a41a-12835bfed798-oauth-serving-cert\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:53.096110 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.095979    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/699c5a18-73b8-41fb-a41a-12835bfed798-service-ca\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:53.096188 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.096164    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/699c5a18-73b8-41fb-a41a-12835bfed798-trusted-ca-bundle\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:53.097635 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.097615    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/699c5a18-73b8-41fb-a41a-12835bfed798-console-oauth-config\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:53.097740 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.097723    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/699c5a18-73b8-41fb-a41a-12835bfed798-console-serving-cert\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:53.104195 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.104175    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcfxz\" (UniqueName: \"kubernetes.io/projected/699c5a18-73b8-41fb-a41a-12835bfed798-kube-api-access-jcfxz\") pod \"console-7f9f59fbcb-k6ll8\" (UID: \"699c5a18-73b8-41fb-a41a-12835bfed798\") " pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:53.129958 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.129928    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:53.204381 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.204307    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:39:53.345748 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.345465    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f9f59fbcb-k6ll8"]
Jul 02 20:39:53.348527 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:39:53.348496    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod699c5a18_73b8_41fb_a41a_12835bfed798.slice/crio-ec0637a681d611bce82171d0199d976426aab42cc1f2f4ed6b11a3e289feb13e WatchSource:0}: Error finding container ec0637a681d611bce82171d0199d976426aab42cc1f2f4ed6b11a3e289feb13e: Status 404 returned error can't find the container with id ec0637a681d611bce82171d0199d976426aab42cc1f2f4ed6b11a3e289feb13e
Jul 02 20:39:53.672640 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.672607    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:53.727644 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:53.727611    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:54.262125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:54.262090    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9f59fbcb-k6ll8" event={"ID":"699c5a18-73b8-41fb-a41a-12835bfed798","Type":"ContainerStarted","Data":"0c0510b47e72da9cef6c822b092479849b2032f7fc700899cd566b2e2ceb73d3"}
Jul 02 20:39:54.262544 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:54.262146    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9f59fbcb-k6ll8" event={"ID":"699c5a18-73b8-41fb-a41a-12835bfed798","Type":"ContainerStarted","Data":"ec0637a681d611bce82171d0199d976426aab42cc1f2f4ed6b11a3e289feb13e"}
Jul 02 20:39:54.280389 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:54.280343    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f9f59fbcb-k6ll8" podStartSLOduration=2.280328137 podStartE2EDuration="2.280328137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:39:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:39:54.278918865 +0000 UTC m=+438.401930438" watchObservedRunningTime="2026-07-02 20:39:54.280328137 +0000 UTC m=+438.403339709"
Jul 02 20:39:54.834875 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:54.834843    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr"]
Jul 02 20:39:54.838510 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:54.838495    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr"
Jul 02 20:39:54.841003 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:54.840975    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fzlr4\""
Jul 02 20:39:54.841101 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:54.841055    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 20:39:54.842107 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:54.842091    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 20:39:54.846624 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:54.846598    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr"]
Jul 02 20:39:54.910109 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:54.910076    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68cc7d19-a799-4719-bdb3-b6a3881bea59-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr\" (UID: \"68cc7d19-a799-4719-bdb3-b6a3881bea59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr"
Jul 02 20:39:54.910247 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:54.910139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg9vc\" (UniqueName: \"kubernetes.io/projected/68cc7d19-a799-4719-bdb3-b6a3881bea59-kube-api-access-wg9vc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr\" (UID: \"68cc7d19-a799-4719-bdb3-b6a3881bea59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr"
Jul 02 20:39:54.910247 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:54.910186    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68cc7d19-a799-4719-bdb3-b6a3881bea59-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr\" (UID: \"68cc7d19-a799-4719-bdb3-b6a3881bea59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr"
Jul 02 20:39:55.011152 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.011120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg9vc\" (UniqueName: \"kubernetes.io/projected/68cc7d19-a799-4719-bdb3-b6a3881bea59-kube-api-access-wg9vc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr\" (UID: \"68cc7d19-a799-4719-bdb3-b6a3881bea59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr"
Jul 02 20:39:55.011326 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.011178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68cc7d19-a799-4719-bdb3-b6a3881bea59-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr\" (UID: \"68cc7d19-a799-4719-bdb3-b6a3881bea59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr"
Jul 02 20:39:55.011326 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.011204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68cc7d19-a799-4719-bdb3-b6a3881bea59-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr\" (UID: \"68cc7d19-a799-4719-bdb3-b6a3881bea59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr"
Jul 02 20:39:55.011567 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.011547    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68cc7d19-a799-4719-bdb3-b6a3881bea59-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr\" (UID: \"68cc7d19-a799-4719-bdb3-b6a3881bea59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr"
Jul 02 20:39:55.011644 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.011592    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68cc7d19-a799-4719-bdb3-b6a3881bea59-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr\" (UID: \"68cc7d19-a799-4719-bdb3-b6a3881bea59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr"
Jul 02 20:39:55.019692 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.019665    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg9vc\" (UniqueName: \"kubernetes.io/projected/68cc7d19-a799-4719-bdb3-b6a3881bea59-kube-api-access-wg9vc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr\" (UID: \"68cc7d19-a799-4719-bdb3-b6a3881bea59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr"
Jul 02 20:39:55.148889 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.148864    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr"
Jul 02 20:39:55.277891 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.277864    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr"]
Jul 02 20:39:55.279496 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:39:55.279471    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68cc7d19_a799_4719_bdb3_b6a3881bea59.slice/crio-e8019134d0e064909e83ac38e1b2601aad863b275c3225dd9f7d8d6706c80db0 WatchSource:0}: Error finding container e8019134d0e064909e83ac38e1b2601aad863b275c3225dd9f7d8d6706c80db0: Status 404 returned error can't find the container with id e8019134d0e064909e83ac38e1b2601aad863b275c3225dd9f7d8d6706c80db0
Jul 02 20:39:55.636817 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.636782    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6"]
Jul 02 20:39:55.640268 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.640252    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6"
Jul 02 20:39:55.653648 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.653622    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6"]
Jul 02 20:39:55.715913 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.715882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6\" (UID: \"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6"
Jul 02 20:39:55.716058 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.715949    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shlj4\" (UniqueName: \"kubernetes.io/projected/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-kube-api-access-shlj4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6\" (UID: \"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6"
Jul 02 20:39:55.716058 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.716003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6\" (UID: \"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6"
Jul 02 20:39:55.817450 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.817413    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6\" (UID: \"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6"
Jul 02 20:39:55.817600 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.817473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shlj4\" (UniqueName: \"kubernetes.io/projected/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-kube-api-access-shlj4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6\" (UID: \"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6"
Jul 02 20:39:55.817600 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.817515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6\" (UID: \"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6"
Jul 02 20:39:55.817850 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.817830    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6\" (UID: \"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6"
Jul 02 20:39:55.817890 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.817853    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6\" (UID: \"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6"
Jul 02 20:39:55.825741 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.825721    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shlj4\" (UniqueName: \"kubernetes.io/projected/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-kube-api-access-shlj4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6\" (UID: \"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6"
Jul 02 20:39:55.949213 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:55.949127    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6"
Jul 02 20:39:56.082144 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.082110    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6"]
Jul 02 20:39:56.082962 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:39:56.082942    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f13b5f4_f92a_48a6_946b_c8ed8442a6ff.slice/crio-41f83258f055aec85f1e72b4ce6c14d052ce3a05e4cfe3aa14a8a26ddb954e9a WatchSource:0}: Error finding container 41f83258f055aec85f1e72b4ce6c14d052ce3a05e4cfe3aa14a8a26ddb954e9a: Status 404 returned error can't find the container with id 41f83258f055aec85f1e72b4ce6c14d052ce3a05e4cfe3aa14a8a26ddb954e9a
Jul 02 20:39:56.237459 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.237427    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw"]
Jul 02 20:39:56.240790 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.240744    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw"
Jul 02 20:39:56.249094 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.249064    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw"]
Jul 02 20:39:56.274569 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.274546    2565 generic.go:356] "Generic (PLEG): container finished" podID="68cc7d19-a799-4719-bdb3-b6a3881bea59" containerID="973258369c340cb00a80345eb489ace361a83292066989e2f456e30dea44e236" exitCode=0
Jul 02 20:39:56.274703 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.274627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr" event={"ID":"68cc7d19-a799-4719-bdb3-b6a3881bea59","Type":"ContainerDied","Data":"973258369c340cb00a80345eb489ace361a83292066989e2f456e30dea44e236"}
Jul 02 20:39:56.274703 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.274674    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr" event={"ID":"68cc7d19-a799-4719-bdb3-b6a3881bea59","Type":"ContainerStarted","Data":"e8019134d0e064909e83ac38e1b2601aad863b275c3225dd9f7d8d6706c80db0"}
Jul 02 20:39:56.276250 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.276228    2565 generic.go:356] "Generic (PLEG): container finished" podID="9f13b5f4-f92a-48a6-946b-c8ed8442a6ff" containerID="79818e0018690961fd4b0e64e31c1ea202b1df5a8f15da3a7bdcbfea19b9b62a" exitCode=0
Jul 02 20:39:56.276330 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.276300    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6" event={"ID":"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff","Type":"ContainerDied","Data":"79818e0018690961fd4b0e64e31c1ea202b1df5a8f15da3a7bdcbfea19b9b62a"}
Jul 02 20:39:56.276369 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.276334    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6" event={"ID":"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff","Type":"ContainerStarted","Data":"41f83258f055aec85f1e72b4ce6c14d052ce3a05e4cfe3aa14a8a26ddb954e9a"}
Jul 02 20:39:56.321340 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.321311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66ebd2f2-878f-4598-bb36-bebfb6094889-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw\" (UID: \"66ebd2f2-878f-4598-bb36-bebfb6094889\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw"
Jul 02 20:39:56.321688 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.321379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66ebd2f2-878f-4598-bb36-bebfb6094889-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw\" (UID: \"66ebd2f2-878f-4598-bb36-bebfb6094889\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw"
Jul 02 20:39:56.321688 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.321465    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx9cl\" (UniqueName: \"kubernetes.io/projected/66ebd2f2-878f-4598-bb36-bebfb6094889-kube-api-access-qx9cl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw\" (UID: \"66ebd2f2-878f-4598-bb36-bebfb6094889\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw"
Jul 02 20:39:56.422576 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.422540    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66ebd2f2-878f-4598-bb36-bebfb6094889-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw\" (UID: \"66ebd2f2-878f-4598-bb36-bebfb6094889\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw"
Jul 02 20:39:56.422748 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.422600    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx9cl\" (UniqueName: \"kubernetes.io/projected/66ebd2f2-878f-4598-bb36-bebfb6094889-kube-api-access-qx9cl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw\" (UID: \"66ebd2f2-878f-4598-bb36-bebfb6094889\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw"
Jul 02 20:39:56.422748 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.422636    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66ebd2f2-878f-4598-bb36-bebfb6094889-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw\" (UID: \"66ebd2f2-878f-4598-bb36-bebfb6094889\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw"
Jul 02 20:39:56.422997 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.422979    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66ebd2f2-878f-4598-bb36-bebfb6094889-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw\" (UID: \"66ebd2f2-878f-4598-bb36-bebfb6094889\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw"
Jul 02 20:39:56.423037 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.423021    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66ebd2f2-878f-4598-bb36-bebfb6094889-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw\" (UID: \"66ebd2f2-878f-4598-bb36-bebfb6094889\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw"
Jul 02 20:39:56.430927 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.430907    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx9cl\" (UniqueName: \"kubernetes.io/projected/66ebd2f2-878f-4598-bb36-bebfb6094889-kube-api-access-qx9cl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw\" (UID: \"66ebd2f2-878f-4598-bb36-bebfb6094889\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw"
Jul 02 20:39:56.558184 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.558105    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw"
Jul 02 20:39:56.639873 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.639725    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j"]
Jul 02 20:39:56.643879 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.643858    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j"
Jul 02 20:39:56.651493 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.651459    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j"]
Jul 02 20:39:56.696293 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.696271    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw"]
Jul 02 20:39:56.724728 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.724690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp47n\" (UniqueName: \"kubernetes.io/projected/cf33c63b-e711-422f-8c25-08ff8ca002d2-kube-api-access-wp47n\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j\" (UID: \"cf33c63b-e711-422f-8c25-08ff8ca002d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j"
Jul 02 20:39:56.724897 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.724819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf33c63b-e711-422f-8c25-08ff8ca002d2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j\" (UID: \"cf33c63b-e711-422f-8c25-08ff8ca002d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j"
Jul 02 20:39:56.724897 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.724861    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf33c63b-e711-422f-8c25-08ff8ca002d2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j\" (UID: \"cf33c63b-e711-422f-8c25-08ff8ca002d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j"
Jul 02 20:39:56.726336 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:39:56.726312    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ebd2f2_878f_4598_bb36_bebfb6094889.slice/crio-bbf1a26ef1d93897ca61b970e43a935caad8e3bafb434ef92ae0f5be28512222 WatchSource:0}: Error finding container bbf1a26ef1d93897ca61b970e43a935caad8e3bafb434ef92ae0f5be28512222: Status 404 returned error can't find the container with id bbf1a26ef1d93897ca61b970e43a935caad8e3bafb434ef92ae0f5be28512222
Jul 02 20:39:56.825766 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.825721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp47n\" (UniqueName: \"kubernetes.io/projected/cf33c63b-e711-422f-8c25-08ff8ca002d2-kube-api-access-wp47n\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j\" (UID: \"cf33c63b-e711-422f-8c25-08ff8ca002d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j"
Jul 02 20:39:56.825912 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.825799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf33c63b-e711-422f-8c25-08ff8ca002d2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j\" (UID: \"cf33c63b-e711-422f-8c25-08ff8ca002d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j"
Jul 02 20:39:56.825912 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.825842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf33c63b-e711-422f-8c25-08ff8ca002d2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j\" (UID: \"cf33c63b-e711-422f-8c25-08ff8ca002d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j"
Jul 02 20:39:56.826151 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.826129    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf33c63b-e711-422f-8c25-08ff8ca002d2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j\" (UID: \"cf33c63b-e711-422f-8c25-08ff8ca002d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j"
Jul 02 20:39:56.826217 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.826165    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf33c63b-e711-422f-8c25-08ff8ca002d2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j\" (UID: \"cf33c63b-e711-422f-8c25-08ff8ca002d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j"
Jul 02 20:39:56.834443 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.834416    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp47n\" (UniqueName: \"kubernetes.io/projected/cf33c63b-e711-422f-8c25-08ff8ca002d2-kube-api-access-wp47n\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j\" (UID: \"cf33c63b-e711-422f-8c25-08ff8ca002d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j"
Jul 02 20:39:56.960587 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:56.960562    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j"
Jul 02 20:39:57.127555 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:57.127524    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j"]
Jul 02 20:39:57.152706 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:39:57.152676    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf33c63b_e711_422f_8c25_08ff8ca002d2.slice/crio-20dc53210b631cc9774f8a719c30a521e287a1536622759abbf30c8c6440e36e WatchSource:0}: Error finding container 20dc53210b631cc9774f8a719c30a521e287a1536622759abbf30c8c6440e36e: Status 404 returned error can't find the container with id 20dc53210b631cc9774f8a719c30a521e287a1536622759abbf30c8c6440e36e
Jul 02 20:39:57.282980 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:57.282945    2565 generic.go:356] "Generic (PLEG): container finished" podID="66ebd2f2-878f-4598-bb36-bebfb6094889" containerID="80cd86eb7bd65720743ecf27670c95251b7f6b82ba037bd0d95b58f22a0406c1" exitCode=0
Jul 02 20:39:57.283122 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:57.283021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw" event={"ID":"66ebd2f2-878f-4598-bb36-bebfb6094889","Type":"ContainerDied","Data":"80cd86eb7bd65720743ecf27670c95251b7f6b82ba037bd0d95b58f22a0406c1"}
Jul 02 20:39:57.283122 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:57.283075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw" event={"ID":"66ebd2f2-878f-4598-bb36-bebfb6094889","Type":"ContainerStarted","Data":"bbf1a26ef1d93897ca61b970e43a935caad8e3bafb434ef92ae0f5be28512222"}
Jul 02 20:39:57.284910 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:57.284876    2565 generic.go:356] "Generic (PLEG): container finished" podID="68cc7d19-a799-4719-bdb3-b6a3881bea59" containerID="557c617694dd9052e16d94ba1886a7245c9b61394fab313c20ee3f133f897814" exitCode=0
Jul 02 20:39:57.285007 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:57.284929    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr" event={"ID":"68cc7d19-a799-4719-bdb3-b6a3881bea59","Type":"ContainerDied","Data":"557c617694dd9052e16d94ba1886a7245c9b61394fab313c20ee3f133f897814"}
Jul 02 20:39:57.286960 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:57.286929    2565 generic.go:356] "Generic (PLEG): container finished" podID="9f13b5f4-f92a-48a6-946b-c8ed8442a6ff" containerID="ad450986cc1b2e6c1d8a1952f098a1560bc8e1062cc76c39a2fd8b12e0282e1e" exitCode=0
Jul 02 20:39:57.287079 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:57.286960    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6" event={"ID":"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff","Type":"ContainerDied","Data":"ad450986cc1b2e6c1d8a1952f098a1560bc8e1062cc76c39a2fd8b12e0282e1e"}
Jul 02 20:39:57.288559 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:57.288539    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf33c63b-e711-422f-8c25-08ff8ca002d2" containerID="98b0d59c18653d2ac25f232711fb9ddaa9dd18bb4ffae8218f8c7d1ee28d385a" exitCode=0
Jul 02 20:39:57.288636 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:57.288596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j" event={"ID":"cf33c63b-e711-422f-8c25-08ff8ca002d2","Type":"ContainerDied","Data":"98b0d59c18653d2ac25f232711fb9ddaa9dd18bb4ffae8218f8c7d1ee28d385a"}
Jul 02 20:39:57.288688 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:57.288639    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j" event={"ID":"cf33c63b-e711-422f-8c25-08ff8ca002d2","Type":"ContainerStarted","Data":"20dc53210b631cc9774f8a719c30a521e287a1536622759abbf30c8c6440e36e"}
Jul 02 20:39:58.295841 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:58.295742    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf33c63b-e711-422f-8c25-08ff8ca002d2" containerID="dfa9ace1e591e3206c41a49a86953925da1ac267bfd5dae8761e0526fa495e7d" exitCode=0
Jul 02 20:39:58.297950 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:58.297921    2565 generic.go:356] "Generic (PLEG): container finished" podID="66ebd2f2-878f-4598-bb36-bebfb6094889" containerID="7ef890edb3814c74802aeeda992179cfa9e91ca2be153aeb36f521a0e75fb143" exitCode=0
Jul 02 20:39:58.299724 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:58.299694    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j" event={"ID":"cf33c63b-e711-422f-8c25-08ff8ca002d2","Type":"ContainerDied","Data":"dfa9ace1e591e3206c41a49a86953925da1ac267bfd5dae8761e0526fa495e7d"}
Jul 02 20:39:58.299847 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:58.299805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw" event={"ID":"66ebd2f2-878f-4598-bb36-bebfb6094889","Type":"ContainerDied","Data":"7ef890edb3814c74802aeeda992179cfa9e91ca2be153aeb36f521a0e75fb143"}
Jul 02 20:39:58.300362 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:58.300342    2565 generic.go:356] "Generic (PLEG): container finished" podID="68cc7d19-a799-4719-bdb3-b6a3881bea59" containerID="190d179d35bb5a923cb0c426c819517156c9b56d937319bf1318c09e3a757993" exitCode=0
Jul 02 20:39:58.300453 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:58.300429    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr" event={"ID":"68cc7d19-a799-4719-bdb3-b6a3881bea59","Type":"ContainerDied","Data":"190d179d35bb5a923cb0c426c819517156c9b56d937319bf1318c09e3a757993"}
Jul 02 20:39:58.302562 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:58.302539    2565 generic.go:356] "Generic (PLEG): container finished" podID="9f13b5f4-f92a-48a6-946b-c8ed8442a6ff" containerID="501584433c1f4c28c5e63b094b3c3c9f77172efcaea1359b466b2f084e7d2d79" exitCode=0
Jul 02 20:39:58.302664 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:58.302606    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6" event={"ID":"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff","Type":"ContainerDied","Data":"501584433c1f4c28c5e63b094b3c3c9f77172efcaea1359b466b2f084e7d2d79"}
Jul 02 20:39:59.309453 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.309418    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf33c63b-e711-422f-8c25-08ff8ca002d2" containerID="b16debe47353e340feff85ca4c64672782b6cd211e85d9c1b0893398e16fc4f8" exitCode=0
Jul 02 20:39:59.309933 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.309500    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j" event={"ID":"cf33c63b-e711-422f-8c25-08ff8ca002d2","Type":"ContainerDied","Data":"b16debe47353e340feff85ca4c64672782b6cd211e85d9c1b0893398e16fc4f8"}
Jul 02 20:39:59.311466 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.311439    2565 generic.go:356] "Generic (PLEG): container finished" podID="66ebd2f2-878f-4598-bb36-bebfb6094889" containerID="b1553e2203c822852031b4e57823a71f617cff3ad28368b42d21c25740167e30" exitCode=0
Jul 02 20:39:59.311633 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.311465    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw" event={"ID":"66ebd2f2-878f-4598-bb36-bebfb6094889","Type":"ContainerDied","Data":"b1553e2203c822852031b4e57823a71f617cff3ad28368b42d21c25740167e30"}
Jul 02 20:39:59.440221 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.440199    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr"
Jul 02 20:39:59.471039 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.471020    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6"
Jul 02 20:39:59.554393 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.554363    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-util\") pod \"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff\" (UID: \"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff\") "
Jul 02 20:39:59.554567 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.554418    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68cc7d19-a799-4719-bdb3-b6a3881bea59-util\") pod \"68cc7d19-a799-4719-bdb3-b6a3881bea59\" (UID: \"68cc7d19-a799-4719-bdb3-b6a3881bea59\") "
Jul 02 20:39:59.554567 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.554465    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shlj4\" (UniqueName: \"kubernetes.io/projected/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-kube-api-access-shlj4\") pod \"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff\" (UID: \"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff\") "
Jul 02 20:39:59.554567 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.554490    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-bundle\") pod \"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff\" (UID: \"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff\") "
Jul 02 20:39:59.554567 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.554551    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68cc7d19-a799-4719-bdb3-b6a3881bea59-bundle\") pod \"68cc7d19-a799-4719-bdb3-b6a3881bea59\" (UID: \"68cc7d19-a799-4719-bdb3-b6a3881bea59\") "
Jul 02 20:39:59.554819 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.554583    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wg9vc\" (UniqueName: \"kubernetes.io/projected/68cc7d19-a799-4719-bdb3-b6a3881bea59-kube-api-access-wg9vc\") pod \"68cc7d19-a799-4719-bdb3-b6a3881bea59\" (UID: \"68cc7d19-a799-4719-bdb3-b6a3881bea59\") "
Jul 02 20:39:59.555153 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.555121    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68cc7d19-a799-4719-bdb3-b6a3881bea59-bundle" (OuterVolumeSpecName: "bundle") pod "68cc7d19-a799-4719-bdb3-b6a3881bea59" (UID: "68cc7d19-a799-4719-bdb3-b6a3881bea59"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:39:59.555291 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.555158    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-bundle" (OuterVolumeSpecName: "bundle") pod "9f13b5f4-f92a-48a6-946b-c8ed8442a6ff" (UID: "9f13b5f4-f92a-48a6-946b-c8ed8442a6ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:39:59.556742 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.556721    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-kube-api-access-shlj4" (OuterVolumeSpecName: "kube-api-access-shlj4") pod "9f13b5f4-f92a-48a6-946b-c8ed8442a6ff" (UID: "9f13b5f4-f92a-48a6-946b-c8ed8442a6ff"). InnerVolumeSpecName "kube-api-access-shlj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:39:59.557043 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.557012    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68cc7d19-a799-4719-bdb3-b6a3881bea59-kube-api-access-wg9vc" (OuterVolumeSpecName: "kube-api-access-wg9vc") pod "68cc7d19-a799-4719-bdb3-b6a3881bea59" (UID: "68cc7d19-a799-4719-bdb3-b6a3881bea59"). InnerVolumeSpecName "kube-api-access-wg9vc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:39:59.560190 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.560135    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-util" (OuterVolumeSpecName: "util") pod "9f13b5f4-f92a-48a6-946b-c8ed8442a6ff" (UID: "9f13b5f4-f92a-48a6-946b-c8ed8442a6ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:39:59.562371 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.562350    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68cc7d19-a799-4719-bdb3-b6a3881bea59-util" (OuterVolumeSpecName: "util") pod "68cc7d19-a799-4719-bdb3-b6a3881bea59" (UID: "68cc7d19-a799-4719-bdb3-b6a3881bea59"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:39:59.655701 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.655660    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shlj4\" (UniqueName: \"kubernetes.io/projected/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-kube-api-access-shlj4\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:39:59.655701 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.655699    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-bundle\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:39:59.655701 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.655708    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68cc7d19-a799-4719-bdb3-b6a3881bea59-bundle\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:39:59.655920 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.655728    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg9vc\" (UniqueName: \"kubernetes.io/projected/68cc7d19-a799-4719-bdb3-b6a3881bea59-kube-api-access-wg9vc\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:39:59.655920 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.655737    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f13b5f4-f92a-48a6-946b-c8ed8442a6ff-util\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:39:59.655920 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:39:59.655746    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68cc7d19-a799-4719-bdb3-b6a3881bea59-util\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:40:00.318116 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.318090    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6"
Jul 02 20:40:00.318116 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.318105    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6" event={"ID":"9f13b5f4-f92a-48a6-946b-c8ed8442a6ff","Type":"ContainerDied","Data":"41f83258f055aec85f1e72b4ce6c14d052ce3a05e4cfe3aa14a8a26ddb954e9a"}
Jul 02 20:40:00.318517 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.318147    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41f83258f055aec85f1e72b4ce6c14d052ce3a05e4cfe3aa14a8a26ddb954e9a"
Jul 02 20:40:00.320306 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.320283    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr" event={"ID":"68cc7d19-a799-4719-bdb3-b6a3881bea59","Type":"ContainerDied","Data":"e8019134d0e064909e83ac38e1b2601aad863b275c3225dd9f7d8d6706c80db0"}
Jul 02 20:40:00.320442 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.320322    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8019134d0e064909e83ac38e1b2601aad863b275c3225dd9f7d8d6706c80db0"
Jul 02 20:40:00.320940 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.320489    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr"
Jul 02 20:40:00.476796 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.476734    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j"
Jul 02 20:40:00.478952 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.478928    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw"
Jul 02 20:40:00.564122 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.564041    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf33c63b-e711-422f-8c25-08ff8ca002d2-bundle\") pod \"cf33c63b-e711-422f-8c25-08ff8ca002d2\" (UID: \"cf33c63b-e711-422f-8c25-08ff8ca002d2\") "
Jul 02 20:40:00.564122 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.564108    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf33c63b-e711-422f-8c25-08ff8ca002d2-util\") pod \"cf33c63b-e711-422f-8c25-08ff8ca002d2\" (UID: \"cf33c63b-e711-422f-8c25-08ff8ca002d2\") "
Jul 02 20:40:00.564350 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.564125    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66ebd2f2-878f-4598-bb36-bebfb6094889-util\") pod \"66ebd2f2-878f-4598-bb36-bebfb6094889\" (UID: \"66ebd2f2-878f-4598-bb36-bebfb6094889\") "
Jul 02 20:40:00.564350 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.564149    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qx9cl\" (UniqueName: \"kubernetes.io/projected/66ebd2f2-878f-4598-bb36-bebfb6094889-kube-api-access-qx9cl\") pod \"66ebd2f2-878f-4598-bb36-bebfb6094889\" (UID: \"66ebd2f2-878f-4598-bb36-bebfb6094889\") "
Jul 02 20:40:00.564350 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.564207    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66ebd2f2-878f-4598-bb36-bebfb6094889-bundle\") pod \"66ebd2f2-878f-4598-bb36-bebfb6094889\" (UID: \"66ebd2f2-878f-4598-bb36-bebfb6094889\") "
Jul 02 20:40:00.564350 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.564236    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp47n\" (UniqueName: \"kubernetes.io/projected/cf33c63b-e711-422f-8c25-08ff8ca002d2-kube-api-access-wp47n\") pod \"cf33c63b-e711-422f-8c25-08ff8ca002d2\" (UID: \"cf33c63b-e711-422f-8c25-08ff8ca002d2\") "
Jul 02 20:40:00.564617 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.564588    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf33c63b-e711-422f-8c25-08ff8ca002d2-bundle" (OuterVolumeSpecName: "bundle") pod "cf33c63b-e711-422f-8c25-08ff8ca002d2" (UID: "cf33c63b-e711-422f-8c25-08ff8ca002d2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:40:00.564731 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.564714    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66ebd2f2-878f-4598-bb36-bebfb6094889-bundle" (OuterVolumeSpecName: "bundle") pod "66ebd2f2-878f-4598-bb36-bebfb6094889" (UID: "66ebd2f2-878f-4598-bb36-bebfb6094889"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:40:00.566246 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.566223    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66ebd2f2-878f-4598-bb36-bebfb6094889-kube-api-access-qx9cl" (OuterVolumeSpecName: "kube-api-access-qx9cl") pod "66ebd2f2-878f-4598-bb36-bebfb6094889" (UID: "66ebd2f2-878f-4598-bb36-bebfb6094889"). InnerVolumeSpecName "kube-api-access-qx9cl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:40:00.566677 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.566653    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf33c63b-e711-422f-8c25-08ff8ca002d2-kube-api-access-wp47n" (OuterVolumeSpecName: "kube-api-access-wp47n") pod "cf33c63b-e711-422f-8c25-08ff8ca002d2" (UID: "cf33c63b-e711-422f-8c25-08ff8ca002d2"). InnerVolumeSpecName "kube-api-access-wp47n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:40:00.569933 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.569897    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66ebd2f2-878f-4598-bb36-bebfb6094889-util" (OuterVolumeSpecName: "util") pod "66ebd2f2-878f-4598-bb36-bebfb6094889" (UID: "66ebd2f2-878f-4598-bb36-bebfb6094889"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:40:00.570526 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.570505    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf33c63b-e711-422f-8c25-08ff8ca002d2-util" (OuterVolumeSpecName: "util") pod "cf33c63b-e711-422f-8c25-08ff8ca002d2" (UID: "cf33c63b-e711-422f-8c25-08ff8ca002d2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:40:00.665345 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.665304    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66ebd2f2-878f-4598-bb36-bebfb6094889-bundle\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:40:00.665345 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.665342    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp47n\" (UniqueName: \"kubernetes.io/projected/cf33c63b-e711-422f-8c25-08ff8ca002d2-kube-api-access-wp47n\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:40:00.665345 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.665354    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf33c63b-e711-422f-8c25-08ff8ca002d2-bundle\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:40:00.665345 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.665362    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf33c63b-e711-422f-8c25-08ff8ca002d2-util\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:40:00.665580 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.665370    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66ebd2f2-878f-4598-bb36-bebfb6094889-util\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:40:00.665580 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:00.665378    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qx9cl\" (UniqueName: \"kubernetes.io/projected/66ebd2f2-878f-4598-bb36-bebfb6094889-kube-api-access-qx9cl\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:40:01.328665 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:01.328635    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw"
Jul 02 20:40:01.329101 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:01.328670    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw" event={"ID":"66ebd2f2-878f-4598-bb36-bebfb6094889","Type":"ContainerDied","Data":"bbf1a26ef1d93897ca61b970e43a935caad8e3bafb434ef92ae0f5be28512222"}
Jul 02 20:40:01.329101 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:01.328715    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbf1a26ef1d93897ca61b970e43a935caad8e3bafb434ef92ae0f5be28512222"
Jul 02 20:40:01.330277 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:01.330256    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j" event={"ID":"cf33c63b-e711-422f-8c25-08ff8ca002d2","Type":"ContainerDied","Data":"20dc53210b631cc9774f8a719c30a521e287a1536622759abbf30c8c6440e36e"}
Jul 02 20:40:01.330389 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:01.330288    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20dc53210b631cc9774f8a719c30a521e287a1536622759abbf30c8c6440e36e"
Jul 02 20:40:01.330389 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:01.330311    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j"
Jul 02 20:40:03.153370 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:03.153338    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:03.205165 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:03.205133    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:40:03.205333 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:03.205285    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:40:03.210780 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:03.210741    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:40:03.343238 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:03.343210    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f9f59fbcb-k6ll8"
Jul 02 20:40:03.389902 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:03.389868    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-767cd9c89-svs9t"]
Jul 02 20:40:03.505210 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:03.505132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:03.604353 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:03.604318    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:03.779984 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:03.779903    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:06.347612 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:06.347573    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:06.634587 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:06.634467    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:11.558042 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:11.558011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:12.396376 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:12.396340    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:14.150389 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:14.150359    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:14.749453 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:14.749421    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:17.218861 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:17.218814    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:19.962597 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962564    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4"]
Jul 02 20:40:19.962974 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962891    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66ebd2f2-878f-4598-bb36-bebfb6094889" containerName="extract"
Jul 02 20:40:19.962974 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962902    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="66ebd2f2-878f-4598-bb36-bebfb6094889" containerName="extract"
Jul 02 20:40:19.962974 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962916    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68cc7d19-a799-4719-bdb3-b6a3881bea59" containerName="extract"
Jul 02 20:40:19.962974 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962921    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="68cc7d19-a799-4719-bdb3-b6a3881bea59" containerName="extract"
Jul 02 20:40:19.962974 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962930    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68cc7d19-a799-4719-bdb3-b6a3881bea59" containerName="pull"
Jul 02 20:40:19.962974 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962936    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="68cc7d19-a799-4719-bdb3-b6a3881bea59" containerName="pull"
Jul 02 20:40:19.962974 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962944    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf33c63b-e711-422f-8c25-08ff8ca002d2" containerName="pull"
Jul 02 20:40:19.962974 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962949    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf33c63b-e711-422f-8c25-08ff8ca002d2" containerName="pull"
Jul 02 20:40:19.962974 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962956    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf33c63b-e711-422f-8c25-08ff8ca002d2" containerName="util"
Jul 02 20:40:19.962974 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962961    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf33c63b-e711-422f-8c25-08ff8ca002d2" containerName="util"
Jul 02 20:40:19.962974 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962967    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f13b5f4-f92a-48a6-946b-c8ed8442a6ff" containerName="util"
Jul 02 20:40:19.962974 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962973    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f13b5f4-f92a-48a6-946b-c8ed8442a6ff" containerName="util"
Jul 02 20:40:19.962974 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962978    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f13b5f4-f92a-48a6-946b-c8ed8442a6ff" containerName="pull"
Jul 02 20:40:19.963602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962983    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f13b5f4-f92a-48a6-946b-c8ed8442a6ff" containerName="pull"
Jul 02 20:40:19.963602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962989    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66ebd2f2-878f-4598-bb36-bebfb6094889" containerName="pull"
Jul 02 20:40:19.963602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.962994    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="66ebd2f2-878f-4598-bb36-bebfb6094889" containerName="pull"
Jul 02 20:40:19.963602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.963002    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68cc7d19-a799-4719-bdb3-b6a3881bea59" containerName="util"
Jul 02 20:40:19.963602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.963007    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="68cc7d19-a799-4719-bdb3-b6a3881bea59" containerName="util"
Jul 02 20:40:19.963602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.963012    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66ebd2f2-878f-4598-bb36-bebfb6094889" containerName="util"
Jul 02 20:40:19.963602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.963017    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="66ebd2f2-878f-4598-bb36-bebfb6094889" containerName="util"
Jul 02 20:40:19.963602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.963025    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf33c63b-e711-422f-8c25-08ff8ca002d2" containerName="extract"
Jul 02 20:40:19.963602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.963030    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf33c63b-e711-422f-8c25-08ff8ca002d2" containerName="extract"
Jul 02 20:40:19.963602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.963037    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f13b5f4-f92a-48a6-946b-c8ed8442a6ff" containerName="extract"
Jul 02 20:40:19.963602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.963041    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f13b5f4-f92a-48a6-946b-c8ed8442a6ff" containerName="extract"
Jul 02 20:40:19.963602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.963090    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="68cc7d19-a799-4719-bdb3-b6a3881bea59" containerName="extract"
Jul 02 20:40:19.963602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.963097    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f13b5f4-f92a-48a6-946b-c8ed8442a6ff" containerName="extract"
Jul 02 20:40:19.963602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.963104    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf33c63b-e711-422f-8c25-08ff8ca002d2" containerName="extract"
Jul 02 20:40:19.963602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.963111    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="66ebd2f2-878f-4598-bb36-bebfb6094889" containerName="extract"
Jul 02 20:40:19.967108 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.967093    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4"
Jul 02 20:40:19.969894 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.969867    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 02 20:40:19.969894 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.969880    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 02 20:40:19.970066 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.969943    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 20:40:19.970907 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.970894    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 20:40:19.970995 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.970979    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fzlr4\""
Jul 02 20:40:19.975437 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.975417    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4"]
Jul 02 20:40:19.978378 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:19.978353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:20.037611 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:20.037581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrp92\" (UniqueName: \"kubernetes.io/projected/b60adaf4-a8ac-4dd9-8353-be9b53a23897-kube-api-access-lrp92\") pod \"kuadrant-console-plugin-66b5774985-h5vc4\" (UID: \"b60adaf4-a8ac-4dd9-8353-be9b53a23897\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4"
Jul 02 20:40:20.037746 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:20.037650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b60adaf4-a8ac-4dd9-8353-be9b53a23897-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h5vc4\" (UID: \"b60adaf4-a8ac-4dd9-8353-be9b53a23897\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4"
Jul 02 20:40:20.037746 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:20.037696    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b60adaf4-a8ac-4dd9-8353-be9b53a23897-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h5vc4\" (UID: \"b60adaf4-a8ac-4dd9-8353-be9b53a23897\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4"
Jul 02 20:40:20.139045 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:20.139011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b60adaf4-a8ac-4dd9-8353-be9b53a23897-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h5vc4\" (UID: \"b60adaf4-a8ac-4dd9-8353-be9b53a23897\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4"
Jul 02 20:40:20.139045 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:20.139052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b60adaf4-a8ac-4dd9-8353-be9b53a23897-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h5vc4\" (UID: \"b60adaf4-a8ac-4dd9-8353-be9b53a23897\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4"
Jul 02 20:40:20.139269 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:20.139092    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrp92\" (UniqueName: \"kubernetes.io/projected/b60adaf4-a8ac-4dd9-8353-be9b53a23897-kube-api-access-lrp92\") pod \"kuadrant-console-plugin-66b5774985-h5vc4\" (UID: \"b60adaf4-a8ac-4dd9-8353-be9b53a23897\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4"
Jul 02 20:40:20.139866 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:20.139836    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b60adaf4-a8ac-4dd9-8353-be9b53a23897-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h5vc4\" (UID: \"b60adaf4-a8ac-4dd9-8353-be9b53a23897\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4"
Jul 02 20:40:20.141542 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:20.141516    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b60adaf4-a8ac-4dd9-8353-be9b53a23897-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h5vc4\" (UID: \"b60adaf4-a8ac-4dd9-8353-be9b53a23897\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4"
Jul 02 20:40:20.154246 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:20.154221    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrp92\" (UniqueName: \"kubernetes.io/projected/b60adaf4-a8ac-4dd9-8353-be9b53a23897-kube-api-access-lrp92\") pod \"kuadrant-console-plugin-66b5774985-h5vc4\" (UID: \"b60adaf4-a8ac-4dd9-8353-be9b53a23897\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4"
Jul 02 20:40:20.168704 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:20.168680    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:20.260977 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:20.260874    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:20.277223 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:20.277195    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4"
Jul 02 20:40:20.406310 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:20.406284    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4"]
Jul 02 20:40:20.408044 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:40:20.408017    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb60adaf4_a8ac_4dd9_8353_be9b53a23897.slice/crio-c43f0275fc30737fd39b73749d3d4d8a7c0df6f52135784a45923543e24b6576 WatchSource:0}: Error finding container c43f0275fc30737fd39b73749d3d4d8a7c0df6f52135784a45923543e24b6576: Status 404 returned error can't find the container with id c43f0275fc30737fd39b73749d3d4d8a7c0df6f52135784a45923543e24b6576
Jul 02 20:40:20.424844 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:20.424789    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4" event={"ID":"b60adaf4-a8ac-4dd9-8353-be9b53a23897","Type":"ContainerStarted","Data":"c43f0275fc30737fd39b73749d3d4d8a7c0df6f52135784a45923543e24b6576"}
Jul 02 20:40:22.223076 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:22.223040    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:22.278098 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:22.278063    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:22.364446 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:22.364411    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:22.439634 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:22.439603    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:28.411984 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:28.411938    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-767cd9c89-svs9t" podUID="d17a1ed5-1d8d-4c10-b976-612bf914cfff" containerName="console" containerID="cri-o://c2cc9097f279950ed1dbf542a3ec35f2e6f96deee438be41ea54a4e3f0335c1b" gracePeriod=15
Jul 02 20:40:29.481351 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:29.481316    2565 generic.go:356] "Generic (PLEG): container finished" podID="d17a1ed5-1d8d-4c10-b976-612bf914cfff" containerID="c2cc9097f279950ed1dbf542a3ec35f2e6f96deee438be41ea54a4e3f0335c1b" exitCode=0
Jul 02 20:40:29.481789 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:29.481399    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-767cd9c89-svs9t" event={"ID":"d17a1ed5-1d8d-4c10-b976-612bf914cfff","Type":"ContainerDied","Data":"c2cc9097f279950ed1dbf542a3ec35f2e6f96deee438be41ea54a4e3f0335c1b"}
Jul 02 20:40:30.505812 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:30.505783    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"]
Jul 02 20:40:30.673192 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:30.673157    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"]
Jul 02 20:40:30.673371 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:30.673269    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"
Jul 02 20:40:30.676461 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:30.676437    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-97plq\""
Jul 02 20:40:30.732665 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:30.732632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a24bfaad-462c-4f66-9231-c03f1932720d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8ntnw\" (UID: \"a24bfaad-462c-4f66-9231-c03f1932720d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"
Jul 02 20:40:30.732857 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:30.732742    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7drtw\" (UniqueName: \"kubernetes.io/projected/a24bfaad-462c-4f66-9231-c03f1932720d-kube-api-access-7drtw\") pod \"kuadrant-operator-controller-manager-86878c769f-8ntnw\" (UID: \"a24bfaad-462c-4f66-9231-c03f1932720d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"
Jul 02 20:40:30.834325 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:30.834235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a24bfaad-462c-4f66-9231-c03f1932720d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8ntnw\" (UID: \"a24bfaad-462c-4f66-9231-c03f1932720d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"
Jul 02 20:40:30.834492 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:30.834331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7drtw\" (UniqueName: \"kubernetes.io/projected/a24bfaad-462c-4f66-9231-c03f1932720d-kube-api-access-7drtw\") pod \"kuadrant-operator-controller-manager-86878c769f-8ntnw\" (UID: \"a24bfaad-462c-4f66-9231-c03f1932720d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"
Jul 02 20:40:30.834621 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:30.834595    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a24bfaad-462c-4f66-9231-c03f1932720d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8ntnw\" (UID: \"a24bfaad-462c-4f66-9231-c03f1932720d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"
Jul 02 20:40:30.851501 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:30.851473    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7drtw\" (UniqueName: \"kubernetes.io/projected/a24bfaad-462c-4f66-9231-c03f1932720d-kube-api-access-7drtw\") pod \"kuadrant-operator-controller-manager-86878c769f-8ntnw\" (UID: \"a24bfaad-462c-4f66-9231-c03f1932720d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"
Jul 02 20:40:30.985408 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:30.985362    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"
Jul 02 20:40:31.196369 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:31.196331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:31.296926 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:31.296878    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:31.316574 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:31.316529    2565 patch_prober.go:28] interesting pod/console-767cd9c89-svs9t container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body=
Jul 02 20:40:31.316732 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:31.316601    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-767cd9c89-svs9t" podUID="d17a1ed5-1d8d-4c10-b976-612bf914cfff" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused"
Jul 02 20:40:36.650481 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:36.650439    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:36.750825 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:36.750781    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:39.089906 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:39.089861    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:39.190099 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:39.190061    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:41.317013 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:41.316974    2565 patch_prober.go:28] interesting pod/console-767cd9c89-svs9t container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body=
Jul 02 20:40:41.317428 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:41.317042    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-767cd9c89-svs9t" podUID="d17a1ed5-1d8d-4c10-b976-612bf914cfff" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused"
Jul 02 20:40:41.369179 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:41.369138    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:41.441381 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:41.441325    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:42.658055 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.658031    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:40:42.660671 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.660648    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"]
Jul 02 20:40:42.665749 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:40:42.665725    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24bfaad_462c_4f66_9231_c03f1932720d.slice/crio-6214e23bbcc53976c9b4425c1e8246c973532d24245aa125cce9f91282b8ec71 WatchSource:0}: Error finding container 6214e23bbcc53976c9b4425c1e8246c973532d24245aa125cce9f91282b8ec71: Status 404 returned error can't find the container with id 6214e23bbcc53976c9b4425c1e8246c973532d24245aa125cce9f91282b8ec71
Jul 02 20:40:42.746637 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.746601    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-trusted-ca-bundle\") pod \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") "
Jul 02 20:40:42.746844 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.746644    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-config\") pod \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") "
Jul 02 20:40:42.746844 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.746667    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-service-ca\") pod \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") "
Jul 02 20:40:42.746844 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.746715    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-oauth-config\") pod \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") "
Jul 02 20:40:42.746844 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.746793    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-oauth-serving-cert\") pod \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") "
Jul 02 20:40:42.746844 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.746820    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-serving-cert\") pod \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") "
Jul 02 20:40:42.747112 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.746876    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwnpd\" (UniqueName: \"kubernetes.io/projected/d17a1ed5-1d8d-4c10-b976-612bf914cfff-kube-api-access-xwnpd\") pod \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\" (UID: \"d17a1ed5-1d8d-4c10-b976-612bf914cfff\") "
Jul 02 20:40:42.747112 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.747049    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-config" (OuterVolumeSpecName: "console-config") pod "d17a1ed5-1d8d-4c10-b976-612bf914cfff" (UID: "d17a1ed5-1d8d-4c10-b976-612bf914cfff"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:40:42.747216 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.747109    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-service-ca" (OuterVolumeSpecName: "service-ca") pod "d17a1ed5-1d8d-4c10-b976-612bf914cfff" (UID: "d17a1ed5-1d8d-4c10-b976-612bf914cfff"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:40:42.747216 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.747151    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d17a1ed5-1d8d-4c10-b976-612bf914cfff" (UID: "d17a1ed5-1d8d-4c10-b976-612bf914cfff"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:40:42.747216 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.747162    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d17a1ed5-1d8d-4c10-b976-612bf914cfff" (UID: "d17a1ed5-1d8d-4c10-b976-612bf914cfff"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:40:42.747216 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.747167    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-config\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:40:42.747216 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.747184    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-service-ca\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:40:42.750377 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.750221    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d17a1ed5-1d8d-4c10-b976-612bf914cfff-kube-api-access-xwnpd" (OuterVolumeSpecName: "kube-api-access-xwnpd") pod "d17a1ed5-1d8d-4c10-b976-612bf914cfff" (UID: "d17a1ed5-1d8d-4c10-b976-612bf914cfff"). InnerVolumeSpecName "kube-api-access-xwnpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:40:42.754246 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.754202    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d17a1ed5-1d8d-4c10-b976-612bf914cfff" (UID: "d17a1ed5-1d8d-4c10-b976-612bf914cfff"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:40:42.754246 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.754221    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d17a1ed5-1d8d-4c10-b976-612bf914cfff" (UID: "d17a1ed5-1d8d-4c10-b976-612bf914cfff"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:40:42.848524 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.848497    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwnpd\" (UniqueName: \"kubernetes.io/projected/d17a1ed5-1d8d-4c10-b976-612bf914cfff-kube-api-access-xwnpd\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:40:42.848524 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.848526    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-trusted-ca-bundle\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:40:42.848708 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.848536    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-oauth-config\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:40:42.848708 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.848545    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d17a1ed5-1d8d-4c10-b976-612bf914cfff-oauth-serving-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:40:42.848708 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:42.848553    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d17a1ed5-1d8d-4c10-b976-612bf914cfff-console-serving-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:40:43.562702 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:43.562667    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4" event={"ID":"b60adaf4-a8ac-4dd9-8353-be9b53a23897","Type":"ContainerStarted","Data":"380ba04f26ee3502653936c5dbc4bad5e5899830d0d6a022cffa8521fe48ce3e"}
Jul 02 20:40:43.564015 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:43.563992    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw" event={"ID":"a24bfaad-462c-4f66-9231-c03f1932720d","Type":"ContainerStarted","Data":"6214e23bbcc53976c9b4425c1e8246c973532d24245aa125cce9f91282b8ec71"}
Jul 02 20:40:43.565487 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:43.565459    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-767cd9c89-svs9t" event={"ID":"d17a1ed5-1d8d-4c10-b976-612bf914cfff","Type":"ContainerDied","Data":"cefaaeb4f05d5743cbf1ff879ab3a51903179b5b8fd5a61da358c5a0f0f957f2"}
Jul 02 20:40:43.565582 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:43.565488    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-767cd9c89-svs9t"
Jul 02 20:40:43.565582 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:43.565504    2565 scope.go:117] "RemoveContainer" containerID="c2cc9097f279950ed1dbf542a3ec35f2e6f96deee438be41ea54a4e3f0335c1b"
Jul 02 20:40:43.580931 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:43.580728    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h5vc4" podStartSLOduration=2.387005845 podStartE2EDuration="24.580713599s" totalImagesPullingTime="22.193707754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:43.578391567 +0000 UTC m=+487.701403142" watchObservedRunningTime="2026-07-02 20:40:43.580713599 +0000 UTC m=+487.703725170"
Jul 02 20:40:43.599388 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:43.599350    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-767cd9c89-svs9t"]
Jul 02 20:40:43.607540 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:43.607510    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-767cd9c89-svs9t"]
Jul 02 20:40:44.299295 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:44.299258    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d17a1ed5-1d8d-4c10-b976-612bf914cfff" path="/var/lib/kubelet/pods/d17a1ed5-1d8d-4c10-b976-612bf914cfff/volumes"
Jul 02 20:40:47.703955 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:47.703920    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:47.820380 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:47.820340    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:48.595462 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:48.595427    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw" event={"ID":"a24bfaad-462c-4f66-9231-c03f1932720d","Type":"ContainerStarted","Data":"e5da43b58311c934acccee21e2aed483fe3695c008706466a729200e0dfd141a"}
Jul 02 20:40:48.595641 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:48.595500    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"
Jul 02 20:40:48.618027 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:48.617971    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw" podStartSLOduration=13.351376501 podStartE2EDuration="18.617955499s" totalImagesPullingTime="5.266578998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:48.615078915 +0000 UTC m=+492.738090486" watchObservedRunningTime="2026-07-02 20:40:48.617955499 +0000 UTC m=+492.740967127"
Jul 02 20:40:54.247146 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:54.247109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:54.347810 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:54.347776    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:56.857301 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:56.857267    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:56.958013 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:56.957980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:59.602776 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:40:59.602735    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"
Jul 02 20:41:00.041237 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:00.041202    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:00.141939 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:00.141859    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:06.707449 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:06.707417    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:06.808819 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:06.808786    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:13.292498 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:13.292462    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:13.392523 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:13.392487    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:16.122646 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:16.122612    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:16.300878 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:16.300843    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:18.065977 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:18.065944    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:18.186796 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:18.186737    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:18.242160 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:18.242131    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:18.865116 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:18.865087    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-zh4dh"]
Jul 02 20:41:18.865435 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:18.865423    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d17a1ed5-1d8d-4c10-b976-612bf914cfff" containerName="console"
Jul 02 20:41:18.865480 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:18.865437    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d17a1ed5-1d8d-4c10-b976-612bf914cfff" containerName="console"
Jul 02 20:41:18.865518 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:18.865501    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d17a1ed5-1d8d-4c10-b976-612bf914cfff" containerName="console"
Jul 02 20:41:18.903733 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:18.903701    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zh4dh"]
Jul 02 20:41:18.903908 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:18.903816    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zh4dh"
Jul 02 20:41:18.906514 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:18.906490    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pjx2f\""
Jul 02 20:41:18.907832 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:18.907810    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:18.961050 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:18.961023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pbq6\" (UniqueName: \"kubernetes.io/projected/12b5b48f-505f-4789-a427-9ba6a043e6ff-kube-api-access-4pbq6\") pod \"authorino-58cd955675-zh4dh\" (UID: \"12b5b48f-505f-4789-a427-9ba6a043e6ff\") " pod="kuadrant-system/authorino-58cd955675-zh4dh"
Jul 02 20:41:19.007918 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:19.007885    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:19.062518 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:19.062483    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pbq6\" (UniqueName: \"kubernetes.io/projected/12b5b48f-505f-4789-a427-9ba6a043e6ff-kube-api-access-4pbq6\") pod \"authorino-58cd955675-zh4dh\" (UID: \"12b5b48f-505f-4789-a427-9ba6a043e6ff\") " pod="kuadrant-system/authorino-58cd955675-zh4dh"
Jul 02 20:41:19.071752 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:19.071723    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pbq6\" (UniqueName: \"kubernetes.io/projected/12b5b48f-505f-4789-a427-9ba6a043e6ff-kube-api-access-4pbq6\") pod \"authorino-58cd955675-zh4dh\" (UID: \"12b5b48f-505f-4789-a427-9ba6a043e6ff\") " pod="kuadrant-system/authorino-58cd955675-zh4dh"
Jul 02 20:41:19.212725 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:19.212643    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zh4dh"
Jul 02 20:41:19.343087 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:19.343047    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zh4dh"]
Jul 02 20:41:19.344827 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:41:19.344797    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12b5b48f_505f_4789_a427_9ba6a043e6ff.slice/crio-23203928b869ca0a89e06dc3d07dc59c7580f1b139f7ae1d3aaac4eaefa2b5af WatchSource:0}: Error finding container 23203928b869ca0a89e06dc3d07dc59c7580f1b139f7ae1d3aaac4eaefa2b5af: Status 404 returned error can't find the container with id 23203928b869ca0a89e06dc3d07dc59c7580f1b139f7ae1d3aaac4eaefa2b5af
Jul 02 20:41:19.756857 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:19.756815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zh4dh" event={"ID":"12b5b48f-505f-4789-a427-9ba6a043e6ff","Type":"ContainerStarted","Data":"23203928b869ca0a89e06dc3d07dc59c7580f1b139f7ae1d3aaac4eaefa2b5af"}
Jul 02 20:41:22.777459 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:22.777425    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zh4dh" event={"ID":"12b5b48f-505f-4789-a427-9ba6a043e6ff","Type":"ContainerStarted","Data":"1ef1667c32f3fe6613e989c9a5cf1d529db909f0685aa1da78a9526c1cf0a9df"}
Jul 02 20:41:22.795881 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:22.795832    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-zh4dh" podStartSLOduration=1.487916288 podStartE2EDuration="4.795817112s" totalImagesPullingTime="3.307900824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:41:22.792712779 +0000 UTC m=+526.915724352" watchObservedRunningTime="2026-07-02 20:41:22.795817112 +0000 UTC m=+526.918828683"
Jul 02 20:41:23.909550 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:23.909514    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zh4dh"]
Jul 02 20:41:24.787852 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:24.787813    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-zh4dh" podUID="12b5b48f-505f-4789-a427-9ba6a043e6ff" containerName="authorino" containerID="cri-o://1ef1667c32f3fe6613e989c9a5cf1d529db909f0685aa1da78a9526c1cf0a9df" gracePeriod=30
Jul 02 20:41:25.034515 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:25.034494    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zh4dh"
Jul 02 20:41:25.121153 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:25.121125    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pbq6\" (UniqueName: \"kubernetes.io/projected/12b5b48f-505f-4789-a427-9ba6a043e6ff-kube-api-access-4pbq6\") pod \"12b5b48f-505f-4789-a427-9ba6a043e6ff\" (UID: \"12b5b48f-505f-4789-a427-9ba6a043e6ff\") "
Jul 02 20:41:25.123113 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:25.123092    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12b5b48f-505f-4789-a427-9ba6a043e6ff-kube-api-access-4pbq6" (OuterVolumeSpecName: "kube-api-access-4pbq6") pod "12b5b48f-505f-4789-a427-9ba6a043e6ff" (UID: "12b5b48f-505f-4789-a427-9ba6a043e6ff"). InnerVolumeSpecName "kube-api-access-4pbq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:41:25.222564 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:25.222535    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pbq6\" (UniqueName: \"kubernetes.io/projected/12b5b48f-505f-4789-a427-9ba6a043e6ff-kube-api-access-4pbq6\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:41:25.794287 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:25.794247    2565 generic.go:356] "Generic (PLEG): container finished" podID="12b5b48f-505f-4789-a427-9ba6a043e6ff" containerID="1ef1667c32f3fe6613e989c9a5cf1d529db909f0685aa1da78a9526c1cf0a9df" exitCode=0
Jul 02 20:41:25.794287 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:25.794287    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zh4dh"
Jul 02 20:41:25.794521 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:25.794289    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zh4dh" event={"ID":"12b5b48f-505f-4789-a427-9ba6a043e6ff","Type":"ContainerDied","Data":"1ef1667c32f3fe6613e989c9a5cf1d529db909f0685aa1da78a9526c1cf0a9df"}
Jul 02 20:41:25.794521 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:25.794325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zh4dh" event={"ID":"12b5b48f-505f-4789-a427-9ba6a043e6ff","Type":"ContainerDied","Data":"23203928b869ca0a89e06dc3d07dc59c7580f1b139f7ae1d3aaac4eaefa2b5af"}
Jul 02 20:41:25.794521 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:25.794343    2565 scope.go:117] "RemoveContainer" containerID="1ef1667c32f3fe6613e989c9a5cf1d529db909f0685aa1da78a9526c1cf0a9df"
Jul 02 20:41:25.802964 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:25.802947    2565 scope.go:117] "RemoveContainer" containerID="1ef1667c32f3fe6613e989c9a5cf1d529db909f0685aa1da78a9526c1cf0a9df"
Jul 02 20:41:25.803222 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:41:25.803204    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ef1667c32f3fe6613e989c9a5cf1d529db909f0685aa1da78a9526c1cf0a9df\": container with ID starting with 1ef1667c32f3fe6613e989c9a5cf1d529db909f0685aa1da78a9526c1cf0a9df not found: ID does not exist" containerID="1ef1667c32f3fe6613e989c9a5cf1d529db909f0685aa1da78a9526c1cf0a9df"
Jul 02 20:41:25.803286 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:25.803231    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ef1667c32f3fe6613e989c9a5cf1d529db909f0685aa1da78a9526c1cf0a9df"} err="failed to get container status \"1ef1667c32f3fe6613e989c9a5cf1d529db909f0685aa1da78a9526c1cf0a9df\": rpc error: code = NotFound desc = could not find container \"1ef1667c32f3fe6613e989c9a5cf1d529db909f0685aa1da78a9526c1cf0a9df\": container with ID starting with 1ef1667c32f3fe6613e989c9a5cf1d529db909f0685aa1da78a9526c1cf0a9df not found: ID does not exist"
Jul 02 20:41:25.814631 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:25.814610    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zh4dh"]
Jul 02 20:41:25.818847 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:25.818825    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-zh4dh"]
Jul 02 20:41:26.298738 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:26.298698    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12b5b48f-505f-4789-a427-9ba6a043e6ff" path="/var/lib/kubelet/pods/12b5b48f-505f-4789-a427-9ba6a043e6ff/volumes"
Jul 02 20:41:34.447404 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:34.447367    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:41.927809 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:41.927773    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:46.320370 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.320336    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:46.427656 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.427626    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:46.539140 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.539108    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-njghz"]
Jul 02 20:41:46.539447 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.539434    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12b5b48f-505f-4789-a427-9ba6a043e6ff" containerName="authorino"
Jul 02 20:41:46.539492 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.539449    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="12b5b48f-505f-4789-a427-9ba6a043e6ff" containerName="authorino"
Jul 02 20:41:46.539527 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.539521    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="12b5b48f-505f-4789-a427-9ba6a043e6ff" containerName="authorino"
Jul 02 20:41:46.543997 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.543978    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-njghz"
Jul 02 20:41:46.546591 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.546489    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pjx2f\""
Jul 02 20:41:46.549309 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.549291    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-njghz"]
Jul 02 20:41:46.704641 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.704608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v2zv\" (UniqueName: \"kubernetes.io/projected/2a734613-d6bf-453a-8015-410e8a2b2a50-kube-api-access-4v2zv\") pod \"authorino-5d4b67c446-njghz\" (UID: \"2a734613-d6bf-453a-8015-410e8a2b2a50\") " pod="kuadrant-system/authorino-5d4b67c446-njghz"
Jul 02 20:41:46.742931 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.742896    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-njghz"]
Jul 02 20:41:46.743175 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:41:46.743156    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4v2zv], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-njghz" podUID="2a734613-d6bf-453a-8015-410e8a2b2a50"
Jul 02 20:41:46.770766 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.770719    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-96xkg"]
Jul 02 20:41:46.774042 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.774022    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-96xkg"
Jul 02 20:41:46.776540 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.776518    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 02 20:41:46.782177 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.782152    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-96xkg"]
Jul 02 20:41:46.801706 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.801672    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-96xkg"]
Jul 02 20:41:46.801961 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:41:46.801942    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7kdz4 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-7kdz4 tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-96xkg" podUID="2c277392-4992-4930-b31f-471df050449d"
Jul 02 20:41:46.805861 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.805833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v2zv\" (UniqueName: \"kubernetes.io/projected/2a734613-d6bf-453a-8015-410e8a2b2a50-kube-api-access-4v2zv\") pod \"authorino-5d4b67c446-njghz\" (UID: \"2a734613-d6bf-453a-8015-410e8a2b2a50\") " pod="kuadrant-system/authorino-5d4b67c446-njghz"
Jul 02 20:41:46.819730 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.819703    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v2zv\" (UniqueName: \"kubernetes.io/projected/2a734613-d6bf-453a-8015-410e8a2b2a50-kube-api-access-4v2zv\") pod \"authorino-5d4b67c446-njghz\" (UID: \"2a734613-d6bf-453a-8015-410e8a2b2a50\") " pod="kuadrant-system/authorino-5d4b67c446-njghz"
Jul 02 20:41:46.906596 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.906566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c277392-4992-4930-b31f-471df050449d-tls-cert\") pod \"authorino-76877994-96xkg\" (UID: \"2c277392-4992-4930-b31f-471df050449d\") " pod="kuadrant-system/authorino-76877994-96xkg"
Jul 02 20:41:46.906832 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.906620    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kdz4\" (UniqueName: \"kubernetes.io/projected/2c277392-4992-4930-b31f-471df050449d-kube-api-access-7kdz4\") pod \"authorino-76877994-96xkg\" (UID: \"2c277392-4992-4930-b31f-471df050449d\") " pod="kuadrant-system/authorino-76877994-96xkg"
Jul 02 20:41:46.908808 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.908782    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-njghz"
Jul 02 20:41:46.908940 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.908783    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-96xkg"
Jul 02 20:41:46.916222 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.916198    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-njghz"
Jul 02 20:41:46.919332 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:46.919314    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-96xkg"
Jul 02 20:41:47.007154 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.007055    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v2zv\" (UniqueName: \"kubernetes.io/projected/2a734613-d6bf-453a-8015-410e8a2b2a50-kube-api-access-4v2zv\") pod \"2a734613-d6bf-453a-8015-410e8a2b2a50\" (UID: \"2a734613-d6bf-453a-8015-410e8a2b2a50\") "
Jul 02 20:41:47.007339 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.007167    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kdz4\" (UniqueName: \"kubernetes.io/projected/2c277392-4992-4930-b31f-471df050449d-kube-api-access-7kdz4\") pod \"authorino-76877994-96xkg\" (UID: \"2c277392-4992-4930-b31f-471df050449d\") " pod="kuadrant-system/authorino-76877994-96xkg"
Jul 02 20:41:47.007339 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.007293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c277392-4992-4930-b31f-471df050449d-tls-cert\") pod \"authorino-76877994-96xkg\" (UID: \"2c277392-4992-4930-b31f-471df050449d\") " pod="kuadrant-system/authorino-76877994-96xkg"
Jul 02 20:41:47.009208 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.009181    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a734613-d6bf-453a-8015-410e8a2b2a50-kube-api-access-4v2zv" (OuterVolumeSpecName: "kube-api-access-4v2zv") pod "2a734613-d6bf-453a-8015-410e8a2b2a50" (UID: "2a734613-d6bf-453a-8015-410e8a2b2a50"). InnerVolumeSpecName "kube-api-access-4v2zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:41:47.009672 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.009652    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c277392-4992-4930-b31f-471df050449d-tls-cert\") pod \"authorino-76877994-96xkg\" (UID: \"2c277392-4992-4930-b31f-471df050449d\") " pod="kuadrant-system/authorino-76877994-96xkg"
Jul 02 20:41:47.016181 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.016160    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kdz4\" (UniqueName: \"kubernetes.io/projected/2c277392-4992-4930-b31f-471df050449d-kube-api-access-7kdz4\") pod \"authorino-76877994-96xkg\" (UID: \"2c277392-4992-4930-b31f-471df050449d\") " pod="kuadrant-system/authorino-76877994-96xkg"
Jul 02 20:41:47.108598 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.108563    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c277392-4992-4930-b31f-471df050449d-tls-cert\") pod \"2c277392-4992-4930-b31f-471df050449d\" (UID: \"2c277392-4992-4930-b31f-471df050449d\") "
Jul 02 20:41:47.108801 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.108629    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kdz4\" (UniqueName: \"kubernetes.io/projected/2c277392-4992-4930-b31f-471df050449d-kube-api-access-7kdz4\") pod \"2c277392-4992-4930-b31f-471df050449d\" (UID: \"2c277392-4992-4930-b31f-471df050449d\") "
Jul 02 20:41:47.108801 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.108795    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v2zv\" (UniqueName: \"kubernetes.io/projected/2a734613-d6bf-453a-8015-410e8a2b2a50-kube-api-access-4v2zv\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:41:47.110689 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.110663    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c277392-4992-4930-b31f-471df050449d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2c277392-4992-4930-b31f-471df050449d" (UID: "2c277392-4992-4930-b31f-471df050449d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:41:47.110689 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.110668    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c277392-4992-4930-b31f-471df050449d-kube-api-access-7kdz4" (OuterVolumeSpecName: "kube-api-access-7kdz4") pod "2c277392-4992-4930-b31f-471df050449d" (UID: "2c277392-4992-4930-b31f-471df050449d"). InnerVolumeSpecName "kube-api-access-7kdz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:41:47.209522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.209487    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kdz4\" (UniqueName: \"kubernetes.io/projected/2c277392-4992-4930-b31f-471df050449d-kube-api-access-7kdz4\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:41:47.209522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.209518    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c277392-4992-4930-b31f-471df050449d-tls-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:41:47.913978 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.913946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-96xkg"
Jul 02 20:41:47.914356 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.913946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-njghz"
Jul 02 20:41:47.946331 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.946298    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-96xkg"]
Jul 02 20:41:47.953777 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.951546    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-96xkg"]
Jul 02 20:41:47.977148 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.977116    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-njghz"]
Jul 02 20:41:47.980702 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:47.980677    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-njghz"]
Jul 02 20:41:48.299449 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:48.299372    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a734613-d6bf-453a-8015-410e8a2b2a50" path="/var/lib/kubelet/pods/2a734613-d6bf-453a-8015-410e8a2b2a50/volumes"
Jul 02 20:41:48.299634 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:48.299622    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c277392-4992-4930-b31f-471df050449d" path="/var/lib/kubelet/pods/2c277392-4992-4930-b31f-471df050449d/volumes"
Jul 02 20:41:52.762294 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:52.762267    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:53.381480 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:53.381411    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:53.478338 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:53.478309    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:53.534002 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:53.533972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:56.750551 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:56.750483    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:56.857189 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:41:56.857153    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:05.750065 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:42:05.750035    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:05.851125 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:42:05.851097    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:28.182358 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:42:28.182323    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:28.628151 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:42:28.628119    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:28.879065 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:42:28.878972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:29.099010 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:42:29.098973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:29.196852 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:42:29.196697    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:36.289129 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:42:36.289099    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 20:42:36.289604 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:42:36.289170    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 20:42:39.723616 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:42:39.723582    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:39.821463 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:42:39.821412    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:51.618294 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:42:51.618255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:43:00.286538 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.286455    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"]
Jul 02 20:43:00.289833 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.289812    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.293790 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.293767    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 20:43:00.293930 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.293776    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 02 20:43:00.293930 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.293814    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 20:43:00.293930 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.293818    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gtvps\""
Jul 02 20:43:00.301134 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.301112    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"]
Jul 02 20:43:00.316717 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.316668    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:43:00.334801 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.334781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f51bb928-0241-4504-95f6-06af25015e75-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.334898 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.334814    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f51bb928-0241-4504-95f6-06af25015e75-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.334898 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.334834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f51bb928-0241-4504-95f6-06af25015e75-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.335026 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.334965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f51bb928-0241-4504-95f6-06af25015e75-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.335095 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.335077    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f51bb928-0241-4504-95f6-06af25015e75-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.335337 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.335312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d96px\" (UniqueName: \"kubernetes.io/projected/f51bb928-0241-4504-95f6-06af25015e75-kube-api-access-d96px\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.436187 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.436162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f51bb928-0241-4504-95f6-06af25015e75-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.436324 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.436213    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f51bb928-0241-4504-95f6-06af25015e75-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.436324 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.436270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d96px\" (UniqueName: \"kubernetes.io/projected/f51bb928-0241-4504-95f6-06af25015e75-kube-api-access-d96px\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.436324 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.436314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f51bb928-0241-4504-95f6-06af25015e75-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.436504 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.436346    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f51bb928-0241-4504-95f6-06af25015e75-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.436504 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.436374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f51bb928-0241-4504-95f6-06af25015e75-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.436610 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.436533    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f51bb928-0241-4504-95f6-06af25015e75-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.436718 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.436696    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f51bb928-0241-4504-95f6-06af25015e75-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.436718 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.436710    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f51bb928-0241-4504-95f6-06af25015e75-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.438543 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.438519    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f51bb928-0241-4504-95f6-06af25015e75-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.438800 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.438785    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f51bb928-0241-4504-95f6-06af25015e75-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.444256 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.444229    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d96px\" (UniqueName: \"kubernetes.io/projected/f51bb928-0241-4504-95f6-06af25015e75-kube-api-access-d96px\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9tkj2\" (UID: \"f51bb928-0241-4504-95f6-06af25015e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.602618 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.602585    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:00.735235 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:00.735203    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"]
Jul 02 20:43:00.737166 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:43:00.737139    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51bb928_0241_4504_95f6_06af25015e75.slice/crio-24242186a7c732f12b624ac8e25ae9c8a34233b342f0c4b92b11a5ec2796783f WatchSource:0}: Error finding container 24242186a7c732f12b624ac8e25ae9c8a34233b342f0c4b92b11a5ec2796783f: Status 404 returned error can't find the container with id 24242186a7c732f12b624ac8e25ae9c8a34233b342f0c4b92b11a5ec2796783f
Jul 02 20:43:01.304362 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:01.304326    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2" event={"ID":"f51bb928-0241-4504-95f6-06af25015e75","Type":"ContainerStarted","Data":"24242186a7c732f12b624ac8e25ae9c8a34233b342f0c4b92b11a5ec2796783f"}
Jul 02 20:43:02.315726 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:02.315691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2" event={"ID":"f51bb928-0241-4504-95f6-06af25015e75","Type":"ContainerStarted","Data":"8efb7c0a03138ec0fbf3ffdfd3756603ccecf34a2ec39b47e30227c22834c853"}
Jul 02 20:43:02.334907 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:02.334847    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2" podStartSLOduration=1.314882276 podStartE2EDuration="2.334830712s" totalImagesPullingTime="1.019948436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:43:02.332388968 +0000 UTC m=+626.455400552" watchObservedRunningTime="2026-07-02 20:43:02.334830712 +0000 UTC m=+626.457842283"
Jul 02 20:43:04.102106 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:04.102062    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:43:04.250157 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:04.250107    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:43:10.092870 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.092832    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"]
Jul 02 20:43:10.097004 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.096983    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.099519 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.099494    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 02 20:43:10.105919 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.105893    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"]
Jul 02 20:43:10.128725 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.128691    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:43:10.228856 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.228828    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44934f5a-a23e-4953-ad5e-64fb834715d1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.229025 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.228888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44934f5a-a23e-4953-ad5e-64fb834715d1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.229025 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.228979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44934f5a-a23e-4953-ad5e-64fb834715d1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.229025 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.229009    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44934f5a-a23e-4953-ad5e-64fb834715d1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.229133 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.229027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44934f5a-a23e-4953-ad5e-64fb834715d1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.229133 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.229048    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc6w9\" (UniqueName: \"kubernetes.io/projected/44934f5a-a23e-4953-ad5e-64fb834715d1-kube-api-access-rc6w9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.329860 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.329829    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44934f5a-a23e-4953-ad5e-64fb834715d1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.330039 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.329885    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44934f5a-a23e-4953-ad5e-64fb834715d1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.330039 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.329903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44934f5a-a23e-4953-ad5e-64fb834715d1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.330039 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.329919    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44934f5a-a23e-4953-ad5e-64fb834715d1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.330039 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.329940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc6w9\" (UniqueName: \"kubernetes.io/projected/44934f5a-a23e-4953-ad5e-64fb834715d1-kube-api-access-rc6w9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.330258 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.330055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44934f5a-a23e-4953-ad5e-64fb834715d1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.330258 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.330203    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44934f5a-a23e-4953-ad5e-64fb834715d1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.330386 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.330367    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44934f5a-a23e-4953-ad5e-64fb834715d1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.330462 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.330439    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44934f5a-a23e-4953-ad5e-64fb834715d1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.332181 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.332159    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44934f5a-a23e-4953-ad5e-64fb834715d1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.332340 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.332325    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44934f5a-a23e-4953-ad5e-64fb834715d1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.338742 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.338712    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc6w9\" (UniqueName: \"kubernetes.io/projected/44934f5a-a23e-4953-ad5e-64fb834715d1-kube-api-access-rc6w9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cd6jv\" (UID: \"44934f5a-a23e-4953-ad5e-64fb834715d1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.409602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.409524    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:10.539522 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.539298    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"]
Jul 02 20:43:10.541695 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:43:10.541668    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44934f5a_a23e_4953_ad5e_64fb834715d1.slice/crio-84d1097c8cba4846abb13310ed8f3f54c8d9b5aff45b5fa20ca13e8b73eed723 WatchSource:0}: Error finding container 84d1097c8cba4846abb13310ed8f3f54c8d9b5aff45b5fa20ca13e8b73eed723: Status 404 returned error can't find the container with id 84d1097c8cba4846abb13310ed8f3f54c8d9b5aff45b5fa20ca13e8b73eed723
Jul 02 20:43:10.543151 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.543130    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:43:10.603495 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.603449    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:10.603655 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.603520    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:10.616228 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:10.616198    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:11.366561 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:11.366522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv" event={"ID":"44934f5a-a23e-4953-ad5e-64fb834715d1","Type":"ContainerStarted","Data":"e60790a635e16cccb6a8a8fc84f50dae013cd27140b79eba1b19e3de99149266"}
Jul 02 20:43:11.367038 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:11.366576    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv" event={"ID":"44934f5a-a23e-4953-ad5e-64fb834715d1","Type":"ContainerStarted","Data":"84d1097c8cba4846abb13310ed8f3f54c8d9b5aff45b5fa20ca13e8b73eed723"}
Jul 02 20:43:11.378083 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:11.378056    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9tkj2"
Jul 02 20:43:11.385636 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:11.385593    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv" podStartSLOduration=1.190681801 podStartE2EDuration="1.385579244s" totalImagesPullingTime="194.897443ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:43:11.383191906 +0000 UTC m=+635.506203479" watchObservedRunningTime="2026-07-02 20:43:11.385579244 +0000 UTC m=+635.508590815"
Jul 02 20:43:14.813566 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:14.813531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:43:20.410594 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:20.410566    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:20.411070 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:20.410618    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:20.423598 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:20.423576    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:20.434933 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:20.434909    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cd6jv"
Jul 02 20:43:31.907836 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:31.907796    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:43:32.002045 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:32.001996    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:43:32.860246 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:32.860218    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"]
Jul 02 20:43:32.863685 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:32.863662    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:32.870860 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:32.870684    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 02 20:43:32.893418 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:32.893387    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"]
Jul 02 20:43:32.928139 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:32.928105    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84a29309-b17e-40f3-9554-28a8495306f6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:32.928542 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:32.928166    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84a29309-b17e-40f3-9554-28a8495306f6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:32.928542 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:32.928239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84a29309-b17e-40f3-9554-28a8495306f6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:32.928542 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:32.928271    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84a29309-b17e-40f3-9554-28a8495306f6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:32.928542 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:32.928289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84a29309-b17e-40f3-9554-28a8495306f6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:32.928542 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:32.928348    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm24z\" (UniqueName: \"kubernetes.io/projected/84a29309-b17e-40f3-9554-28a8495306f6-kube-api-access-dm24z\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:32.944119 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:32.944072    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:43:33.029045 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:33.029013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm24z\" (UniqueName: \"kubernetes.io/projected/84a29309-b17e-40f3-9554-28a8495306f6-kube-api-access-dm24z\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:33.029045 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:33.029050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84a29309-b17e-40f3-9554-28a8495306f6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:33.029276 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:33.029087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84a29309-b17e-40f3-9554-28a8495306f6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:33.029276 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:33.029140    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84a29309-b17e-40f3-9554-28a8495306f6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:33.029276 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:33.029166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84a29309-b17e-40f3-9554-28a8495306f6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:33.029411 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:33.029369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84a29309-b17e-40f3-9554-28a8495306f6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:33.029616 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:33.029593    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84a29309-b17e-40f3-9554-28a8495306f6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:33.029616 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:33.029612    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84a29309-b17e-40f3-9554-28a8495306f6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:33.029726 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:33.029663    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84a29309-b17e-40f3-9554-28a8495306f6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:33.031451 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:33.031428    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84a29309-b17e-40f3-9554-28a8495306f6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:33.031689 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:33.031670    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84a29309-b17e-40f3-9554-28a8495306f6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:33.038082 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:33.038063    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm24z\" (UniqueName: \"kubernetes.io/projected/84a29309-b17e-40f3-9554-28a8495306f6-kube-api-access-dm24z\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lccnf\" (UID: \"84a29309-b17e-40f3-9554-28a8495306f6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:33.173990 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:33.173897    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:33.306619 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:33.306577    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"]
Jul 02 20:43:33.308155 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:43:33.308116    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84a29309_b17e_40f3_9554_28a8495306f6.slice/crio-20ec6035c48252ca2407e5a3e17ede2ba9ade154b9170ffa5d4e943365488fd1 WatchSource:0}: Error finding container 20ec6035c48252ca2407e5a3e17ede2ba9ade154b9170ffa5d4e943365488fd1: Status 404 returned error can't find the container with id 20ec6035c48252ca2407e5a3e17ede2ba9ade154b9170ffa5d4e943365488fd1
Jul 02 20:43:33.485892 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:33.485813    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf" event={"ID":"84a29309-b17e-40f3-9554-28a8495306f6","Type":"ContainerStarted","Data":"20ec6035c48252ca2407e5a3e17ede2ba9ade154b9170ffa5d4e943365488fd1"}
Jul 02 20:43:34.492887 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:34.492848    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf" event={"ID":"84a29309-b17e-40f3-9554-28a8495306f6","Type":"ContainerStarted","Data":"f89fdad33b5c000e14ff82bd0f94a47a111ae49e2e7c5d878f60daa75908a453"}
Jul 02 20:43:34.511130 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:34.511080    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf" podStartSLOduration=2.313592264 podStartE2EDuration="2.511062307s" totalImagesPullingTime="197.470043ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:43:34.508627695 +0000 UTC m=+658.631639266" watchObservedRunningTime="2026-07-02 20:43:34.511062307 +0000 UTC m=+658.634073877"
Jul 02 20:43:43.174748 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:43.174713    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:43.175193 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:43.174794    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:43.187037 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:43.187016    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:43.550734 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:43.550653    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lccnf"
Jul 02 20:43:44.192942 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.192911    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"]
Jul 02 20:43:44.196772 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.196744    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.199591 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.199572    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 02 20:43:44.206157 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.206131    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"]
Jul 02 20:43:44.219552 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.219529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.219656 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.219641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.219718 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.219692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.219800 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.219726    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.219859 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.219802    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6nmb\" (UniqueName: \"kubernetes.io/projected/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-kube-api-access-t6nmb\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.219900 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.219879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.237518 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.237494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:43:44.320629 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.320593    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.320629 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.320636    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.320893 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.320664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.320893 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.320777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6nmb\" (UniqueName: \"kubernetes.io/projected/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-kube-api-access-t6nmb\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.320893 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.320824    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.321177 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.320870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.321263 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.321067    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.321320 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.321123    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.321320 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.321148    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.323039 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.323016    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.323290 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.323272    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.330086 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.330063    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6nmb\" (UniqueName: \"kubernetes.io/projected/d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a-kube-api-access-t6nmb\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28\" (UID: \"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.507627 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.507530    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:44.648039 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:44.648010    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"]
Jul 02 20:43:44.648642 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:43:44.648621    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd16b38a4_36f4_4ac3_9652_b1a53a8e8b8a.slice/crio-0e40cff84e3b48038af6e027b72d1b1095d859d4575b8dbb0a4b5d253e03a307 WatchSource:0}: Error finding container 0e40cff84e3b48038af6e027b72d1b1095d859d4575b8dbb0a4b5d253e03a307: Status 404 returned error can't find the container with id 0e40cff84e3b48038af6e027b72d1b1095d859d4575b8dbb0a4b5d253e03a307
Jul 02 20:43:45.552639 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:45.552611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28" event={"ID":"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a","Type":"ContainerStarted","Data":"da8d54b44686c0e56fa0fa0138effec66b4b4661cb8c77f91fbd95d5b2c9654f"}
Jul 02 20:43:45.552639 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:45.552648    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28" event={"ID":"d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a","Type":"ContainerStarted","Data":"0e40cff84e3b48038af6e027b72d1b1095d859d4575b8dbb0a4b5d253e03a307"}
Jul 02 20:43:45.575297 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:45.575242    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28" podStartSLOduration=1.405543559 podStartE2EDuration="1.575226547s" totalImagesPullingTime="169.682988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:43:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:43:45.572308016 +0000 UTC m=+669.695319587" watchObservedRunningTime="2026-07-02 20:43:45.575226547 +0000 UTC m=+669.698238118"
Jul 02 20:43:54.508003 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:54.507963    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:54.508453 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:54.508019    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:54.521566 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:54.521543    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:43:54.610259 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:43:54.610234    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28"
Jul 02 20:44:55.247193 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:44:55.247153    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:44:59.624702 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:44:59.624668    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:44:59.733902 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:44:59.733870    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:45:00.792424 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:45:00.792387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:45:00.888570 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:45:00.888541    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:45:39.789351 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:45:39.789319    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:12.888315 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:46:12.888232    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:14.164864 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:46:14.164828    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:49.849644 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:46:49.849605    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:49.943653 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:46:49.943621    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:50.085216 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:46:50.085177    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:56.244807 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:46:56.244774    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:56.314121 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:46:56.314086    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:56.415815 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:46:56.415780    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:56.509862 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:46:56.509783    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:56.613009 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:46:56.612977    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:47:02.442304 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:47:02.442266    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:47:02.547191 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:47:02.547159    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:47:29.781859 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:47:29.781781    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:47:36.323744 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:47:36.323721    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 20:47:36.327094 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:47:36.327070    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 20:49:24.089730 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:49:24.089651    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:49:25.604147 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:49:25.604104    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:50:55.654480 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:55.654446    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"]
Jul 02 20:50:55.655059 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:55.654736    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw" podUID="a24bfaad-462c-4f66-9231-c03f1932720d" containerName="manager" containerID="cri-o://e5da43b58311c934acccee21e2aed483fe3695c008706466a729200e0dfd141a" gracePeriod=10
Jul 02 20:50:57.613608 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:57.613583    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"
Jul 02 20:50:57.631465 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:57.631438    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a24bfaad-462c-4f66-9231-c03f1932720d-extensions-socket-volume\") pod \"a24bfaad-462c-4f66-9231-c03f1932720d\" (UID: \"a24bfaad-462c-4f66-9231-c03f1932720d\") "
Jul 02 20:50:57.631465 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:57.631470    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7drtw\" (UniqueName: \"kubernetes.io/projected/a24bfaad-462c-4f66-9231-c03f1932720d-kube-api-access-7drtw\") pod \"a24bfaad-462c-4f66-9231-c03f1932720d\" (UID: \"a24bfaad-462c-4f66-9231-c03f1932720d\") "
Jul 02 20:50:57.631831 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:57.631800    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a24bfaad-462c-4f66-9231-c03f1932720d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a24bfaad-462c-4f66-9231-c03f1932720d" (UID: "a24bfaad-462c-4f66-9231-c03f1932720d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:50:57.633495 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:57.633471    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a24bfaad-462c-4f66-9231-c03f1932720d-kube-api-access-7drtw" (OuterVolumeSpecName: "kube-api-access-7drtw") pod "a24bfaad-462c-4f66-9231-c03f1932720d" (UID: "a24bfaad-462c-4f66-9231-c03f1932720d"). InnerVolumeSpecName "kube-api-access-7drtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:50:57.732586 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:57.732501    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a24bfaad-462c-4f66-9231-c03f1932720d-extensions-socket-volume\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:50:57.732586 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:57.732532    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7drtw\" (UniqueName: \"kubernetes.io/projected/a24bfaad-462c-4f66-9231-c03f1932720d-kube-api-access-7drtw\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:50:57.842343 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:57.842305    2565 generic.go:356] "Generic (PLEG): container finished" podID="a24bfaad-462c-4f66-9231-c03f1932720d" containerID="e5da43b58311c934acccee21e2aed483fe3695c008706466a729200e0dfd141a" exitCode=0
Jul 02 20:50:57.842514 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:57.842352    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"
Jul 02 20:50:57.842514 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:57.842387    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw" event={"ID":"a24bfaad-462c-4f66-9231-c03f1932720d","Type":"ContainerDied","Data":"e5da43b58311c934acccee21e2aed483fe3695c008706466a729200e0dfd141a"}
Jul 02 20:50:57.842514 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:57.842440    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw" event={"ID":"a24bfaad-462c-4f66-9231-c03f1932720d","Type":"ContainerDied","Data":"6214e23bbcc53976c9b4425c1e8246c973532d24245aa125cce9f91282b8ec71"}
Jul 02 20:50:57.842514 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:57.842485    2565 scope.go:117] "RemoveContainer" containerID="e5da43b58311c934acccee21e2aed483fe3695c008706466a729200e0dfd141a"
Jul 02 20:50:57.852221 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:57.852205    2565 scope.go:117] "RemoveContainer" containerID="e5da43b58311c934acccee21e2aed483fe3695c008706466a729200e0dfd141a"
Jul 02 20:50:57.852490 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:50:57.852470    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5da43b58311c934acccee21e2aed483fe3695c008706466a729200e0dfd141a\": container with ID starting with e5da43b58311c934acccee21e2aed483fe3695c008706466a729200e0dfd141a not found: ID does not exist" containerID="e5da43b58311c934acccee21e2aed483fe3695c008706466a729200e0dfd141a"
Jul 02 20:50:57.852552 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:57.852500    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5da43b58311c934acccee21e2aed483fe3695c008706466a729200e0dfd141a"} err="failed to get container status \"e5da43b58311c934acccee21e2aed483fe3695c008706466a729200e0dfd141a\": rpc error: code = NotFound desc = could not find container \"e5da43b58311c934acccee21e2aed483fe3695c008706466a729200e0dfd141a\": container with ID starting with e5da43b58311c934acccee21e2aed483fe3695c008706466a729200e0dfd141a not found: ID does not exist"
Jul 02 20:50:57.867603 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:57.867564    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"]
Jul 02 20:50:57.869657 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:57.869637    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ntnw"]
Jul 02 20:50:58.299799 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:50:58.299746    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a24bfaad-462c-4f66-9231-c03f1932720d" path="/var/lib/kubelet/pods/a24bfaad-462c-4f66-9231-c03f1932720d/volumes"
Jul 02 20:51:02.982040 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:51:02.982003    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:51:03.043620 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:51:03.043585    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:52:36.359369 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:52:36.359340    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 20:52:36.363048 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:52:36.363026    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 20:57:03.980805 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:57:03.980749    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:24.232103 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:57:24.232070    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:29.860932 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:57:29.860897    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:29.961493 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:57:29.961459    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:36.392157 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:57:36.392125    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 20:57:36.397241 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:57:36.397218    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 20:57:39.740686 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:57:39.740651    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:42.358108 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:57:42.358072    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:49.481807 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:57:49.481751    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:53.407346 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:57:53.407283    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:57.751294 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:57:57.751263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:02.905265 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:02.905227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:05.891933 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:05.891894    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:05.993213 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:05.993184    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:06.465362 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:06.465331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:12.021242 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:12.021194    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:12.122692 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:12.122658    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:12.235060 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:12.235020    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:12.331779 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:12.331669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:13.514784 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.514742    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:13.590165 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.590115    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:13.591566 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.591545    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"]
Jul 02 20:58:13.591907 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.591894    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a24bfaad-462c-4f66-9231-c03f1932720d" containerName="manager"
Jul 02 20:58:13.591955 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.591908    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a24bfaad-462c-4f66-9231-c03f1932720d" containerName="manager"
Jul 02 20:58:13.591996 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.591973    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a24bfaad-462c-4f66-9231-c03f1932720d" containerName="manager"
Jul 02 20:58:13.594851 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.594830    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"
Jul 02 20:58:13.597545 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.597527    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-d75a2d72-serving-cert\""
Jul 02 20:58:13.597738 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.597724    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-k4crx\""
Jul 02 20:58:13.611275 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.611250    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"]
Jul 02 20:58:13.684417 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.684382    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:13.728626 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.728588    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e4a64d-0a6b-4db1-a70f-6db1730fb347-openshift-service-ca\") pod \"maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb\" (UID: \"15e4a64d-0a6b-4db1-a70f-6db1730fb347\") " pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"
Jul 02 20:58:13.728844 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.728637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e4a64d-0a6b-4db1-a70f-6db1730fb347-maas-api-tls\") pod \"maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb\" (UID: \"15e4a64d-0a6b-4db1-a70f-6db1730fb347\") " pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"
Jul 02 20:58:13.728844 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.728737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6zx4\" (UniqueName: \"kubernetes.io/projected/15e4a64d-0a6b-4db1-a70f-6db1730fb347-kube-api-access-l6zx4\") pod \"maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb\" (UID: \"15e4a64d-0a6b-4db1-a70f-6db1730fb347\") " pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"
Jul 02 20:58:13.829468 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.829382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e4a64d-0a6b-4db1-a70f-6db1730fb347-openshift-service-ca\") pod \"maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb\" (UID: \"15e4a64d-0a6b-4db1-a70f-6db1730fb347\") " pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"
Jul 02 20:58:13.829468 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.829429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e4a64d-0a6b-4db1-a70f-6db1730fb347-maas-api-tls\") pod \"maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb\" (UID: \"15e4a64d-0a6b-4db1-a70f-6db1730fb347\") " pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"
Jul 02 20:58:13.829688 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.829482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6zx4\" (UniqueName: \"kubernetes.io/projected/15e4a64d-0a6b-4db1-a70f-6db1730fb347-kube-api-access-l6zx4\") pod \"maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb\" (UID: \"15e4a64d-0a6b-4db1-a70f-6db1730fb347\") " pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"
Jul 02 20:58:13.830038 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.830014    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e4a64d-0a6b-4db1-a70f-6db1730fb347-openshift-service-ca\") pod \"maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb\" (UID: \"15e4a64d-0a6b-4db1-a70f-6db1730fb347\") " pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"
Jul 02 20:58:13.831869 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.831848    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e4a64d-0a6b-4db1-a70f-6db1730fb347-maas-api-tls\") pod \"maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb\" (UID: \"15e4a64d-0a6b-4db1-a70f-6db1730fb347\") " pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"
Jul 02 20:58:13.842653 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.842621    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6zx4\" (UniqueName: \"kubernetes.io/projected/15e4a64d-0a6b-4db1-a70f-6db1730fb347-kube-api-access-l6zx4\") pod \"maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb\" (UID: \"15e4a64d-0a6b-4db1-a70f-6db1730fb347\") " pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"
Jul 02 20:58:13.866891 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.866860    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:13.913893 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:13.913865    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"
Jul 02 20:58:14.254000 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:14.253972    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"]
Jul 02 20:58:14.255180 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:58:14.255156    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e4a64d_0a6b_4db1_a70f_6db1730fb347.slice/crio-a67184af76387319ad728935f05ae948ab3d3ab1c0ad94d647d626c2684d0162 WatchSource:0}: Error finding container a67184af76387319ad728935f05ae948ab3d3ab1c0ad94d647d626c2684d0162: Status 404 returned error can't find the container with id a67184af76387319ad728935f05ae948ab3d3ab1c0ad94d647d626c2684d0162
Jul 02 20:58:14.256552 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:14.256522    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:58:14.710544 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:14.710509    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:14.806719 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:14.806684    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:15.073339 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:15.073241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb" event={"ID":"15e4a64d-0a6b-4db1-a70f-6db1730fb347","Type":"ContainerStarted","Data":"a67184af76387319ad728935f05ae948ab3d3ab1c0ad94d647d626c2684d0162"}
Jul 02 20:58:15.758914 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:15.758820    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:16.081400 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:16.081360    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb" event={"ID":"15e4a64d-0a6b-4db1-a70f-6db1730fb347","Type":"ContainerStarted","Data":"6008ad916e3098698814a48cd0c97630935c6f86674d7d6fcebea575a81e28e0"}
Jul 02 20:58:16.081557 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:16.081471    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"
Jul 02 20:58:16.100193 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:16.100143    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb" podStartSLOduration=1.415699099 podStartE2EDuration="3.100128929s" totalImagesPullingTime="1.68442983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:58:16.09786609 +0000 UTC m=+1540.220877663" watchObservedRunningTime="2026-07-02 20:58:16.100128929 +0000 UTC m=+1540.223140515"
Jul 02 20:58:18.705615 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:18.705582    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:18.858679 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:18.858645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:18.958318 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:18.958234    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:19.039875 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:19.039840    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"]
Jul 02 20:58:19.040133 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:19.040078    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb" podUID="15e4a64d-0a6b-4db1-a70f-6db1730fb347" containerName="maas-api" containerID="cri-o://6008ad916e3098698814a48cd0c97630935c6f86674d7d6fcebea575a81e28e0" gracePeriod=30
Jul 02 20:58:19.063221 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:19.063198    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:19.287337 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:19.287312    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"
Jul 02 20:58:19.384201 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:19.384175    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e4a64d-0a6b-4db1-a70f-6db1730fb347-openshift-service-ca\") pod \"15e4a64d-0a6b-4db1-a70f-6db1730fb347\" (UID: \"15e4a64d-0a6b-4db1-a70f-6db1730fb347\") "
Jul 02 20:58:19.384368 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:19.384240    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e4a64d-0a6b-4db1-a70f-6db1730fb347-maas-api-tls\") pod \"15e4a64d-0a6b-4db1-a70f-6db1730fb347\" (UID: \"15e4a64d-0a6b-4db1-a70f-6db1730fb347\") "
Jul 02 20:58:19.384368 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:19.384271    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6zx4\" (UniqueName: \"kubernetes.io/projected/15e4a64d-0a6b-4db1-a70f-6db1730fb347-kube-api-access-l6zx4\") pod \"15e4a64d-0a6b-4db1-a70f-6db1730fb347\" (UID: \"15e4a64d-0a6b-4db1-a70f-6db1730fb347\") "
Jul 02 20:58:19.384605 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:19.384581    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15e4a64d-0a6b-4db1-a70f-6db1730fb347-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "15e4a64d-0a6b-4db1-a70f-6db1730fb347" (UID: "15e4a64d-0a6b-4db1-a70f-6db1730fb347"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:58:19.386423 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:19.386397    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15e4a64d-0a6b-4db1-a70f-6db1730fb347-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "15e4a64d-0a6b-4db1-a70f-6db1730fb347" (UID: "15e4a64d-0a6b-4db1-a70f-6db1730fb347"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:58:19.386517 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:19.386479    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15e4a64d-0a6b-4db1-a70f-6db1730fb347-kube-api-access-l6zx4" (OuterVolumeSpecName: "kube-api-access-l6zx4") pod "15e4a64d-0a6b-4db1-a70f-6db1730fb347" (UID: "15e4a64d-0a6b-4db1-a70f-6db1730fb347"). InnerVolumeSpecName "kube-api-access-l6zx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:58:19.485865 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:19.485832    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e4a64d-0a6b-4db1-a70f-6db1730fb347-openshift-service-ca\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:58:19.485865 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:19.485866    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e4a64d-0a6b-4db1-a70f-6db1730fb347-maas-api-tls\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:58:19.486133 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:19.485881    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6zx4\" (UniqueName: \"kubernetes.io/projected/15e4a64d-0a6b-4db1-a70f-6db1730fb347-kube-api-access-l6zx4\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:58:20.103222 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:20.103185    2565 generic.go:356] "Generic (PLEG): container finished" podID="15e4a64d-0a6b-4db1-a70f-6db1730fb347" containerID="6008ad916e3098698814a48cd0c97630935c6f86674d7d6fcebea575a81e28e0" exitCode=0
Jul 02 20:58:20.103596 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:20.103233    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"
Jul 02 20:58:20.103596 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:20.103268    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb" event={"ID":"15e4a64d-0a6b-4db1-a70f-6db1730fb347","Type":"ContainerDied","Data":"6008ad916e3098698814a48cd0c97630935c6f86674d7d6fcebea575a81e28e0"}
Jul 02 20:58:20.103596 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:20.103342    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb" event={"ID":"15e4a64d-0a6b-4db1-a70f-6db1730fb347","Type":"ContainerDied","Data":"a67184af76387319ad728935f05ae948ab3d3ab1c0ad94d647d626c2684d0162"}
Jul 02 20:58:20.103596 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:20.103355    2565 scope.go:117] "RemoveContainer" containerID="6008ad916e3098698814a48cd0c97630935c6f86674d7d6fcebea575a81e28e0"
Jul 02 20:58:20.112940 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:20.112924    2565 scope.go:117] "RemoveContainer" containerID="6008ad916e3098698814a48cd0c97630935c6f86674d7d6fcebea575a81e28e0"
Jul 02 20:58:20.113209 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:58:20.113190    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6008ad916e3098698814a48cd0c97630935c6f86674d7d6fcebea575a81e28e0\": container with ID starting with 6008ad916e3098698814a48cd0c97630935c6f86674d7d6fcebea575a81e28e0 not found: ID does not exist" containerID="6008ad916e3098698814a48cd0c97630935c6f86674d7d6fcebea575a81e28e0"
Jul 02 20:58:20.113256 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:20.113218    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6008ad916e3098698814a48cd0c97630935c6f86674d7d6fcebea575a81e28e0"} err="failed to get container status \"6008ad916e3098698814a48cd0c97630935c6f86674d7d6fcebea575a81e28e0\": rpc error: code = NotFound desc = could not find container \"6008ad916e3098698814a48cd0c97630935c6f86674d7d6fcebea575a81e28e0\": container with ID starting with 6008ad916e3098698814a48cd0c97630935c6f86674d7d6fcebea575a81e28e0 not found: ID does not exist"
Jul 02 20:58:20.125136 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:20.125111    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"]
Jul 02 20:58:20.128603 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:20.128584    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-d75a2d72-5d8cc67b87-j2ljb"]
Jul 02 20:58:20.298839 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:20.298803    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15e4a64d-0a6b-4db1-a70f-6db1730fb347" path="/var/lib/kubelet/pods/15e4a64d-0a6b-4db1-a70f-6db1730fb347/volumes"
Jul 02 20:58:21.407281 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:21.407204    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:24.563721 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.563687    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:24.666057 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.666014    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:24.732852 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.732822    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"]
Jul 02 20:58:24.733239 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.733221    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e4a64d-0a6b-4db1-a70f-6db1730fb347" containerName="maas-api"
Jul 02 20:58:24.733330 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.733241    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e4a64d-0a6b-4db1-a70f-6db1730fb347" containerName="maas-api"
Jul 02 20:58:24.733384 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.733344    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e4a64d-0a6b-4db1-a70f-6db1730fb347" containerName="maas-api"
Jul 02 20:58:24.739832 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.738327    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.741506 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.741469    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 20:58:24.741717 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.741696    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-eac2ac97-openshift-default-dockercfg-pw49r\""
Jul 02 20:58:24.747807 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.747778    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"]
Jul 02 20:58:24.802225 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.802193    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:24.833917 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.833855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-data\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.833917 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.833886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnnz4\" (UniqueName: \"kubernetes.io/projected/08d85eba-c999-4740-84ab-4fc9cb73dad2-kube-api-access-hnnz4\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.834062 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.833917    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-workload-socket\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.834062 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.833989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-credential-socket\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.834062 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.834026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-podinfo\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.834062 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.834044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-token\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.834188 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.834132    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-envoy\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.834188 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.834153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08d85eba-c999-4740-84ab-4fc9cb73dad2-istiod-ca-cert\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.834188 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.834171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-workload-certs\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.927410 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.927375    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:24.934982 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.934958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-podinfo\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.935115 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.934986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-token\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.935115 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.935024    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-envoy\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.935226 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.935134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08d85eba-c999-4740-84ab-4fc9cb73dad2-istiod-ca-cert\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.935226 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.935165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-workload-certs\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.935337 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.935246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-data\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.935337 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.935281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnnz4\" (UniqueName: \"kubernetes.io/projected/08d85eba-c999-4740-84ab-4fc9cb73dad2-kube-api-access-hnnz4\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.935337 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.935331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-workload-socket\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.935496 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.935371    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-credential-socket\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.935602 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.935570    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-workload-certs\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.935739 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.935709    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-data\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.935843 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.935819    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-credential-socket\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.935896 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.935860    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-workload-socket\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.935969 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.935948    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08d85eba-c999-4740-84ab-4fc9cb73dad2-istiod-ca-cert\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.937360 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.937340    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-envoy\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.937585 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.937567    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-podinfo\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.946693 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.946669    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-token\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:24.946820 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:24.946779    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnnz4\" (UniqueName: \"kubernetes.io/projected/08d85eba-c999-4740-84ab-4fc9cb73dad2-kube-api-access-hnnz4\") pod \"e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") " pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:25.053492 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:25.053459    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:25.190708 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:25.190684    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"]
Jul 02 20:58:25.192316 ip-10-0-133-123 kubenswrapper[2565]: W0702 20:58:25.192286    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d85eba_c999_4740_84ab_4fc9cb73dad2.slice/crio-bdcdbbfb8ffd155529895d17d41301724d0d481244ff8cd6b8a6f54c89e7bc8c WatchSource:0}: Error finding container bdcdbbfb8ffd155529895d17d41301724d0d481244ff8cd6b8a6f54c89e7bc8c: Status 404 returned error can't find the container with id bdcdbbfb8ffd155529895d17d41301724d0d481244ff8cd6b8a6f54c89e7bc8c
Jul 02 20:58:26.004983 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:26.004941    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:26.098847 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:26.098812    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:26.142124 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:26.142095    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9" event={"ID":"08d85eba-c999-4740-84ab-4fc9cb73dad2","Type":"ContainerStarted","Data":"bdcdbbfb8ffd155529895d17d41301724d0d481244ff8cd6b8a6f54c89e7bc8c"}
Jul 02 20:58:26.170042 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:26.170011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:26.267052 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:26.266962    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:26.538800 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:26.538694    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:26.644343 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:26.644307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:28.049407 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:28.049356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:30.415366 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:30.415328    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 20:58:30.415736 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:30.415409    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 20:58:30.415736 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:30.415455    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 20:58:31.178655 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:31.178611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9" event={"ID":"08d85eba-c999-4740-84ab-4fc9cb73dad2","Type":"ContainerStarted","Data":"a42c7f071f24ddcef91e88969cd24ea0e1b0243a4fa86d2a8e4755fd3fbaba86"}
Jul 02 20:58:31.199497 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:31.199417    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9" podStartSLOduration=1.97857499 podStartE2EDuration="7.199399944s" totalImagesPullingTime="5.220824954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:58:31.198390551 +0000 UTC m=+1555.321402122" watchObservedRunningTime="2026-07-02 20:58:31.199399944 +0000 UTC m=+1555.322411516"
Jul 02 20:58:31.200305 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:31.200281    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:31.596420 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:31.596385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:32.054016 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:32.053932    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:33.094955 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:33.094913    2565 patch_prober.go:28] interesting pod/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 02 20:58:33.095317 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:33.094981    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9" podUID="08d85eba-c999-4740-84ab-4fc9cb73dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 20:58:34.125067 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:34.125003    2565 patch_prober.go:28] interesting pod/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 02 20:58:34.125711 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:34.125670    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9" podUID="08d85eba-c999-4740-84ab-4fc9cb73dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 20:58:35.127528 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:35.127103    2565 patch_prober.go:28] interesting pod/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 02 20:58:35.127528 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:35.127187    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9" podUID="08d85eba-c999-4740-84ab-4fc9cb73dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 20:58:36.168901 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:36.168868    2565 patch_prober.go:28] interesting pod/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 02 20:58:36.169339 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:36.168918    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9" podUID="08d85eba-c999-4740-84ab-4fc9cb73dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 20:58:37.209909 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:37.209876    2565 patch_prober.go:28] interesting pod/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 02 20:58:37.210329 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:37.209924    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9" podUID="08d85eba-c999-4740-84ab-4fc9cb73dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 20:58:37.574569 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:37.574490    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"]
Jul 02 20:58:37.574701 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:37.574660    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9" podUID="08d85eba-c999-4740-84ab-4fc9cb73dad2" containerName="istio-proxy" containerID="cri-o://a42c7f071f24ddcef91e88969cd24ea0e1b0243a4fa86d2a8e4755fd3fbaba86" gracePeriod=30
Jul 02 20:58:37.597873 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:37.597844    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:37.709043 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:37.708994    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:38.229319 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.228219    2565 patch_prober.go:28] interesting pod/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 02 20:58:38.229319 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.228294    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9" podUID="08d85eba-c999-4740-84ab-4fc9cb73dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 20:58:38.229319 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.228546    2565 patch_prober.go:28] interesting pod/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 02 20:58:38.229319 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.228581    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9" podUID="08d85eba-c999-4740-84ab-4fc9cb73dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 02 20:58:38.419844 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.419785    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:38.560463 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.560380    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-podinfo\") pod \"08d85eba-c999-4740-84ab-4fc9cb73dad2\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") "
Jul 02 20:58:38.560463 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.560425    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-envoy\") pod \"08d85eba-c999-4740-84ab-4fc9cb73dad2\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") "
Jul 02 20:58:38.560463 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.560451    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-token\") pod \"08d85eba-c999-4740-84ab-4fc9cb73dad2\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") "
Jul 02 20:58:38.560710 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.560475    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-data\") pod \"08d85eba-c999-4740-84ab-4fc9cb73dad2\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") "
Jul 02 20:58:38.560710 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.560491    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnnz4\" (UniqueName: \"kubernetes.io/projected/08d85eba-c999-4740-84ab-4fc9cb73dad2-kube-api-access-hnnz4\") pod \"08d85eba-c999-4740-84ab-4fc9cb73dad2\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") "
Jul 02 20:58:38.560710 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.560513    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-workload-certs\") pod \"08d85eba-c999-4740-84ab-4fc9cb73dad2\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") "
Jul 02 20:58:38.560710 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.560543    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08d85eba-c999-4740-84ab-4fc9cb73dad2-istiod-ca-cert\") pod \"08d85eba-c999-4740-84ab-4fc9cb73dad2\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") "
Jul 02 20:58:38.560710 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.560592    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-workload-socket\") pod \"08d85eba-c999-4740-84ab-4fc9cb73dad2\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") "
Jul 02 20:58:38.560710 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.560640    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-credential-socket\") pod \"08d85eba-c999-4740-84ab-4fc9cb73dad2\" (UID: \"08d85eba-c999-4740-84ab-4fc9cb73dad2\") "
Jul 02 20:58:38.561319 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.560950    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "08d85eba-c999-4740-84ab-4fc9cb73dad2" (UID: "08d85eba-c999-4740-84ab-4fc9cb73dad2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:58:38.561319 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.561122    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08d85eba-c999-4740-84ab-4fc9cb73dad2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "08d85eba-c999-4740-84ab-4fc9cb73dad2" (UID: "08d85eba-c999-4740-84ab-4fc9cb73dad2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:58:38.561319 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.561142    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "08d85eba-c999-4740-84ab-4fc9cb73dad2" (UID: "08d85eba-c999-4740-84ab-4fc9cb73dad2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:58:38.561319 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.561287    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "08d85eba-c999-4740-84ab-4fc9cb73dad2" (UID: "08d85eba-c999-4740-84ab-4fc9cb73dad2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:58:38.561594 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.561442    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-data" (OuterVolumeSpecName: "istio-data") pod "08d85eba-c999-4740-84ab-4fc9cb73dad2" (UID: "08d85eba-c999-4740-84ab-4fc9cb73dad2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:58:38.562882 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.562858    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08d85eba-c999-4740-84ab-4fc9cb73dad2-kube-api-access-hnnz4" (OuterVolumeSpecName: "kube-api-access-hnnz4") pod "08d85eba-c999-4740-84ab-4fc9cb73dad2" (UID: "08d85eba-c999-4740-84ab-4fc9cb73dad2"). InnerVolumeSpecName "kube-api-access-hnnz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:58:38.562882 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.562874    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-token" (OuterVolumeSpecName: "istio-token") pod "08d85eba-c999-4740-84ab-4fc9cb73dad2" (UID: "08d85eba-c999-4740-84ab-4fc9cb73dad2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:58:38.563038 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.563007    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "08d85eba-c999-4740-84ab-4fc9cb73dad2" (UID: "08d85eba-c999-4740-84ab-4fc9cb73dad2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 20:58:38.563086 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.563028    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "08d85eba-c999-4740-84ab-4fc9cb73dad2" (UID: "08d85eba-c999-4740-84ab-4fc9cb73dad2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:58:38.661617 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.661585    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-podinfo\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:58:38.661617 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.661611    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-envoy\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:58:38.661617 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.661620    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-token\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:58:38.661617 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.661628    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-istio-data\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:58:38.661901 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.661637    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnnz4\" (UniqueName: \"kubernetes.io/projected/08d85eba-c999-4740-84ab-4fc9cb73dad2-kube-api-access-hnnz4\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:58:38.661901 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.661646    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-workload-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:58:38.661901 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.661653    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08d85eba-c999-4740-84ab-4fc9cb73dad2-istiod-ca-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:58:38.661901 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.661661    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-workload-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:58:38.661901 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:38.661670    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08d85eba-c999-4740-84ab-4fc9cb73dad2-credential-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 20:58:39.221000 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:39.220965    2565 generic.go:356] "Generic (PLEG): container finished" podID="08d85eba-c999-4740-84ab-4fc9cb73dad2" containerID="a42c7f071f24ddcef91e88969cd24ea0e1b0243a4fa86d2a8e4755fd3fbaba86" exitCode=0
Jul 02 20:58:39.221187 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:39.221012    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"
Jul 02 20:58:39.221187 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:39.221054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9" event={"ID":"08d85eba-c999-4740-84ab-4fc9cb73dad2","Type":"ContainerDied","Data":"a42c7f071f24ddcef91e88969cd24ea0e1b0243a4fa86d2a8e4755fd3fbaba86"}
Jul 02 20:58:39.221187 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:39.221107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9" event={"ID":"08d85eba-c999-4740-84ab-4fc9cb73dad2","Type":"ContainerDied","Data":"bdcdbbfb8ffd155529895d17d41301724d0d481244ff8cd6b8a6f54c89e7bc8c"}
Jul 02 20:58:39.221187 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:39.221133    2565 scope.go:117] "RemoveContainer" containerID="a42c7f071f24ddcef91e88969cd24ea0e1b0243a4fa86d2a8e4755fd3fbaba86"
Jul 02 20:58:39.236687 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:39.236668    2565 scope.go:117] "RemoveContainer" containerID="a42c7f071f24ddcef91e88969cd24ea0e1b0243a4fa86d2a8e4755fd3fbaba86"
Jul 02 20:58:39.237013 ip-10-0-133-123 kubenswrapper[2565]: E0702 20:58:39.236952    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a42c7f071f24ddcef91e88969cd24ea0e1b0243a4fa86d2a8e4755fd3fbaba86\": container with ID starting with a42c7f071f24ddcef91e88969cd24ea0e1b0243a4fa86d2a8e4755fd3fbaba86 not found: ID does not exist" containerID="a42c7f071f24ddcef91e88969cd24ea0e1b0243a4fa86d2a8e4755fd3fbaba86"
Jul 02 20:58:39.237013 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:39.236980    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a42c7f071f24ddcef91e88969cd24ea0e1b0243a4fa86d2a8e4755fd3fbaba86"} err="failed to get container status \"a42c7f071f24ddcef91e88969cd24ea0e1b0243a4fa86d2a8e4755fd3fbaba86\": rpc error: code = NotFound desc = could not find container \"a42c7f071f24ddcef91e88969cd24ea0e1b0243a4fa86d2a8e4755fd3fbaba86\": container with ID starting with a42c7f071f24ddcef91e88969cd24ea0e1b0243a4fa86d2a8e4755fd3fbaba86 not found: ID does not exist"
Jul 02 20:58:39.246556 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:39.246534    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"]
Jul 02 20:58:39.250043 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:39.250019    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-eac2ac97-openshift-default-555b5dff85-vnnd9"]
Jul 02 20:58:39.347853 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:39.347824    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:40.298373 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:40.298341    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08d85eba-c999-4740-84ab-4fc9cb73dad2" path="/var/lib/kubelet/pods/08d85eba-c999-4740-84ab-4fc9cb73dad2/volumes"
Jul 02 20:58:43.262504 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:43.262467    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:43.319530 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:43.319496    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:43.465456 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:43.465426    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:43.527825 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:43.527735    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:44.651050 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:44.651019    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:44.729166 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:44.729136    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:44.790346 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:44.790313    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:44.959002 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:44.958926    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:45.262817 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:45.262734    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:45.363967 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:45.363932    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:47.142485 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:47.142455    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:49.145041 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:49.145007    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:49.352298 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:49.352264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:49.461273 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:49.461188    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:49.561210 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:49.561179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:52.619660 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:52.619629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:55.374370 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:55.374334    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:55.436210 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:55.436181    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:55.877554 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:55.877523    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:55.977804 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:55.977768    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:56.078870 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:56.078841    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:57.607907 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:58:57.607872    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:03.323590 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:59:03.323555    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:03.382926 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:59:03.382892    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:03.447222 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:59:03.447164    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:03.546960 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:59:03.546922    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:03.646847 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:59:03.646815    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:04.064400 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:59:04.064323    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:30.038368 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:59:30.038282    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:35.834234 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:59:35.834203    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:35.898306 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:59:35.898271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:35.979540 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:59:35.979507    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:36.078980 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:59:36.078942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:51.994096 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:59:51.994061    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:57.881371 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:59:57.881336    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:57.984744 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:59:57.984709    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:58.081483 ip-10-0-133-123 kubenswrapper[2565]: I0702 20:59:58.081444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:00.137173 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:00.137140    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717100-p98rz"]
Jul 02 21:00:00.137551 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:00.137488    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08d85eba-c999-4740-84ab-4fc9cb73dad2" containerName="istio-proxy"
Jul 02 21:00:00.137551 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:00.137499    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="08d85eba-c999-4740-84ab-4fc9cb73dad2" containerName="istio-proxy"
Jul 02 21:00:00.137625 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:00.137556    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="08d85eba-c999-4740-84ab-4fc9cb73dad2" containerName="istio-proxy"
Jul 02 21:00:00.140619 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:00.140604    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717100-p98rz"
Jul 02 21:00:00.142959 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:00.142936    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-k4crx\""
Jul 02 21:00:00.148547 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:00.148522    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717100-p98rz"]
Jul 02 21:00:00.195608 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:00.195581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqm2j\" (UniqueName: \"kubernetes.io/projected/cf376f1e-dc1b-4a18-b019-5a2511b735b7-kube-api-access-rqm2j\") pod \"maas-api-key-cleanup-29717100-p98rz\" (UID: \"cf376f1e-dc1b-4a18-b019-5a2511b735b7\") " pod="opendatahub/maas-api-key-cleanup-29717100-p98rz"
Jul 02 21:00:00.296702 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:00.296666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqm2j\" (UniqueName: \"kubernetes.io/projected/cf376f1e-dc1b-4a18-b019-5a2511b735b7-kube-api-access-rqm2j\") pod \"maas-api-key-cleanup-29717100-p98rz\" (UID: \"cf376f1e-dc1b-4a18-b019-5a2511b735b7\") " pod="opendatahub/maas-api-key-cleanup-29717100-p98rz"
Jul 02 21:00:00.304919 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:00.304892    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqm2j\" (UniqueName: \"kubernetes.io/projected/cf376f1e-dc1b-4a18-b019-5a2511b735b7-kube-api-access-rqm2j\") pod \"maas-api-key-cleanup-29717100-p98rz\" (UID: \"cf376f1e-dc1b-4a18-b019-5a2511b735b7\") " pod="opendatahub/maas-api-key-cleanup-29717100-p98rz"
Jul 02 21:00:00.451922 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:00.451842    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717100-p98rz"
Jul 02 21:00:00.583397 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:00.583367    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717100-p98rz"]
Jul 02 21:00:00.586272 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:00:00.586246    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf376f1e_dc1b_4a18_b019_5a2511b735b7.slice/crio-b8101e178bc09a060fc600596d0f497fd1cfb6179c72e10a10d040a0beea5f4e WatchSource:0}: Error finding container b8101e178bc09a060fc600596d0f497fd1cfb6179c72e10a10d040a0beea5f4e: Status 404 returned error can't find the container with id b8101e178bc09a060fc600596d0f497fd1cfb6179c72e10a10d040a0beea5f4e
Jul 02 21:00:00.640886 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:00.640856    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717100-p98rz" event={"ID":"cf376f1e-dc1b-4a18-b019-5a2511b735b7","Type":"ContainerStarted","Data":"b8101e178bc09a060fc600596d0f497fd1cfb6179c72e10a10d040a0beea5f4e"}
Jul 02 21:00:08.628514 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:08.628480    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:09.482708 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:09.482673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:15.108302 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:15.108262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:15.214435 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:15.214393    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:15.310983 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:15.310945    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:15.408847 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:15.408737    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:16.239599 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:16.239564    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:16.334488 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:16.334460    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:16.434103 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:16.434066    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:18.122379 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:18.122348    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:19.740098 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:19.740063    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf376f1e-dc1b-4a18-b019-5a2511b735b7" containerID="f813f1654b91127e8280440574b702538e5c6d31264f813320d3757f36749443" exitCode=0
Jul 02 21:00:19.740469 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:19.740122    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717100-p98rz" event={"ID":"cf376f1e-dc1b-4a18-b019-5a2511b735b7","Type":"ContainerDied","Data":"f813f1654b91127e8280440574b702538e5c6d31264f813320d3757f36749443"}
Jul 02 21:00:20.875174 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:20.875146    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717100-p98rz"
Jul 02 21:00:20.986328 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:20.986293    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqm2j\" (UniqueName: \"kubernetes.io/projected/cf376f1e-dc1b-4a18-b019-5a2511b735b7-kube-api-access-rqm2j\") pod \"cf376f1e-dc1b-4a18-b019-5a2511b735b7\" (UID: \"cf376f1e-dc1b-4a18-b019-5a2511b735b7\") "
Jul 02 21:00:20.988331 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:20.988304    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf376f1e-dc1b-4a18-b019-5a2511b735b7-kube-api-access-rqm2j" (OuterVolumeSpecName: "kube-api-access-rqm2j") pod "cf376f1e-dc1b-4a18-b019-5a2511b735b7" (UID: "cf376f1e-dc1b-4a18-b019-5a2511b735b7"). InnerVolumeSpecName "kube-api-access-rqm2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:00:21.087147 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:21.087064    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqm2j\" (UniqueName: \"kubernetes.io/projected/cf376f1e-dc1b-4a18-b019-5a2511b735b7-kube-api-access-rqm2j\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:00:21.751996 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:21.751966    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717100-p98rz"
Jul 02 21:00:21.751996 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:21.751965    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717100-p98rz" event={"ID":"cf376f1e-dc1b-4a18-b019-5a2511b735b7","Type":"ContainerDied","Data":"b8101e178bc09a060fc600596d0f497fd1cfb6179c72e10a10d040a0beea5f4e"}
Jul 02 21:00:21.752208 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:21.752049    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8101e178bc09a060fc600596d0f497fd1cfb6179c72e10a10d040a0beea5f4e"
Jul 02 21:00:23.845596 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:23.845559    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:23.907196 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:23.907164    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:24.545130 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:24.545101    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:30.225977 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.225940    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:30.283858 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.283825    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:30.467493 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.467464    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:30.837909 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.837874    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"]
Jul 02 21:00:30.838250 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.838238    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf376f1e-dc1b-4a18-b019-5a2511b735b7" containerName="cleanup"
Jul 02 21:00:30.838304 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.838252    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf376f1e-dc1b-4a18-b019-5a2511b735b7" containerName="cleanup"
Jul 02 21:00:30.838357 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.838319    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf376f1e-dc1b-4a18-b019-5a2511b735b7" containerName="cleanup"
Jul 02 21:00:30.841390 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.841370    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.844080 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.844062    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3ef915bc-openshift-default-dockercfg-ssggx\""
Jul 02 21:00:30.844198 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.844115    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 21:00:30.853537 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.853518    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"]
Jul 02 21:00:30.862767 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.862730    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:30.868905 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.868884    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-workload-certs\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.869020 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.868913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-data\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.869020 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.868935    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-token\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.869020 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.868952    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-workload-socket\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.869139 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.869016    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-podinfo\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.869139 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.869078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-credential-socket\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.869139 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.869102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzpmp\" (UniqueName: \"kubernetes.io/projected/d6304473-9033-4fbb-a28a-af3266e99c2f-kube-api-access-xzpmp\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.869246 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.869162    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-envoy\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.869246 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.869217    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6304473-9033-4fbb-a28a-af3266e99c2f-istiod-ca-cert\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.970654 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.970619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6304473-9033-4fbb-a28a-af3266e99c2f-istiod-ca-cert\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.970859 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.970678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-workload-certs\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.970859 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.970704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-data\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.970859 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.970727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-token\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.970859 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.970745    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-workload-socket\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.970859 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.970790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-podinfo\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.971123 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.970949    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-credential-socket\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.971123 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.970995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzpmp\" (UniqueName: \"kubernetes.io/projected/d6304473-9033-4fbb-a28a-af3266e99c2f-kube-api-access-xzpmp\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.971123 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.971047    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-envoy\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.971289 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.971143    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-workload-socket\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.971289 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.971210    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-data\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.971396 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.971309    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-credential-socket\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.971396 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.971378    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6304473-9033-4fbb-a28a-af3266e99c2f-istiod-ca-cert\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.971493 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.971473    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-workload-certs\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.973300 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.973277    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-envoy\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.973417 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.973400    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-podinfo\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.985952 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.985928    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-token\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:30.986640 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:30.986619    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzpmp\" (UniqueName: \"kubernetes.io/projected/d6304473-9033-4fbb-a28a-af3266e99c2f-kube-api-access-xzpmp\") pod \"e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") " pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:31.151268 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:31.151233    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:31.278973 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:31.278941    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:31.286812 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:31.286793    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"]
Jul 02 21:00:31.288384 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:00:31.288361    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6304473_9033_4fbb_a28a_af3266e99c2f.slice/crio-3c322879de5c23548385655ca170210a93fde2f707e40bae4aac8d79a86907f5 WatchSource:0}: Error finding container 3c322879de5c23548385655ca170210a93fde2f707e40bae4aac8d79a86907f5: Status 404 returned error can't find the container with id 3c322879de5c23548385655ca170210a93fde2f707e40bae4aac8d79a86907f5
Jul 02 21:00:31.290327 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:31.290296    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:00:31.290425 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:31.290356    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:00:31.290425 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:31.290385    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:00:31.812980 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:31.812949    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c" event={"ID":"d6304473-9033-4fbb-a28a-af3266e99c2f","Type":"ContainerStarted","Data":"4097093b0f91845ed37813b7a6eee189f25a3c193d5ef1dee55438f18717707e"}
Jul 02 21:00:31.813140 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:31.813000    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c" event={"ID":"d6304473-9033-4fbb-a28a-af3266e99c2f","Type":"ContainerStarted","Data":"3c322879de5c23548385655ca170210a93fde2f707e40bae4aac8d79a86907f5"}
Jul 02 21:00:31.835148 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:31.835103    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c" podStartSLOduration=1.8350868569999998 podStartE2EDuration="1.835086857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:00:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:00:31.833571288 +0000 UTC m=+1675.956582859" watchObservedRunningTime="2026-07-02 21:00:31.835086857 +0000 UTC m=+1675.958098429"
Jul 02 21:00:32.152364 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:32.152325    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:32.157214 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:32.157190    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:32.818619 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:32.818587    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:32.819620 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:32.819601    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:33.916915 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:33.916875    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:33.998996 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:33.998961    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:34.222846 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:34.222746    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:34.322693 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:34.322663    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:34.746945 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:34.746913    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:34.846598 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:34.846564    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:38.499266 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:38.499224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:39.220708 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:39.220673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:39.315843 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:39.315810    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:39.686447 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:39.686407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:45.384947 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:45.384908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:45.486201 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:45.486162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:45.851437 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:45.851400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:46.170547 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:46.170444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:46.416536 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:46.416487    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:46.897090 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:46.897055    2565 generic.go:356] "Generic (PLEG): container finished" podID="d6304473-9033-4fbb-a28a-af3266e99c2f" containerID="4097093b0f91845ed37813b7a6eee189f25a3c193d5ef1dee55438f18717707e" exitCode=0
Jul 02 21:00:46.897271 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:46.897125    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c" event={"ID":"d6304473-9033-4fbb-a28a-af3266e99c2f","Type":"ContainerDied","Data":"4097093b0f91845ed37813b7a6eee189f25a3c193d5ef1dee55438f18717707e"}
Jul 02 21:00:46.897521 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:46.897508    2565 scope.go:117] "RemoveContainer" containerID="4097093b0f91845ed37813b7a6eee189f25a3c193d5ef1dee55438f18717707e"
Jul 02 21:00:46.898451 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:46.898426    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:00:46.898507 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:46.898490    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:00:46.898552 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:46.898522    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:00:47.818867 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:47.818833    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:47.904366 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:47.904334    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c" event={"ID":"d6304473-9033-4fbb-a28a-af3266e99c2f","Type":"ContainerStarted","Data":"6d94a85e53a5f5d40f38e5ea7500136585e44bc65826e8816b2c34aeda9d9fcf"}
Jul 02 21:00:48.152084 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:48.152046    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:48.153247 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:48.153224    2565 patch_prober.go:28] interesting pod/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 02 21:00:48.153314 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:48.153276    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c" podUID="d6304473-9033-4fbb-a28a-af3266e99c2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 02 21:00:49.152567 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:49.152525    2565 patch_prober.go:28] interesting pod/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 02 21:00:49.152993 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:49.152594    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c" podUID="d6304473-9033-4fbb-a28a-af3266e99c2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 02 21:00:50.152250 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:50.152213    2565 patch_prober.go:28] interesting pod/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 02 21:00:50.152437 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:50.152266    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c" podUID="d6304473-9033-4fbb-a28a-af3266e99c2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 02 21:00:51.152660 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:51.152628    2565 patch_prober.go:28] interesting pod/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 02 21:00:51.153069 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:51.152682    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c" podUID="d6304473-9033-4fbb-a28a-af3266e99c2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 02 21:00:52.023622 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:52.023591    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:52.081943 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:52.081911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:52.156219 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:52.156190    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:52.156629 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:52.156565    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:52.157186 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:52.157166    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:52.273157 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:52.273129    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"]
Jul 02 21:00:52.929215 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:52.929184    2565 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c" secret="" err="secret \"e2e-mt-3ef915bc-openshift-default-dockercfg-ssggx\" not found"
Jul 02 21:00:52.957949 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:52.957918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:53.014328 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:53.014292    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:53.934654 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:53.934613    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c" podUID="d6304473-9033-4fbb-a28a-af3266e99c2f" containerName="istio-proxy" containerID="cri-o://6d94a85e53a5f5d40f38e5ea7500136585e44bc65826e8816b2c34aeda9d9fcf" gracePeriod=30
Jul 02 21:00:58.610985 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:58.610910    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:58.714982 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:58.714942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:58.811749 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:58.811716    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:58.974979 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:58.974936    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:59.183715 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.183690    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:59.331169 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.331088    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6304473-9033-4fbb-a28a-af3266e99c2f-istiod-ca-cert\") pod \"d6304473-9033-4fbb-a28a-af3266e99c2f\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") "
Jul 02 21:00:59.331169 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.331151    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-workload-certs\") pod \"d6304473-9033-4fbb-a28a-af3266e99c2f\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") "
Jul 02 21:00:59.331169 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.331170    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzpmp\" (UniqueName: \"kubernetes.io/projected/d6304473-9033-4fbb-a28a-af3266e99c2f-kube-api-access-xzpmp\") pod \"d6304473-9033-4fbb-a28a-af3266e99c2f\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") "
Jul 02 21:00:59.331441 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.331195    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-token\") pod \"d6304473-9033-4fbb-a28a-af3266e99c2f\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") "
Jul 02 21:00:59.331441 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.331301    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-podinfo\") pod \"d6304473-9033-4fbb-a28a-af3266e99c2f\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") "
Jul 02 21:00:59.331441 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.331345    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-workload-socket\") pod \"d6304473-9033-4fbb-a28a-af3266e99c2f\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") "
Jul 02 21:00:59.331441 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.331388    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-data\") pod \"d6304473-9033-4fbb-a28a-af3266e99c2f\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") "
Jul 02 21:00:59.331441 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.331426    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-credential-socket\") pod \"d6304473-9033-4fbb-a28a-af3266e99c2f\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") "
Jul 02 21:00:59.331693 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.331447    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d6304473-9033-4fbb-a28a-af3266e99c2f" (UID: "d6304473-9033-4fbb-a28a-af3266e99c2f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:00:59.331693 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.331478    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-envoy\") pod \"d6304473-9033-4fbb-a28a-af3266e99c2f\" (UID: \"d6304473-9033-4fbb-a28a-af3266e99c2f\") "
Jul 02 21:00:59.331693 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.331524    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6304473-9033-4fbb-a28a-af3266e99c2f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d6304473-9033-4fbb-a28a-af3266e99c2f" (UID: "d6304473-9033-4fbb-a28a-af3266e99c2f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:00:59.331847 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.331718    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d6304473-9033-4fbb-a28a-af3266e99c2f" (UID: "d6304473-9033-4fbb-a28a-af3266e99c2f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:00:59.331889 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.331850    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-credential-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:00:59.331889 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.331848    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d6304473-9033-4fbb-a28a-af3266e99c2f" (UID: "d6304473-9033-4fbb-a28a-af3266e99c2f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:00:59.331889 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.331871    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6304473-9033-4fbb-a28a-af3266e99c2f-istiod-ca-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:00:59.331889 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.331886    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-workload-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:00:59.332660 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.332633    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-data" (OuterVolumeSpecName: "istio-data") pod "d6304473-9033-4fbb-a28a-af3266e99c2f" (UID: "d6304473-9033-4fbb-a28a-af3266e99c2f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:00:59.333419 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.333388    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6304473-9033-4fbb-a28a-af3266e99c2f-kube-api-access-xzpmp" (OuterVolumeSpecName: "kube-api-access-xzpmp") pod "d6304473-9033-4fbb-a28a-af3266e99c2f" (UID: "d6304473-9033-4fbb-a28a-af3266e99c2f"). InnerVolumeSpecName "kube-api-access-xzpmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:00:59.333525 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.333390    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d6304473-9033-4fbb-a28a-af3266e99c2f" (UID: "d6304473-9033-4fbb-a28a-af3266e99c2f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 21:00:59.333591 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.333557    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d6304473-9033-4fbb-a28a-af3266e99c2f" (UID: "d6304473-9033-4fbb-a28a-af3266e99c2f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:00:59.333799 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.333741    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-token" (OuterVolumeSpecName: "istio-token") pod "d6304473-9033-4fbb-a28a-af3266e99c2f" (UID: "d6304473-9033-4fbb-a28a-af3266e99c2f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:00:59.432750 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.432708    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzpmp\" (UniqueName: \"kubernetes.io/projected/d6304473-9033-4fbb-a28a-af3266e99c2f-kube-api-access-xzpmp\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:00:59.432750 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.432744    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-token\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:00:59.432750 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.432775    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-podinfo\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:00:59.433041 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.432795    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-workload-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:00:59.433041 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.432805    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-data\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:00:59.433041 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.432816    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6304473-9033-4fbb-a28a-af3266e99c2f-istio-envoy\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:00:59.969448 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.969414    2565 generic.go:356] "Generic (PLEG): container finished" podID="d6304473-9033-4fbb-a28a-af3266e99c2f" containerID="6d94a85e53a5f5d40f38e5ea7500136585e44bc65826e8816b2c34aeda9d9fcf" exitCode=0
Jul 02 21:00:59.969897 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.969470    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"
Jul 02 21:00:59.969897 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.969473    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c" event={"ID":"d6304473-9033-4fbb-a28a-af3266e99c2f","Type":"ContainerDied","Data":"6d94a85e53a5f5d40f38e5ea7500136585e44bc65826e8816b2c34aeda9d9fcf"}
Jul 02 21:00:59.969897 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.969531    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c" event={"ID":"d6304473-9033-4fbb-a28a-af3266e99c2f","Type":"ContainerDied","Data":"3c322879de5c23548385655ca170210a93fde2f707e40bae4aac8d79a86907f5"}
Jul 02 21:00:59.969897 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.969561    2565 scope.go:117] "RemoveContainer" containerID="6d94a85e53a5f5d40f38e5ea7500136585e44bc65826e8816b2c34aeda9d9fcf"
Jul 02 21:00:59.979093 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.979071    2565 scope.go:117] "RemoveContainer" containerID="4097093b0f91845ed37813b7a6eee189f25a3c193d5ef1dee55438f18717707e"
Jul 02 21:00:59.986903 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.986885    2565 scope.go:117] "RemoveContainer" containerID="6d94a85e53a5f5d40f38e5ea7500136585e44bc65826e8816b2c34aeda9d9fcf"
Jul 02 21:00:59.987139 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:00:59.987122    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d94a85e53a5f5d40f38e5ea7500136585e44bc65826e8816b2c34aeda9d9fcf\": container with ID starting with 6d94a85e53a5f5d40f38e5ea7500136585e44bc65826e8816b2c34aeda9d9fcf not found: ID does not exist" containerID="6d94a85e53a5f5d40f38e5ea7500136585e44bc65826e8816b2c34aeda9d9fcf"
Jul 02 21:00:59.987195 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.987147    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d94a85e53a5f5d40f38e5ea7500136585e44bc65826e8816b2c34aeda9d9fcf"} err="failed to get container status \"6d94a85e53a5f5d40f38e5ea7500136585e44bc65826e8816b2c34aeda9d9fcf\": rpc error: code = NotFound desc = could not find container \"6d94a85e53a5f5d40f38e5ea7500136585e44bc65826e8816b2c34aeda9d9fcf\": container with ID starting with 6d94a85e53a5f5d40f38e5ea7500136585e44bc65826e8816b2c34aeda9d9fcf not found: ID does not exist"
Jul 02 21:00:59.987195 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.987164    2565 scope.go:117] "RemoveContainer" containerID="4097093b0f91845ed37813b7a6eee189f25a3c193d5ef1dee55438f18717707e"
Jul 02 21:00:59.987425 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:00:59.987407    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4097093b0f91845ed37813b7a6eee189f25a3c193d5ef1dee55438f18717707e\": container with ID starting with 4097093b0f91845ed37813b7a6eee189f25a3c193d5ef1dee55438f18717707e not found: ID does not exist" containerID="4097093b0f91845ed37813b7a6eee189f25a3c193d5ef1dee55438f18717707e"
Jul 02 21:00:59.987475 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.987433    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4097093b0f91845ed37813b7a6eee189f25a3c193d5ef1dee55438f18717707e"} err="failed to get container status \"4097093b0f91845ed37813b7a6eee189f25a3c193d5ef1dee55438f18717707e\": rpc error: code = NotFound desc = could not find container \"4097093b0f91845ed37813b7a6eee189f25a3c193d5ef1dee55438f18717707e\": container with ID starting with 4097093b0f91845ed37813b7a6eee189f25a3c193d5ef1dee55438f18717707e not found: ID does not exist"
Jul 02 21:00:59.991150 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.991129    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"]
Jul 02 21:00:59.995618 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:00:59.995596    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3ef915bc-openshift-default-68c4d556f5-5rv6c"]
Jul 02 21:01:00.299306 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:00.299203    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6304473-9033-4fbb-a28a-af3266e99c2f" path="/var/lib/kubelet/pods/d6304473-9033-4fbb-a28a-af3266e99c2f/volumes"
Jul 02 21:01:04.550897 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:04.550868    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:04.614226 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:04.614192    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:11.177924 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.177888    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:11.486076 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.485983    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"]
Jul 02 21:01:11.486381 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.486368    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6304473-9033-4fbb-a28a-af3266e99c2f" containerName="istio-proxy"
Jul 02 21:01:11.486423 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.486383    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6304473-9033-4fbb-a28a-af3266e99c2f" containerName="istio-proxy"
Jul 02 21:01:11.486423 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.486400    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6304473-9033-4fbb-a28a-af3266e99c2f" containerName="istio-proxy"
Jul 02 21:01:11.486423 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.486410    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6304473-9033-4fbb-a28a-af3266e99c2f" containerName="istio-proxy"
Jul 02 21:01:11.486519 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.486483    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6304473-9033-4fbb-a28a-af3266e99c2f" containerName="istio-proxy"
Jul 02 21:01:11.486519 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.486491    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6304473-9033-4fbb-a28a-af3266e99c2f" containerName="istio-proxy"
Jul 02 21:01:11.489498 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.489482    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.492221 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.492199    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e59ec025-openshift-default-dockercfg-qdjn8\""
Jul 02 21:01:11.492352 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.492228    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 21:01:11.501277 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.501251    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"]
Jul 02 21:01:11.513246 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.513224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:11.643546 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.643509    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-podinfo\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.643546 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.643550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mzr2\" (UniqueName: \"kubernetes.io/projected/d1b07118-905d-412a-a4a9-d3684a5bbdb3-kube-api-access-4mzr2\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.643791 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.643579    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-workload-socket\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.643791 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.643627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-envoy\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.643791 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.643667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-data\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.643791 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.643690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-token\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.643791 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.643721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-workload-certs\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.643962 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.643801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istiod-ca-cert\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.643962 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.643825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-credential-socket\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.744829 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.744719    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-podinfo\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.744829 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.744750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mzr2\" (UniqueName: \"kubernetes.io/projected/d1b07118-905d-412a-a4a9-d3684a5bbdb3-kube-api-access-4mzr2\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.744829 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.744780    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-workload-socket\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.744829 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.744823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-envoy\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.745143 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.744871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-data\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.745143 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.744898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-token\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.745143 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.744959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-workload-certs\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.745143 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.745005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istiod-ca-cert\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.745143 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.745034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-credential-socket\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.745406 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.745310    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-workload-socket\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.745406 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.745319    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-data\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.745406 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.745379    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-workload-certs\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.745406 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.745402    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-credential-socket\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.745902 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.745878    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istiod-ca-cert\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.747239 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.747221    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-envoy\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.747350 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.747293    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-podinfo\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.762479 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.762454    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-token\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.762623 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.762606    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mzr2\" (UniqueName: \"kubernetes.io/projected/d1b07118-905d-412a-a4a9-d3684a5bbdb3-kube-api-access-4mzr2\") pod \"e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") " pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.801172 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.801145    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:11.941464 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.941436    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"]
Jul 02 21:01:11.942600 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:01:11.942574    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1b07118_905d_412a_a4a9_d3684a5bbdb3.slice/crio-04856613fab7d96b4e5cd2b66adbba029b36294c051685b8df13fc74c96510d1 WatchSource:0}: Error finding container 04856613fab7d96b4e5cd2b66adbba029b36294c051685b8df13fc74c96510d1: Status 404 returned error can't find the container with id 04856613fab7d96b4e5cd2b66adbba029b36294c051685b8df13fc74c96510d1
Jul 02 21:01:11.944773 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.944723    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:01:11.944837 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.944799    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:01:11.944876 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.944834    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:01:11.955247 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:11.955211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:12.033561 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:12.033528    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr" event={"ID":"d1b07118-905d-412a-a4a9-d3684a5bbdb3","Type":"ContainerStarted","Data":"64b4622f2ef0a1e347e29b484c9d71c69b2f25d81ef0883309a7ed0c0bdd01e4"}
Jul 02 21:01:12.033729 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:12.033588    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr" event={"ID":"d1b07118-905d-412a-a4a9-d3684a5bbdb3","Type":"ContainerStarted","Data":"04856613fab7d96b4e5cd2b66adbba029b36294c051685b8df13fc74c96510d1"}
Jul 02 21:01:12.055236 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:12.055161    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr" podStartSLOduration=1.055146361 podStartE2EDuration="1.055146361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:01:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:01:12.051460757 +0000 UTC m=+1716.174472330" watchObservedRunningTime="2026-07-02 21:01:12.055146361 +0000 UTC m=+1716.178157931"
Jul 02 21:01:12.802014 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:12.801980    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:12.806800 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:12.806776    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:13.038788 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:13.038764    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:13.039808 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:13.039788    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:14.126725 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:14.126693    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:14.229711 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:14.229677    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:14.369176 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:14.369126    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:14.845416 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:14.845385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:14.896720 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:14.896685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:18.660025 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:18.659976    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:24.101799 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:24.101750    2565 generic.go:356] "Generic (PLEG): container finished" podID="d1b07118-905d-412a-a4a9-d3684a5bbdb3" containerID="64b4622f2ef0a1e347e29b484c9d71c69b2f25d81ef0883309a7ed0c0bdd01e4" exitCode=0
Jul 02 21:01:24.102189 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:24.101822    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr" event={"ID":"d1b07118-905d-412a-a4a9-d3684a5bbdb3","Type":"ContainerDied","Data":"64b4622f2ef0a1e347e29b484c9d71c69b2f25d81ef0883309a7ed0c0bdd01e4"}
Jul 02 21:01:24.102239 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:24.102226    2565 scope.go:117] "RemoveContainer" containerID="64b4622f2ef0a1e347e29b484c9d71c69b2f25d81ef0883309a7ed0c0bdd01e4"
Jul 02 21:01:24.103218 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:24.103192    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:01:24.103275 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:24.103265    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:01:24.103326 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:24.103314    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:01:25.109523 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.109492    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr" event={"ID":"d1b07118-905d-412a-a4a9-d3684a5bbdb3","Type":"ContainerStarted","Data":"4798b15cb700ed4003df9757caee8b3f9d54b7c90131d49e9674232eecf16d35"}
Jul 02 21:01:25.591776 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.591727    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"]
Jul 02 21:01:25.595205 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.595183    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.598941 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.598919    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e59ec025\"/\"openshift-service-ca.crt\""
Jul 02 21:01:25.599084 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.598959    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e59ec025\"/\"kube-root-ca.crt\""
Jul 02 21:01:25.599084 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.598967    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e59ec025\"/\"default-dockercfg-g86jr\""
Jul 02 21:01:25.599084 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.598919    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e59ec025\"/\"e2e-lifecycle-model-e59ec025-kserve-self-signed-certs\""
Jul 02 21:01:25.605293 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.605274    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"]
Jul 02 21:01:25.615671 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.615646    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:25.681610 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.681571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-dshm\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.681857 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.681622    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm92d\" (UniqueName: \"kubernetes.io/projected/e9da4110-a2bd-463f-8d4d-ef7bfc974208-kube-api-access-gm92d\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.681857 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.681673    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-tmp-dir\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.681857 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.681723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-model-cache\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.681857 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.681819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-home\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.681857 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.681854    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9da4110-a2bd-463f-8d4d-ef7bfc974208-tls-certs\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.782535 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.782499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-model-cache\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.782535 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.782551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-home\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.782749 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.782580    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9da4110-a2bd-463f-8d4d-ef7bfc974208-tls-certs\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.782749 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.782654    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-dshm\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.782749 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.782684    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm92d\" (UniqueName: \"kubernetes.io/projected/e9da4110-a2bd-463f-8d4d-ef7bfc974208-kube-api-access-gm92d\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.782749 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.782709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-tmp-dir\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.783005 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.782970    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-model-cache\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.783067 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.783020    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-home\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.783067 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.783051    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-tmp-dir\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.784968 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.784943    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-dshm\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.785222 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.785205    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9da4110-a2bd-463f-8d4d-ef7bfc974208-tls-certs\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.790189 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.790167    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm92d\" (UniqueName: \"kubernetes.io/projected/e9da4110-a2bd-463f-8d4d-ef7bfc974208-kube-api-access-gm92d\") pod \"e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") " pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:25.802016 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.801993    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:25.803250 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.803222    2565 patch_prober.go:28] interesting pod/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 02 21:01:25.803338 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.803272    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr" podUID="d1b07118-905d-412a-a4a9-d3684a5bbdb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 02 21:01:25.905125 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:25.905031    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:26.091990 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:26.091964    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"]
Jul 02 21:01:26.093278 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:01:26.093242    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9da4110_a2bd_463f_8d4d_ef7bfc974208.slice/crio-c039f33da336dd7a64f3849d5351063e988c082bd59e7f74ed8e2d96daf4493b WatchSource:0}: Error finding container c039f33da336dd7a64f3849d5351063e988c082bd59e7f74ed8e2d96daf4493b: Status 404 returned error can't find the container with id c039f33da336dd7a64f3849d5351063e988c082bd59e7f74ed8e2d96daf4493b
Jul 02 21:01:26.117173 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:26.117012    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv" event={"ID":"e9da4110-a2bd-463f-8d4d-ef7bfc974208","Type":"ContainerStarted","Data":"c039f33da336dd7a64f3849d5351063e988c082bd59e7f74ed8e2d96daf4493b"}
Jul 02 21:01:26.802046 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:26.802015    2565 patch_prober.go:28] interesting pod/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 02 21:01:26.802211 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:26.802078    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr" podUID="d1b07118-905d-412a-a4a9-d3684a5bbdb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 02 21:01:27.124000 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:27.123967    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv" event={"ID":"e9da4110-a2bd-463f-8d4d-ef7bfc974208","Type":"ContainerStarted","Data":"c923e0f2c75ff7648a8027d5e96a26124252714fa720f5da613dd7696b3497f6"}
Jul 02 21:01:27.148878 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:27.148809    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv" podStartSLOduration=2.148788605 podStartE2EDuration="2.148788605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:01:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:01:27.144917899 +0000 UTC m=+1731.267929470" watchObservedRunningTime="2026-07-02 21:01:27.148788605 +0000 UTC m=+1731.271800178"
Jul 02 21:01:27.801529 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:27.801489    2565 patch_prober.go:28] interesting pod/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 02 21:01:27.801743 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:27.801553    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr" podUID="d1b07118-905d-412a-a4a9-d3684a5bbdb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 02 21:01:28.039673 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:28.039622    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:28.802238 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:28.802190    2565 patch_prober.go:28] interesting pod/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 02 21:01:28.802723 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:28.802257    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr" podUID="d1b07118-905d-412a-a4a9-d3684a5bbdb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 02 21:01:29.805392 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:29.805359    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:29.806533 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:29.806505    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:01:35.905824 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:35.905787    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:35.906340 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:35.905850    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:35.918036 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:35.918004    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:36.185348 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:36.185270    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:01:36.240398 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:36.240369    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:36.341339 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:36.341304    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:41.949808 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:41.949775    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:51.182670 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:51.182632    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:51.590482 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:51.590394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:51.690884 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:51.690843    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:51.850314 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:51.850275    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:57.407167 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:01:57.407128    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:02.389062 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:02.389023    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"]
Jul 02 21:02:02.439051 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:02.439015    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:17.409370 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.409328    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv" podUID="e9da4110-a2bd-463f-8d4d-ef7bfc974208" containerName="main" containerID="cri-o://c923e0f2c75ff7648a8027d5e96a26124252714fa720f5da613dd7696b3497f6" gracePeriod=45
Jul 02 21:02:17.650641 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.650615    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:02:17.762748 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.762656    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9da4110-a2bd-463f-8d4d-ef7bfc974208-tls-certs\") pod \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") "
Jul 02 21:02:17.762748 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.762702    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-tmp-dir\") pod \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") "
Jul 02 21:02:17.762748 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.762734    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-dshm\") pod \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") "
Jul 02 21:02:17.763056 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.762781    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-home\") pod \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") "
Jul 02 21:02:17.763056 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.762831    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm92d\" (UniqueName: \"kubernetes.io/projected/e9da4110-a2bd-463f-8d4d-ef7bfc974208-kube-api-access-gm92d\") pod \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") "
Jul 02 21:02:17.763056 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.762858    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-model-cache\") pod \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\" (UID: \"e9da4110-a2bd-463f-8d4d-ef7bfc974208\") "
Jul 02 21:02:17.763209 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.763077    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e9da4110-a2bd-463f-8d4d-ef7bfc974208" (UID: "e9da4110-a2bd-463f-8d4d-ef7bfc974208"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:02:17.763209 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.763137    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-home" (OuterVolumeSpecName: "home") pod "e9da4110-a2bd-463f-8d4d-ef7bfc974208" (UID: "e9da4110-a2bd-463f-8d4d-ef7bfc974208"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:02:17.763209 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.763172    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-model-cache" (OuterVolumeSpecName: "model-cache") pod "e9da4110-a2bd-463f-8d4d-ef7bfc974208" (UID: "e9da4110-a2bd-463f-8d4d-ef7bfc974208"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:02:17.763349 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.763208    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-tmp-dir\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:02:17.765121 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.765085    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9da4110-a2bd-463f-8d4d-ef7bfc974208-kube-api-access-gm92d" (OuterVolumeSpecName: "kube-api-access-gm92d") pod "e9da4110-a2bd-463f-8d4d-ef7bfc974208" (UID: "e9da4110-a2bd-463f-8d4d-ef7bfc974208"). InnerVolumeSpecName "kube-api-access-gm92d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:02:17.765364 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.765342    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9da4110-a2bd-463f-8d4d-ef7bfc974208-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e9da4110-a2bd-463f-8d4d-ef7bfc974208" (UID: "e9da4110-a2bd-463f-8d4d-ef7bfc974208"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:02:17.765364 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.765348    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-dshm" (OuterVolumeSpecName: "dshm") pod "e9da4110-a2bd-463f-8d4d-ef7bfc974208" (UID: "e9da4110-a2bd-463f-8d4d-ef7bfc974208"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:02:17.864394 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.864361    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-dshm\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:02:17.864394 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.864389    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-home\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:02:17.864394 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.864399    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm92d\" (UniqueName: \"kubernetes.io/projected/e9da4110-a2bd-463f-8d4d-ef7bfc974208-kube-api-access-gm92d\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:02:17.864627 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.864409    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9da4110-a2bd-463f-8d4d-ef7bfc974208-model-cache\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:02:17.864627 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:17.864418    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9da4110-a2bd-463f-8d4d-ef7bfc974208-tls-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:02:18.400705 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:18.400672    2565 generic.go:356] "Generic (PLEG): container finished" podID="e9da4110-a2bd-463f-8d4d-ef7bfc974208" containerID="c923e0f2c75ff7648a8027d5e96a26124252714fa720f5da613dd7696b3497f6" exitCode=0
Jul 02 21:02:18.400889 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:18.400715    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"
Jul 02 21:02:18.400889 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:18.400764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv" event={"ID":"e9da4110-a2bd-463f-8d4d-ef7bfc974208","Type":"ContainerDied","Data":"c923e0f2c75ff7648a8027d5e96a26124252714fa720f5da613dd7696b3497f6"}
Jul 02 21:02:18.400889 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:18.400805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv" event={"ID":"e9da4110-a2bd-463f-8d4d-ef7bfc974208","Type":"ContainerDied","Data":"c039f33da336dd7a64f3849d5351063e988c082bd59e7f74ed8e2d96daf4493b"}
Jul 02 21:02:18.400889 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:18.400822    2565 scope.go:117] "RemoveContainer" containerID="c923e0f2c75ff7648a8027d5e96a26124252714fa720f5da613dd7696b3497f6"
Jul 02 21:02:18.409692 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:18.409675    2565 scope.go:117] "RemoveContainer" containerID="c923e0f2c75ff7648a8027d5e96a26124252714fa720f5da613dd7696b3497f6"
Jul 02 21:02:18.410054 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:02:18.409951    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c923e0f2c75ff7648a8027d5e96a26124252714fa720f5da613dd7696b3497f6\": container with ID starting with c923e0f2c75ff7648a8027d5e96a26124252714fa720f5da613dd7696b3497f6 not found: ID does not exist" containerID="c923e0f2c75ff7648a8027d5e96a26124252714fa720f5da613dd7696b3497f6"
Jul 02 21:02:18.410054 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:18.409977    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c923e0f2c75ff7648a8027d5e96a26124252714fa720f5da613dd7696b3497f6"} err="failed to get container status \"c923e0f2c75ff7648a8027d5e96a26124252714fa720f5da613dd7696b3497f6\": rpc error: code = NotFound desc = could not find container \"c923e0f2c75ff7648a8027d5e96a26124252714fa720f5da613dd7696b3497f6\": container with ID starting with c923e0f2c75ff7648a8027d5e96a26124252714fa720f5da613dd7696b3497f6 not found: ID does not exist"
Jul 02 21:02:18.418829 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:18.418801    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"]
Jul 02 21:02:18.422337 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:18.422316    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-e59ec025/e2e-lifecycle-model-e59ec025-kserve-7ff777759-4zdwv"]
Jul 02 21:02:20.299096 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:20.299057    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9da4110-a2bd-463f-8d4d-ef7bfc974208" path="/var/lib/kubelet/pods/e9da4110-a2bd-463f-8d4d-ef7bfc974208/volumes"
Jul 02 21:02:36.428866 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:36.428838    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 21:02:36.435708 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:36.435680    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 21:02:38.734234 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:38.734174    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:40.292540 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:40.292500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:44.792507 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:02:44.792472    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:07.693967 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:07.693933    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:07.756286 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:07.756257    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:07.956465 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:07.956388    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"]
Jul 02 21:03:07.956657 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:07.956633    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr" podUID="d1b07118-905d-412a-a4a9-d3684a5bbdb3" containerName="istio-proxy" containerID="cri-o://4798b15cb700ed4003df9757caee8b3f9d54b7c90131d49e9674232eecf16d35" gracePeriod=30
Jul 02 21:03:07.979708 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:07.979676    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:08.226571 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:08.226483    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:09.324431 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:09.324395    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:09.419299 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:09.419256    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:09.525678 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:09.525646    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:10.322966 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:10.322931    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:10.421980 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:10.421942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:10.478057 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:10.478029    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:11.982823 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:11.982785    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:13.206345 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.206318    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:03:13.269182 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.269112    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mzr2\" (UniqueName: \"kubernetes.io/projected/d1b07118-905d-412a-a4a9-d3684a5bbdb3-kube-api-access-4mzr2\") pod \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") "
Jul 02 21:03:13.269182 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.269171    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-workload-certs\") pod \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") "
Jul 02 21:03:13.269369 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.269221    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-token\") pod \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") "
Jul 02 21:03:13.269369 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.269254    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-data\") pod \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") "
Jul 02 21:03:13.269369 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.269291    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-podinfo\") pod \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") "
Jul 02 21:03:13.269369 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.269335    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istiod-ca-cert\") pod \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") "
Jul 02 21:03:13.269369 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.269364    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-credential-socket\") pod \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") "
Jul 02 21:03:13.269638 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.269412    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-envoy\") pod \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") "
Jul 02 21:03:13.269638 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.269440    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-workload-socket\") pod \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\" (UID: \"d1b07118-905d-412a-a4a9-d3684a5bbdb3\") "
Jul 02 21:03:13.269638 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.269492    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d1b07118-905d-412a-a4a9-d3684a5bbdb3" (UID: "d1b07118-905d-412a-a4a9-d3684a5bbdb3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:03:13.269830 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.269728    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d1b07118-905d-412a-a4a9-d3684a5bbdb3" (UID: "d1b07118-905d-412a-a4a9-d3684a5bbdb3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:03:13.269830 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.269789    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-workload-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:03:13.270059 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.270038    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d1b07118-905d-412a-a4a9-d3684a5bbdb3" (UID: "d1b07118-905d-412a-a4a9-d3684a5bbdb3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:03:13.270215 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.270193    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d1b07118-905d-412a-a4a9-d3684a5bbdb3" (UID: "d1b07118-905d-412a-a4a9-d3684a5bbdb3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:03:13.270309 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.270286    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-data" (OuterVolumeSpecName: "istio-data") pod "d1b07118-905d-412a-a4a9-d3684a5bbdb3" (UID: "d1b07118-905d-412a-a4a9-d3684a5bbdb3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:03:13.271488 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.271467    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d1b07118-905d-412a-a4a9-d3684a5bbdb3" (UID: "d1b07118-905d-412a-a4a9-d3684a5bbdb3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 21:03:13.271563 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.271473    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1b07118-905d-412a-a4a9-d3684a5bbdb3-kube-api-access-4mzr2" (OuterVolumeSpecName: "kube-api-access-4mzr2") pod "d1b07118-905d-412a-a4a9-d3684a5bbdb3" (UID: "d1b07118-905d-412a-a4a9-d3684a5bbdb3"). InnerVolumeSpecName "kube-api-access-4mzr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:03:13.271855 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.271830    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-token" (OuterVolumeSpecName: "istio-token") pod "d1b07118-905d-412a-a4a9-d3684a5bbdb3" (UID: "d1b07118-905d-412a-a4a9-d3684a5bbdb3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:03:13.271855 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.271844    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d1b07118-905d-412a-a4a9-d3684a5bbdb3" (UID: "d1b07118-905d-412a-a4a9-d3684a5bbdb3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:03:13.370588 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.370558    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-envoy\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:03:13.370588 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.370584    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-workload-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:03:13.370796 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.370597    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mzr2\" (UniqueName: \"kubernetes.io/projected/d1b07118-905d-412a-a4a9-d3684a5bbdb3-kube-api-access-4mzr2\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:03:13.370796 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.370610    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-token\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:03:13.370796 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.370621    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-data\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:03:13.370796 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.370632    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istio-podinfo\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:03:13.370796 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.370643    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1b07118-905d-412a-a4a9-d3684a5bbdb3-istiod-ca-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:03:13.370796 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.370655    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07118-905d-412a-a4a9-d3684a5bbdb3-credential-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:03:13.686049 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.686010    2565 generic.go:356] "Generic (PLEG): container finished" podID="d1b07118-905d-412a-a4a9-d3684a5bbdb3" containerID="4798b15cb700ed4003df9757caee8b3f9d54b7c90131d49e9674232eecf16d35" exitCode=0
Jul 02 21:03:13.686209 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.686066    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"
Jul 02 21:03:13.686209 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.686078    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr" event={"ID":"d1b07118-905d-412a-a4a9-d3684a5bbdb3","Type":"ContainerDied","Data":"4798b15cb700ed4003df9757caee8b3f9d54b7c90131d49e9674232eecf16d35"}
Jul 02 21:03:13.686209 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.686132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr" event={"ID":"d1b07118-905d-412a-a4a9-d3684a5bbdb3","Type":"ContainerDied","Data":"04856613fab7d96b4e5cd2b66adbba029b36294c051685b8df13fc74c96510d1"}
Jul 02 21:03:13.686209 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.686160    2565 scope.go:117] "RemoveContainer" containerID="4798b15cb700ed4003df9757caee8b3f9d54b7c90131d49e9674232eecf16d35"
Jul 02 21:03:13.695513 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.695499    2565 scope.go:117] "RemoveContainer" containerID="64b4622f2ef0a1e347e29b484c9d71c69b2f25d81ef0883309a7ed0c0bdd01e4"
Jul 02 21:03:13.703669 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.703649    2565 scope.go:117] "RemoveContainer" containerID="4798b15cb700ed4003df9757caee8b3f9d54b7c90131d49e9674232eecf16d35"
Jul 02 21:03:13.703920 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:03:13.703903    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4798b15cb700ed4003df9757caee8b3f9d54b7c90131d49e9674232eecf16d35\": container with ID starting with 4798b15cb700ed4003df9757caee8b3f9d54b7c90131d49e9674232eecf16d35 not found: ID does not exist" containerID="4798b15cb700ed4003df9757caee8b3f9d54b7c90131d49e9674232eecf16d35"
Jul 02 21:03:13.703974 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.703929    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4798b15cb700ed4003df9757caee8b3f9d54b7c90131d49e9674232eecf16d35"} err="failed to get container status \"4798b15cb700ed4003df9757caee8b3f9d54b7c90131d49e9674232eecf16d35\": rpc error: code = NotFound desc = could not find container \"4798b15cb700ed4003df9757caee8b3f9d54b7c90131d49e9674232eecf16d35\": container with ID starting with 4798b15cb700ed4003df9757caee8b3f9d54b7c90131d49e9674232eecf16d35 not found: ID does not exist"
Jul 02 21:03:13.703974 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.703946    2565 scope.go:117] "RemoveContainer" containerID="64b4622f2ef0a1e347e29b484c9d71c69b2f25d81ef0883309a7ed0c0bdd01e4"
Jul 02 21:03:13.704236 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:03:13.704210    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64b4622f2ef0a1e347e29b484c9d71c69b2f25d81ef0883309a7ed0c0bdd01e4\": container with ID starting with 64b4622f2ef0a1e347e29b484c9d71c69b2f25d81ef0883309a7ed0c0bdd01e4 not found: ID does not exist" containerID="64b4622f2ef0a1e347e29b484c9d71c69b2f25d81ef0883309a7ed0c0bdd01e4"
Jul 02 21:03:13.704318 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.704243    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b4622f2ef0a1e347e29b484c9d71c69b2f25d81ef0883309a7ed0c0bdd01e4"} err="failed to get container status \"64b4622f2ef0a1e347e29b484c9d71c69b2f25d81ef0883309a7ed0c0bdd01e4\": rpc error: code = NotFound desc = could not find container \"64b4622f2ef0a1e347e29b484c9d71c69b2f25d81ef0883309a7ed0c0bdd01e4\": container with ID starting with 64b4622f2ef0a1e347e29b484c9d71c69b2f25d81ef0883309a7ed0c0bdd01e4 not found: ID does not exist"
Jul 02 21:03:13.707200 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.707175    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"]
Jul 02 21:03:13.714374 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:13.714352    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e59ec025-openshift-default-5c5d865b47-z58rr"]
Jul 02 21:03:14.299380 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:14.299347    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1b07118-905d-412a-a4a9-d3684a5bbdb3" path="/var/lib/kubelet/pods/d1b07118-905d-412a-a4a9-d3684a5bbdb3/volumes"
Jul 02 21:03:17.968987 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:17.968931    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:18.024636 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:18.024602    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:18.587189 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:18.587154    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:24.198596 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:24.198556    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:24.259143 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:24.259069    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:24.332721 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:24.332688    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:24.432397 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:24.432348    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:34.918693 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:34.918657    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:35.283574 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:35.283447    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:56.321263 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:03:56.321226    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:02.087652 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.087572    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:02.245556 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.245523    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:02.305829 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.305798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:02.556296 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.556260    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"]
Jul 02 21:04:02.556788 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.556771    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9da4110-a2bd-463f-8d4d-ef7bfc974208" containerName="main"
Jul 02 21:04:02.556853 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.556790    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9da4110-a2bd-463f-8d4d-ef7bfc974208" containerName="main"
Jul 02 21:04:02.556853 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.556808    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1b07118-905d-412a-a4a9-d3684a5bbdb3" containerName="istio-proxy"
Jul 02 21:04:02.556853 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.556814    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1b07118-905d-412a-a4a9-d3684a5bbdb3" containerName="istio-proxy"
Jul 02 21:04:02.556853 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.556826    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1b07118-905d-412a-a4a9-d3684a5bbdb3" containerName="istio-proxy"
Jul 02 21:04:02.556853 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.556832    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1b07118-905d-412a-a4a9-d3684a5bbdb3" containerName="istio-proxy"
Jul 02 21:04:02.557013 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.556902    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9da4110-a2bd-463f-8d4d-ef7bfc974208" containerName="main"
Jul 02 21:04:02.557013 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.556909    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1b07118-905d-412a-a4a9-d3684a5bbdb3" containerName="istio-proxy"
Jul 02 21:04:02.557013 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.556917    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1b07118-905d-412a-a4a9-d3684a5bbdb3" containerName="istio-proxy"
Jul 02 21:04:02.560013 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.559995    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.562873 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.562849    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 21:04:02.563022 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.562855    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d9e8a3-openshift-default-dockercfg-kzcxd\""
Jul 02 21:04:02.571130 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.571105    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"]
Jul 02 21:04:02.587847 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.587820    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:02.704879 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.704819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37d93b20-3785-44c2-a300-44963284db74-istiod-ca-cert\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.704879 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.704880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-istio-envoy\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.705092 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.704914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-credential-socket\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.705092 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.704943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-workload-certs\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.705092 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.704968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37d93b20-3785-44c2-a300-44963284db74-istio-token\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.705092 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.705022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-workload-socket\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.705092 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.705036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-istio-data\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.705092 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.705062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37d93b20-3785-44c2-a300-44963284db74-istio-podinfo\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.705092 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.705080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkr9q\" (UniqueName: \"kubernetes.io/projected/37d93b20-3785-44c2-a300-44963284db74-kube-api-access-kkr9q\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.806258 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.806224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37d93b20-3785-44c2-a300-44963284db74-istio-podinfo\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.806453 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.806269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkr9q\" (UniqueName: \"kubernetes.io/projected/37d93b20-3785-44c2-a300-44963284db74-kube-api-access-kkr9q\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.806453 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.806347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37d93b20-3785-44c2-a300-44963284db74-istiod-ca-cert\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.806453 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.806374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-istio-envoy\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.806453 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.806405    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-credential-socket\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.806644 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.806572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-workload-certs\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.806644 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.806621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37d93b20-3785-44c2-a300-44963284db74-istio-token\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.806747 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.806662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-workload-socket\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.806747 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.806685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-istio-data\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.806895 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.806831    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-credential-socket\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.806986 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.806962    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-workload-certs\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.807072 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.807049    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-workload-socket\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.807120 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.807067    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-istio-data\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.807563 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.807544    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37d93b20-3785-44c2-a300-44963284db74-istiod-ca-cert\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.808797 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.808776    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-istio-envoy\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.808892 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.808876    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37d93b20-3785-44c2-a300-44963284db74-istio-podinfo\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.814238 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.814213    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37d93b20-3785-44c2-a300-44963284db74-istio-token\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.814425 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.814405    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkr9q\" (UniqueName: \"kubernetes.io/projected/37d93b20-3785-44c2-a300-44963284db74-kube-api-access-kkr9q\") pod \"e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") " pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:02.870428 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:02.870396    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:03.004347 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:03.004314    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"]
Jul 02 21:04:03.005697 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:04:03.005657    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37d93b20_3785_44c2_a300_44963284db74.slice/crio-56ef37fe2b20d0afe9b6ec59199d40119538ce93615e1913a218e04e8bc6e486 WatchSource:0}: Error finding container 56ef37fe2b20d0afe9b6ec59199d40119538ce93615e1913a218e04e8bc6e486: Status 404 returned error can't find the container with id 56ef37fe2b20d0afe9b6ec59199d40119538ce93615e1913a218e04e8bc6e486
Jul 02 21:04:03.007908 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:03.007869    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:04:03.007980 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:03.007958    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:04:03.008028 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:03.008001    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:04:03.130638 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:03.130604    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:03.948240 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:03.948202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj" event={"ID":"37d93b20-3785-44c2-a300-44963284db74","Type":"ContainerStarted","Data":"7d55fd7f05fae2404724b2cc9ea9506f5880efdae3dde87c22fa2a2ddcc88928"}
Jul 02 21:04:03.948441 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:03.948259    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj" event={"ID":"37d93b20-3785-44c2-a300-44963284db74","Type":"ContainerStarted","Data":"56ef37fe2b20d0afe9b6ec59199d40119538ce93615e1913a218e04e8bc6e486"}
Jul 02 21:04:03.969739 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:03.969692    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj" podStartSLOduration=1.9696772980000001 podStartE2EDuration="1.969677298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:04:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:04:03.967210966 +0000 UTC m=+1888.090222539" watchObservedRunningTime="2026-07-02 21:04:03.969677298 +0000 UTC m=+1888.092688934"
Jul 02 21:04:04.870584 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:04.870548    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:04.875449 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:04.875428    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:04.953983 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:04.953953    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:04.955079 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:04.955060    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:06.013685 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:06.013640    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:06.096363 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:06.096328    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:06.166683 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:06.166648    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:06.509455 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:06.509413    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:06.610187 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:06.610154    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:06.710056 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:06.710012    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:10.557991 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:10.557949    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:10.926984 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:10.926944    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:11.270857 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.270773    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"]
Jul 02 21:04:11.274189 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.274166    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.276744 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.276722    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-d34e2e-openshift-default-dockercfg-g9rsr\""
Jul 02 21:04:11.288056 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.288015    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"]
Jul 02 21:04:11.298434 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.298406    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:11.387613 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.387580    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-workload-socket\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.387817 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.387629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-credential-socket\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.387817 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.387661    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-podinfo\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.387817 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.387701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-workload-certs\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.387817 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.387802    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-token\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.388014 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.387850    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-envoy\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.388014 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.387877    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72nnv\" (UniqueName: \"kubernetes.io/projected/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-kube-api-access-72nnv\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.388014 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.387908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istiod-ca-cert\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.388014 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.387971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-data\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.489446 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.489411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-workload-socket\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.489637 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.489510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-credential-socket\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.489637 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.489563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-podinfo\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.489637 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.489583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-workload-certs\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.489637 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.489615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-token\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.489902 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.489640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-envoy\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.489902 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.489659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72nnv\" (UniqueName: \"kubernetes.io/projected/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-kube-api-access-72nnv\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.489902 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.489685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istiod-ca-cert\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.489902 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.489724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-data\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.489902 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.489829    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-workload-socket\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.490162 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.489907    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-credential-socket\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.490162 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.490023    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-workload-certs\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.490162 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.490097    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-data\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.490411 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.490393    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istiod-ca-cert\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.492072 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.492041    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-envoy\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.492182 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.492139    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-podinfo\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.498142 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.498118    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-token\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.498941 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.498916    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72nnv\" (UniqueName: \"kubernetes.io/projected/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-kube-api-access-72nnv\") pod \"e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") " pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.585930 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.585834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:11.643639 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.643601    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:11.731094 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.730821    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"]
Jul 02 21:04:11.734241 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:04:11.734216    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f7dd01_ab5d_464b_b9a5_cd12acc466b4.slice/crio-cd5b71ea676afa725c10e36a3844ed505194de5bf7233d9111f0a06990ad6edc WatchSource:0}: Error finding container cd5b71ea676afa725c10e36a3844ed505194de5bf7233d9111f0a06990ad6edc: Status 404 returned error can't find the container with id cd5b71ea676afa725c10e36a3844ed505194de5bf7233d9111f0a06990ad6edc
Jul 02 21:04:11.736412 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.736367    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:04:11.736482 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.736468    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:04:11.736529 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.736513    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:04:11.994695 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.994659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz" event={"ID":"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4","Type":"ContainerStarted","Data":"15456f66f43b7c8dfad7e24c3d8ee0b983c2a388308a4e01ef55f3f21e1717c2"}
Jul 02 21:04:11.994884 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:11.994718    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz" event={"ID":"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4","Type":"ContainerStarted","Data":"cd5b71ea676afa725c10e36a3844ed505194de5bf7233d9111f0a06990ad6edc"}
Jul 02 21:04:12.017906 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:12.017854    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz" podStartSLOduration=1.01783878 podStartE2EDuration="1.01783878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:04:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:04:12.015543566 +0000 UTC m=+1896.138555138" watchObservedRunningTime="2026-07-02 21:04:12.01783878 +0000 UTC m=+1896.140850350"
Jul 02 21:04:12.586654 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:12.586626    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:12.591578 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:12.591555    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:13.000121 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:13.000090    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:13.001230 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:13.001208    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:14.288457 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:14.288422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:14.388942 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:14.388907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:14.808089 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:14.808058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:14.908630 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:14.908594    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:17.134615 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:17.134568    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:17.235469 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:17.235431    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:18.750683 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:18.750617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:19.955357 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:19.955316    2565 patch_prober.go:28] interesting pod/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 02 21:04:19.955871 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:19.955396    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj" podUID="37d93b20-3785-44c2-a300-44963284db74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 02 21:04:20.048965 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:20.048865    2565 generic.go:356] "Generic (PLEG): container finished" podID="37d93b20-3785-44c2-a300-44963284db74" containerID="7d55fd7f05fae2404724b2cc9ea9506f5880efdae3dde87c22fa2a2ddcc88928" exitCode=0
Jul 02 21:04:20.048965 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:20.048934    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj" event={"ID":"37d93b20-3785-44c2-a300-44963284db74","Type":"ContainerDied","Data":"7d55fd7f05fae2404724b2cc9ea9506f5880efdae3dde87c22fa2a2ddcc88928"}
Jul 02 21:04:20.049472 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:20.049450    2565 scope.go:117] "RemoveContainer" containerID="7d55fd7f05fae2404724b2cc9ea9506f5880efdae3dde87c22fa2a2ddcc88928"
Jul 02 21:04:20.052222 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:20.052179    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:04:20.052351 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:20.052281    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:04:20.052351 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:20.052333    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:04:21.060477 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:21.060442    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj" event={"ID":"37d93b20-3785-44c2-a300-44963284db74","Type":"ContainerStarted","Data":"fc6d39659448ae3995e7a0378eec9bfd0469301d1caebbae2ab7e81ded8d2848"}
Jul 02 21:04:21.871738 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:21.871690    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:21.871968 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:21.871870    2565 patch_prober.go:28] interesting pod/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 02 21:04:21.871968 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:21.871932    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj" podUID="37d93b20-3785-44c2-a300-44963284db74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 02 21:04:22.871138 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:22.871103    2565 patch_prober.go:28] interesting pod/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 02 21:04:22.871577 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:22.871157    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj" podUID="37d93b20-3785-44c2-a300-44963284db74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 02 21:04:23.871294 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:23.871247    2565 patch_prober.go:28] interesting pod/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 02 21:04:23.871692 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:23.871315    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj" podUID="37d93b20-3785-44c2-a300-44963284db74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 02 21:04:24.871006 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:24.870972    2565 patch_prober.go:28] interesting pod/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 02 21:04:24.871182 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:24.871034    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj" podUID="37d93b20-3785-44c2-a300-44963284db74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 02 21:04:25.875838 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:25.875807    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:25.876232 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:25.876080    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:25.876740 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:25.876723    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:04:26.996712 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:26.996683    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"]
Jul 02 21:04:26.999951 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:26.999934    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.002573 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.002553    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d9e8a3\"/\"openshift-service-ca.crt\""
Jul 02 21:04:27.002816 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.002799    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d9e8a3\"/\"kube-root-ca.crt\""
Jul 02 21:04:27.003917 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.003897    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d9e8a3\"/\"default-dockercfg-nt7vq\""
Jul 02 21:04:27.004036 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.004018    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d9e8a3\"/\"test-model-d9e8a3-kserve-self-signed-certs\""
Jul 02 21:04:27.008946 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.008925    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"]
Jul 02 21:04:27.019703 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.019664    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:27.056887 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.056851    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-tmp-dir\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.056887 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.056885    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-tls-certs\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.057117 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.056930    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-home\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.057117 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.056967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-dshm\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.057117 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.057063    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-model-cache\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.057117 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.057093    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqk6m\" (UniqueName: \"kubernetes.io/projected/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-kube-api-access-dqk6m\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.099747 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.099719    2565 generic.go:356] "Generic (PLEG): container finished" podID="e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" containerID="15456f66f43b7c8dfad7e24c3d8ee0b983c2a388308a4e01ef55f3f21e1717c2" exitCode=0
Jul 02 21:04:27.099887 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.099793    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz" event={"ID":"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4","Type":"ContainerDied","Data":"15456f66f43b7c8dfad7e24c3d8ee0b983c2a388308a4e01ef55f3f21e1717c2"}
Jul 02 21:04:27.100277 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.100263    2565 scope.go:117] "RemoveContainer" containerID="15456f66f43b7c8dfad7e24c3d8ee0b983c2a388308a4e01ef55f3f21e1717c2"
Jul 02 21:04:27.101169 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.101145    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:04:27.101224 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.101206    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:04:27.101267 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.101235    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:04:27.158366 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.158328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-model-cache\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.158366 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.158364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqk6m\" (UniqueName: \"kubernetes.io/projected/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-kube-api-access-dqk6m\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.158726 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.158704    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-model-cache\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.158906 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.158814    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-tmp-dir\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.158906 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.158849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-tls-certs\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.159030 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.158928    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-home\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.159030 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.158985    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-dshm\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.159178 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.159155    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-tmp-dir\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.159346 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.159330    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-home\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.161314 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.161287    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-dshm\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.161434 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.161405    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-tls-certs\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.166617 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.166583    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqk6m\" (UniqueName: \"kubernetes.io/projected/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-kube-api-access-dqk6m\") pod \"test-model-d9e8a3-kserve-7877965f7c-fb7pl\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") " pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.310073 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.309982    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:27.360126 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.360091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:27.446961 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.446935    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"]
Jul 02 21:04:27.447874 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:04:27.447825    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3f2c00a_2813_4da6_ac24_cacb3171c1d8.slice/crio-03680ab4a9339cb68331780c4b2661104d2507ae5a0a3f76b12ae528f1c791f2 WatchSource:0}: Error finding container 03680ab4a9339cb68331780c4b2661104d2507ae5a0a3f76b12ae528f1c791f2: Status 404 returned error can't find the container with id 03680ab4a9339cb68331780c4b2661104d2507ae5a0a3f76b12ae528f1c791f2
Jul 02 21:04:27.448038 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:27.447919    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:28.000574 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:28.000536    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:28.107035 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:28.106999    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz" event={"ID":"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4","Type":"ContainerStarted","Data":"84f4b178a3b84bef11a524f42ed6eb1e883247386d8193ca83352193c7fea1fd"}
Jul 02 21:04:28.108564 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:28.108539    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl" event={"ID":"f3f2c00a-2813-4da6-ac24-cacb3171c1d8","Type":"ContainerStarted","Data":"880cedf0659aa8123247fae58780d81c91e8d931b3f992ca87eec9124dc75ecf"}
Jul 02 21:04:28.108680 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:28.108573    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl" event={"ID":"f3f2c00a-2813-4da6-ac24-cacb3171c1d8","Type":"ContainerStarted","Data":"03680ab4a9339cb68331780c4b2661104d2507ae5a0a3f76b12ae528f1c791f2"}
Jul 02 21:04:28.140562 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:28.140515    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl" podStartSLOduration=2.140501931 podStartE2EDuration="2.140501931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:04:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:04:28.14035256 +0000 UTC m=+1912.263364132" watchObservedRunningTime="2026-07-02 21:04:28.140501931 +0000 UTC m=+1912.263513502"
Jul 02 21:04:28.586015 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:28.585981    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:28.587249 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:28.587220    2565 patch_prober.go:28] interesting pod/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 02 21:04:28.587377 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:28.587291    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz" podUID="e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 02 21:04:29.586840 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:29.586802    2565 patch_prober.go:28] interesting pod/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 02 21:04:29.587253 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:29.586862    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz" podUID="e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 02 21:04:30.587215 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:30.587173    2565 patch_prober.go:28] interesting pod/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 02 21:04:30.587608 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:30.587245    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz" podUID="e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 02 21:04:31.586489 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:31.586450    2565 patch_prober.go:28] interesting pod/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 02 21:04:31.586690 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:31.586509    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz" podUID="e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 02 21:04:32.590129 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:32.590095    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:32.590500 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:32.590470    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:32.591232 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:32.591211    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:04:35.585666 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:35.585629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:35.684688 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:35.684649    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:37.310300 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:37.310262    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:37.310836 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:37.310333    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:37.322977 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:37.322950    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:38.176589 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:38.176556    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:04:48.575103 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.575065    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"]
Jul 02 21:04:48.579304 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.579284    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.582011 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.581983    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d34e2e\"/\"openshift-service-ca.crt\""
Jul 02 21:04:48.583084 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.583061    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d34e2e\"/\"default-dockercfg-z66cp\""
Jul 02 21:04:48.583220 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.583130    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d34e2e\"/\"kube-root-ca.crt\""
Jul 02 21:04:48.583300 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.583240    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d34e2e\"/\"test-model-d34e2e-kserve-self-signed-certs\""
Jul 02 21:04:48.587890 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.587868    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"]
Jul 02 21:04:48.599536 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.599508    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:48.672468 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.672436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-model-cache\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.672676 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.672491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6h4x\" (UniqueName: \"kubernetes.io/projected/524f8971-9e7a-4986-9259-c26b67a00331-kube-api-access-t6h4x\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.672676 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.672535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-tmp-dir\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.672828 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.672672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-dshm\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.672828 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.672730    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/524f8971-9e7a-4986-9259-c26b67a00331-tls-certs\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.672828 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.672774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-home\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.774324 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.774286    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-model-cache\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.774498 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.774347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6h4x\" (UniqueName: \"kubernetes.io/projected/524f8971-9e7a-4986-9259-c26b67a00331-kube-api-access-t6h4x\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.774498 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.774386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-tmp-dir\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.774498 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.774422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-dshm\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.774498 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.774446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/524f8971-9e7a-4986-9259-c26b67a00331-tls-certs\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.774498 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.774471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-home\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.774831 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.774808    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-tmp-dir\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.774831 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.774824    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-model-cache\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.774925 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.774844    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-home\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.776789 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.776750    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-dshm\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.777069 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.777014    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/524f8971-9e7a-4986-9259-c26b67a00331-tls-certs\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.782297 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.782277    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6h4x\" (UniqueName: \"kubernetes.io/projected/524f8971-9e7a-4986-9259-c26b67a00331-kube-api-access-t6h4x\") pod \"test-model-d34e2e-kserve-fb86f9dc-tmm99\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") " pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:48.889737 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:48.889703    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:49.031294 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:49.031247    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"]
Jul 02 21:04:49.032671 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:04:49.032643    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod524f8971_9e7a_4986_9259_c26b67a00331.slice/crio-98ea6be75e8c85dbc5856ab057d906ffa517d3594ff8ddd007157b826b6871e0 WatchSource:0}: Error finding container 98ea6be75e8c85dbc5856ab057d906ffa517d3594ff8ddd007157b826b6871e0: Status 404 returned error can't find the container with id 98ea6be75e8c85dbc5856ab057d906ffa517d3594ff8ddd007157b826b6871e0
Jul 02 21:04:49.231917 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:49.231816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99" event={"ID":"524f8971-9e7a-4986-9259-c26b67a00331","Type":"ContainerStarted","Data":"607e76e40851f1b85d8859161bbc8b50dda8da97bc07037473ebe239fe121a97"}
Jul 02 21:04:49.231917 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:49.231858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99" event={"ID":"524f8971-9e7a-4986-9259-c26b67a00331","Type":"ContainerStarted","Data":"98ea6be75e8c85dbc5856ab057d906ffa517d3594ff8ddd007157b826b6871e0"}
Jul 02 21:04:49.248560 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:49.248508    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99" podStartSLOduration=1.248490632 podStartE2EDuration="1.248490632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:04:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:04:49.247691843 +0000 UTC m=+1933.370703446" watchObservedRunningTime="2026-07-02 21:04:49.248490632 +0000 UTC m=+1933.371502216"
Jul 02 21:04:58.890116 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:58.890080    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:58.890591 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:58.890131    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:58.902634 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:58.902606    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:04:59.295492 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:04:59.295413    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:05:07.198299 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:07.198265    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"]
Jul 02 21:05:07.219264 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:07.219232    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:08.132122 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:08.132089    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"]
Jul 02 21:05:08.145351 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:08.145321    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:08.313120 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:08.313089    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:08.730336 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:08.730301    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:08.880191 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:08.880151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:08.981751 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:08.981668    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:09.120871 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:09.120836    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:13.804744 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:13.804709    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:22.219062 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.218998    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl" podUID="f3f2c00a-2813-4da6-ac24-cacb3171c1d8" containerName="main" containerID="cri-o://880cedf0659aa8123247fae58780d81c91e8d931b3f992ca87eec9124dc75ecf" gracePeriod=45
Jul 02 21:05:22.423457 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.423405    2565 generic.go:356] "Generic (PLEG): container finished" podID="f3f2c00a-2813-4da6-ac24-cacb3171c1d8" containerID="880cedf0659aa8123247fae58780d81c91e8d931b3f992ca87eec9124dc75ecf" exitCode=0
Jul 02 21:05:22.423627 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.423487    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl" event={"ID":"f3f2c00a-2813-4da6-ac24-cacb3171c1d8","Type":"ContainerDied","Data":"880cedf0659aa8123247fae58780d81c91e8d931b3f992ca87eec9124dc75ecf"}
Jul 02 21:05:22.484254 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.484226    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:05:22.598267 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.598233    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-home\") pod \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") "
Jul 02 21:05:22.598457 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.598344    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-model-cache\") pod \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") "
Jul 02 21:05:22.598457 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.598408    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-tls-certs\") pod \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") "
Jul 02 21:05:22.598457 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.598439    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-tmp-dir\") pod \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") "
Jul 02 21:05:22.598615 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.598474    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqk6m\" (UniqueName: \"kubernetes.io/projected/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-kube-api-access-dqk6m\") pod \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") "
Jul 02 21:05:22.598615 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.598504    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-home" (OuterVolumeSpecName: "home") pod "f3f2c00a-2813-4da6-ac24-cacb3171c1d8" (UID: "f3f2c00a-2813-4da6-ac24-cacb3171c1d8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:22.598615 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.598526    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-dshm\") pod \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\" (UID: \"f3f2c00a-2813-4da6-ac24-cacb3171c1d8\") "
Jul 02 21:05:22.598615 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.598599    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-model-cache" (OuterVolumeSpecName: "model-cache") pod "f3f2c00a-2813-4da6-ac24-cacb3171c1d8" (UID: "f3f2c00a-2813-4da6-ac24-cacb3171c1d8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:22.598834 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.598709    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f3f2c00a-2813-4da6-ac24-cacb3171c1d8" (UID: "f3f2c00a-2813-4da6-ac24-cacb3171c1d8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:22.598915 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.598893    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-home\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:22.598915 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.598914    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-model-cache\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:22.599091 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.598928    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-tmp-dir\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:22.600694 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.600674    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-dshm" (OuterVolumeSpecName: "dshm") pod "f3f2c00a-2813-4da6-ac24-cacb3171c1d8" (UID: "f3f2c00a-2813-4da6-ac24-cacb3171c1d8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:22.600778 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.600711    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f3f2c00a-2813-4da6-ac24-cacb3171c1d8" (UID: "f3f2c00a-2813-4da6-ac24-cacb3171c1d8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:05:22.600840 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.600819    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-kube-api-access-dqk6m" (OuterVolumeSpecName: "kube-api-access-dqk6m") pod "f3f2c00a-2813-4da6-ac24-cacb3171c1d8" (UID: "f3f2c00a-2813-4da6-ac24-cacb3171c1d8"). InnerVolumeSpecName "kube-api-access-dqk6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:05:22.699473 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.699441    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-tls-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:22.699473 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.699469    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqk6m\" (UniqueName: \"kubernetes.io/projected/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-kube-api-access-dqk6m\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:22.699671 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:22.699483    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3f2c00a-2813-4da6-ac24-cacb3171c1d8-dshm\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:23.152752 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.152687    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99" podUID="524f8971-9e7a-4986-9259-c26b67a00331" containerName="main" containerID="cri-o://607e76e40851f1b85d8859161bbc8b50dda8da97bc07037473ebe239fe121a97" gracePeriod=45
Jul 02 21:05:23.404318 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.404260    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:05:23.430478 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.430446    2565 generic.go:356] "Generic (PLEG): container finished" podID="524f8971-9e7a-4986-9259-c26b67a00331" containerID="607e76e40851f1b85d8859161bbc8b50dda8da97bc07037473ebe239fe121a97" exitCode=0
Jul 02 21:05:23.430478 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.430479    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"
Jul 02 21:05:23.430708 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.430530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99" event={"ID":"524f8971-9e7a-4986-9259-c26b67a00331","Type":"ContainerDied","Data":"607e76e40851f1b85d8859161bbc8b50dda8da97bc07037473ebe239fe121a97"}
Jul 02 21:05:23.430708 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.430572    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99" event={"ID":"524f8971-9e7a-4986-9259-c26b67a00331","Type":"ContainerDied","Data":"98ea6be75e8c85dbc5856ab057d906ffa517d3594ff8ddd007157b826b6871e0"}
Jul 02 21:05:23.430708 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.430595    2565 scope.go:117] "RemoveContainer" containerID="607e76e40851f1b85d8859161bbc8b50dda8da97bc07037473ebe239fe121a97"
Jul 02 21:05:23.431916 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.431902    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"
Jul 02 21:05:23.432026 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.431932    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl" event={"ID":"f3f2c00a-2813-4da6-ac24-cacb3171c1d8","Type":"ContainerDied","Data":"03680ab4a9339cb68331780c4b2661104d2507ae5a0a3f76b12ae528f1c791f2"}
Jul 02 21:05:23.442124 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.442108    2565 scope.go:117] "RemoveContainer" containerID="607e76e40851f1b85d8859161bbc8b50dda8da97bc07037473ebe239fe121a97"
Jul 02 21:05:23.442351 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:05:23.442329    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"607e76e40851f1b85d8859161bbc8b50dda8da97bc07037473ebe239fe121a97\": container with ID starting with 607e76e40851f1b85d8859161bbc8b50dda8da97bc07037473ebe239fe121a97 not found: ID does not exist" containerID="607e76e40851f1b85d8859161bbc8b50dda8da97bc07037473ebe239fe121a97"
Jul 02 21:05:23.442435 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.442357    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"607e76e40851f1b85d8859161bbc8b50dda8da97bc07037473ebe239fe121a97"} err="failed to get container status \"607e76e40851f1b85d8859161bbc8b50dda8da97bc07037473ebe239fe121a97\": rpc error: code = NotFound desc = could not find container \"607e76e40851f1b85d8859161bbc8b50dda8da97bc07037473ebe239fe121a97\": container with ID starting with 607e76e40851f1b85d8859161bbc8b50dda8da97bc07037473ebe239fe121a97 not found: ID does not exist"
Jul 02 21:05:23.442435 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.442373    2565 scope.go:117] "RemoveContainer" containerID="880cedf0659aa8123247fae58780d81c91e8d931b3f992ca87eec9124dc75ecf"
Jul 02 21:05:23.455008 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.454987    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"]
Jul 02 21:05:23.460689 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.460671    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d9e8a3/test-model-d9e8a3-kserve-7877965f7c-fb7pl"]
Jul 02 21:05:23.507080 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.507062    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6h4x\" (UniqueName: \"kubernetes.io/projected/524f8971-9e7a-4986-9259-c26b67a00331-kube-api-access-t6h4x\") pod \"524f8971-9e7a-4986-9259-c26b67a00331\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") "
Jul 02 21:05:23.507194 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.507107    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-home\") pod \"524f8971-9e7a-4986-9259-c26b67a00331\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") "
Jul 02 21:05:23.507194 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.507131    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-tmp-dir\") pod \"524f8971-9e7a-4986-9259-c26b67a00331\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") "
Jul 02 21:05:23.507194 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.507153    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/524f8971-9e7a-4986-9259-c26b67a00331-tls-certs\") pod \"524f8971-9e7a-4986-9259-c26b67a00331\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") "
Jul 02 21:05:23.507377 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.507211    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-model-cache\") pod \"524f8971-9e7a-4986-9259-c26b67a00331\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") "
Jul 02 21:05:23.507377 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.507226    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-dshm\") pod \"524f8971-9e7a-4986-9259-c26b67a00331\" (UID: \"524f8971-9e7a-4986-9259-c26b67a00331\") "
Jul 02 21:05:23.507377 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.507325    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-home" (OuterVolumeSpecName: "home") pod "524f8971-9e7a-4986-9259-c26b67a00331" (UID: "524f8971-9e7a-4986-9259-c26b67a00331"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:23.507540 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.507371    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "524f8971-9e7a-4986-9259-c26b67a00331" (UID: "524f8971-9e7a-4986-9259-c26b67a00331"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:23.507540 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.507451    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-model-cache" (OuterVolumeSpecName: "model-cache") pod "524f8971-9e7a-4986-9259-c26b67a00331" (UID: "524f8971-9e7a-4986-9259-c26b67a00331"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:23.507647 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.507591    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-model-cache\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:23.507647 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.507605    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-home\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:23.507647 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.507613    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-tmp-dir\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:23.509291 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.509264    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-dshm" (OuterVolumeSpecName: "dshm") pod "524f8971-9e7a-4986-9259-c26b67a00331" (UID: "524f8971-9e7a-4986-9259-c26b67a00331"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:23.509291 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.509283    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/524f8971-9e7a-4986-9259-c26b67a00331-kube-api-access-t6h4x" (OuterVolumeSpecName: "kube-api-access-t6h4x") pod "524f8971-9e7a-4986-9259-c26b67a00331" (UID: "524f8971-9e7a-4986-9259-c26b67a00331"). InnerVolumeSpecName "kube-api-access-t6h4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:05:23.509448 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.509365    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/524f8971-9e7a-4986-9259-c26b67a00331-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "524f8971-9e7a-4986-9259-c26b67a00331" (UID: "524f8971-9e7a-4986-9259-c26b67a00331"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:05:23.609103 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.609072    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6h4x\" (UniqueName: \"kubernetes.io/projected/524f8971-9e7a-4986-9259-c26b67a00331-kube-api-access-t6h4x\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:23.609103 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.609099    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/524f8971-9e7a-4986-9259-c26b67a00331-tls-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:23.609294 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.609113    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/524f8971-9e7a-4986-9259-c26b67a00331-dshm\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:23.752517 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.752484    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"]
Jul 02 21:05:23.754666 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:23.754640    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-d34e2e/test-model-d34e2e-kserve-fb86f9dc-tmm99"]
Jul 02 21:05:24.299197 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:24.299162    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="524f8971-9e7a-4986-9259-c26b67a00331" path="/var/lib/kubelet/pods/524f8971-9e7a-4986-9259-c26b67a00331/volumes"
Jul 02 21:05:24.299587 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:24.299574    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3f2c00a-2813-4da6-ac24-cacb3171c1d8" path="/var/lib/kubelet/pods/f3f2c00a-2813-4da6-ac24-cacb3171c1d8/volumes"
Jul 02 21:05:50.429076 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:50.429045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:50.693569 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:50.693479    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"]
Jul 02 21:05:50.693777 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:50.693719    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj" podUID="37d93b20-3785-44c2-a300-44963284db74" containerName="istio-proxy" containerID="cri-o://fc6d39659448ae3995e7a0378eec9bfd0469301d1caebbae2ab7e81ded8d2848" gracePeriod=30
Jul 02 21:05:50.714882 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:50.714851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:50.967094 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:50.967010    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:51.125861 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:51.125826    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:51.546038 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:51.546005    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:51.646666 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:51.646629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:51.778603 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:51.778569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:55.946074 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:55.946050    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:05:56.009061 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.008990    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37d93b20-3785-44c2-a300-44963284db74-istio-token\") pod \"37d93b20-3785-44c2-a300-44963284db74\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") "
Jul 02 21:05:56.009061 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.009025    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-istio-envoy\") pod \"37d93b20-3785-44c2-a300-44963284db74\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") "
Jul 02 21:05:56.009061 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.009048    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-workload-socket\") pod \"37d93b20-3785-44c2-a300-44963284db74\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") "
Jul 02 21:05:56.009308 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.009163    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-credential-socket\") pod \"37d93b20-3785-44c2-a300-44963284db74\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") "
Jul 02 21:05:56.009308 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.009202    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-istio-data\") pod \"37d93b20-3785-44c2-a300-44963284db74\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") "
Jul 02 21:05:56.009308 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.009237    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-workload-certs\") pod \"37d93b20-3785-44c2-a300-44963284db74\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") "
Jul 02 21:05:56.009308 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.009273    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37d93b20-3785-44c2-a300-44963284db74-istio-podinfo\") pod \"37d93b20-3785-44c2-a300-44963284db74\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") "
Jul 02 21:05:56.009308 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.009287    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "37d93b20-3785-44c2-a300-44963284db74" (UID: "37d93b20-3785-44c2-a300-44963284db74"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:56.009565 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.009365    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkr9q\" (UniqueName: \"kubernetes.io/projected/37d93b20-3785-44c2-a300-44963284db74-kube-api-access-kkr9q\") pod \"37d93b20-3785-44c2-a300-44963284db74\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") "
Jul 02 21:05:56.009565 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.009412    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37d93b20-3785-44c2-a300-44963284db74-istiod-ca-cert\") pod \"37d93b20-3785-44c2-a300-44963284db74\" (UID: \"37d93b20-3785-44c2-a300-44963284db74\") "
Jul 02 21:05:56.009565 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.009444    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "37d93b20-3785-44c2-a300-44963284db74" (UID: "37d93b20-3785-44c2-a300-44963284db74"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:56.009565 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.009524    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "37d93b20-3785-44c2-a300-44963284db74" (UID: "37d93b20-3785-44c2-a300-44963284db74"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:56.009835 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.009812    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-workload-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:56.009835 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.009817    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37d93b20-3785-44c2-a300-44963284db74-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "37d93b20-3785-44c2-a300-44963284db74" (UID: "37d93b20-3785-44c2-a300-44963284db74"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:05:56.009984 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.009839    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-credential-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:56.009984 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.009854    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-workload-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:56.010087 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.010038    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-istio-data" (OuterVolumeSpecName: "istio-data") pod "37d93b20-3785-44c2-a300-44963284db74" (UID: "37d93b20-3785-44c2-a300-44963284db74"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:56.011236 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.011211    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37d93b20-3785-44c2-a300-44963284db74-istio-token" (OuterVolumeSpecName: "istio-token") pod "37d93b20-3785-44c2-a300-44963284db74" (UID: "37d93b20-3785-44c2-a300-44963284db74"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:05:56.011435 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.011415    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37d93b20-3785-44c2-a300-44963284db74-kube-api-access-kkr9q" (OuterVolumeSpecName: "kube-api-access-kkr9q") pod "37d93b20-3785-44c2-a300-44963284db74" (UID: "37d93b20-3785-44c2-a300-44963284db74"). InnerVolumeSpecName "kube-api-access-kkr9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:05:56.011937 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.011912    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37d93b20-3785-44c2-a300-44963284db74-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "37d93b20-3785-44c2-a300-44963284db74" (UID: "37d93b20-3785-44c2-a300-44963284db74"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 21:05:56.012005 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.011935    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "37d93b20-3785-44c2-a300-44963284db74" (UID: "37d93b20-3785-44c2-a300-44963284db74"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:56.110608 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.110568    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkr9q\" (UniqueName: \"kubernetes.io/projected/37d93b20-3785-44c2-a300-44963284db74-kube-api-access-kkr9q\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:56.110608 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.110601    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37d93b20-3785-44c2-a300-44963284db74-istiod-ca-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:56.110608 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.110610    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37d93b20-3785-44c2-a300-44963284db74-istio-token\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:56.110608 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.110618    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-istio-envoy\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:56.110897 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.110627    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37d93b20-3785-44c2-a300-44963284db74-istio-data\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:56.110897 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.110635    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37d93b20-3785-44c2-a300-44963284db74-istio-podinfo\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:05:56.611624 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.611589    2565 generic.go:356] "Generic (PLEG): container finished" podID="37d93b20-3785-44c2-a300-44963284db74" containerID="fc6d39659448ae3995e7a0378eec9bfd0469301d1caebbae2ab7e81ded8d2848" exitCode=0
Jul 02 21:05:56.611821 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.611640    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"
Jul 02 21:05:56.611821 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.611679    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj" event={"ID":"37d93b20-3785-44c2-a300-44963284db74","Type":"ContainerDied","Data":"fc6d39659448ae3995e7a0378eec9bfd0469301d1caebbae2ab7e81ded8d2848"}
Jul 02 21:05:56.611821 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.611742    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj" event={"ID":"37d93b20-3785-44c2-a300-44963284db74","Type":"ContainerDied","Data":"56ef37fe2b20d0afe9b6ec59199d40119538ce93615e1913a218e04e8bc6e486"}
Jul 02 21:05:56.611821 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.611781    2565 scope.go:117] "RemoveContainer" containerID="fc6d39659448ae3995e7a0378eec9bfd0469301d1caebbae2ab7e81ded8d2848"
Jul 02 21:05:56.620782 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.620748    2565 scope.go:117] "RemoveContainer" containerID="7d55fd7f05fae2404724b2cc9ea9506f5880efdae3dde87c22fa2a2ddcc88928"
Jul 02 21:05:56.628965 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.628945    2565 scope.go:117] "RemoveContainer" containerID="fc6d39659448ae3995e7a0378eec9bfd0469301d1caebbae2ab7e81ded8d2848"
Jul 02 21:05:56.629217 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:05:56.629196    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc6d39659448ae3995e7a0378eec9bfd0469301d1caebbae2ab7e81ded8d2848\": container with ID starting with fc6d39659448ae3995e7a0378eec9bfd0469301d1caebbae2ab7e81ded8d2848 not found: ID does not exist" containerID="fc6d39659448ae3995e7a0378eec9bfd0469301d1caebbae2ab7e81ded8d2848"
Jul 02 21:05:56.629275 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.629227    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6d39659448ae3995e7a0378eec9bfd0469301d1caebbae2ab7e81ded8d2848"} err="failed to get container status \"fc6d39659448ae3995e7a0378eec9bfd0469301d1caebbae2ab7e81ded8d2848\": rpc error: code = NotFound desc = could not find container \"fc6d39659448ae3995e7a0378eec9bfd0469301d1caebbae2ab7e81ded8d2848\": container with ID starting with fc6d39659448ae3995e7a0378eec9bfd0469301d1caebbae2ab7e81ded8d2848 not found: ID does not exist"
Jul 02 21:05:56.629275 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.629243    2565 scope.go:117] "RemoveContainer" containerID="7d55fd7f05fae2404724b2cc9ea9506f5880efdae3dde87c22fa2a2ddcc88928"
Jul 02 21:05:56.629507 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:05:56.629486    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d55fd7f05fae2404724b2cc9ea9506f5880efdae3dde87c22fa2a2ddcc88928\": container with ID starting with 7d55fd7f05fae2404724b2cc9ea9506f5880efdae3dde87c22fa2a2ddcc88928 not found: ID does not exist" containerID="7d55fd7f05fae2404724b2cc9ea9506f5880efdae3dde87c22fa2a2ddcc88928"
Jul 02 21:05:56.629551 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.629517    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d55fd7f05fae2404724b2cc9ea9506f5880efdae3dde87c22fa2a2ddcc88928"} err="failed to get container status \"7d55fd7f05fae2404724b2cc9ea9506f5880efdae3dde87c22fa2a2ddcc88928\": rpc error: code = NotFound desc = could not find container \"7d55fd7f05fae2404724b2cc9ea9506f5880efdae3dde87c22fa2a2ddcc88928\": container with ID starting with 7d55fd7f05fae2404724b2cc9ea9506f5880efdae3dde87c22fa2a2ddcc88928 not found: ID does not exist"
Jul 02 21:05:56.630235 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.630217    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"]
Jul 02 21:05:56.633384 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.633362    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj"]
Jul 02 21:05:56.876432 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.876339    2565 patch_prober.go:28] interesting pod/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 02 21:05:56.876432 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:56.876404    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d9e8a3-openshift-default-7bc948c485-z4bkj" podUID="37d93b20-3785-44c2-a300-44963284db74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 21:05:57.441721 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:57.441666    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:57.499617 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:57.499548    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:57.711450 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:57.711362    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"]
Jul 02 21:05:57.711607 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:57.711561    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz" podUID="e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" containerName="istio-proxy" containerID="cri-o://84f4b178a3b84bef11a524f42ed6eb1e883247386d8193ca83352193c7fea1fd" gracePeriod=30
Jul 02 21:05:57.725629 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:57.725602    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:57.972709 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:57.972631    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:58.299512 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.299429    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37d93b20-3785-44c2-a300-44963284db74" path="/var/lib/kubelet/pods/37d93b20-3785-44c2-a300-44963284db74/volumes"
Jul 02 21:05:58.349345 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.349314    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:58.653920 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.653884    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"]
Jul 02 21:05:58.654360 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.654335    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37d93b20-3785-44c2-a300-44963284db74" containerName="istio-proxy"
Jul 02 21:05:58.654360 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.654355    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="37d93b20-3785-44c2-a300-44963284db74" containerName="istio-proxy"
Jul 02 21:05:58.654440 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.654374    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37d93b20-3785-44c2-a300-44963284db74" containerName="istio-proxy"
Jul 02 21:05:58.654440 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.654383    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="37d93b20-3785-44c2-a300-44963284db74" containerName="istio-proxy"
Jul 02 21:05:58.654440 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.654393    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3f2c00a-2813-4da6-ac24-cacb3171c1d8" containerName="main"
Jul 02 21:05:58.654440 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.654402    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3f2c00a-2813-4da6-ac24-cacb3171c1d8" containerName="main"
Jul 02 21:05:58.654440 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.654422    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524f8971-9e7a-4986-9259-c26b67a00331" containerName="main"
Jul 02 21:05:58.654440 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.654430    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="524f8971-9e7a-4986-9259-c26b67a00331" containerName="main"
Jul 02 21:05:58.654675 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.654506    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="524f8971-9e7a-4986-9259-c26b67a00331" containerName="main"
Jul 02 21:05:58.654675 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.654521    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3f2c00a-2813-4da6-ac24-cacb3171c1d8" containerName="main"
Jul 02 21:05:58.654675 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.654530    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="37d93b20-3785-44c2-a300-44963284db74" containerName="istio-proxy"
Jul 02 21:05:58.654675 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.654539    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="37d93b20-3785-44c2-a300-44963284db74" containerName="istio-proxy"
Jul 02 21:05:58.659186 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.659167    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.661716 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.661699    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-586d03-openshift-default-dockercfg-5qkl9\""
Jul 02 21:05:58.668720 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.668699    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"]
Jul 02 21:05:58.684128 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.684100    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:58.734195 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.734159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-data\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.734195 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.734197    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wpks\" (UniqueName: \"kubernetes.io/projected/c6600e98-c44d-4294-8ad7-42296ce8a046-kube-api-access-7wpks\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.734379 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.734217    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-workload-certs\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.734379 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.734289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-envoy\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.734379 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.734340    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-workload-socket\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.734379 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.734375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-token\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.734507 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.734401    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-credential-socket\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.734507 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.734438    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-podinfo\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.734507 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.734466    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6600e98-c44d-4294-8ad7-42296ce8a046-istiod-ca-cert\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.835108 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.835069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-workload-certs\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.835318 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.835122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-envoy\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.835318 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.835167    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-workload-socket\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.835318 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.835205    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-token\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.835318 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.835239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-credential-socket\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.835318 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.835260    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-podinfo\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.835318 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.835290    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6600e98-c44d-4294-8ad7-42296ce8a046-istiod-ca-cert\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.835685 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.835386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-data\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.835685 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.835417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wpks\" (UniqueName: \"kubernetes.io/projected/c6600e98-c44d-4294-8ad7-42296ce8a046-kube-api-access-7wpks\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.835685 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.835521    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-workload-certs\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.835685 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.835627    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-workload-socket\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.835871 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.835812    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-data\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.835871 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.835836    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-credential-socket\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.836070 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.836052    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6600e98-c44d-4294-8ad7-42296ce8a046-istiod-ca-cert\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.837498 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.837477    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-envoy\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.837700 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.837682    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-podinfo\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.844394 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.844376    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-token\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.846907 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.846882    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wpks\" (UniqueName: \"kubernetes.io/projected/c6600e98-c44d-4294-8ad7-42296ce8a046-kube-api-access-7wpks\") pod \"e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") " pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.970825 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.970735    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:05:58.994516 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:58.994481    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:59.107144 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:59.107116    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"]
Jul 02 21:05:59.108919 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:05:59.108894    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6600e98_c44d_4294_8ad7_42296ce8a046.slice/crio-6d4993b67a3be9a6ffe60adb3f245f984a483472f8dcce1bbc92f2057748803f WatchSource:0}: Error finding container 6d4993b67a3be9a6ffe60adb3f245f984a483472f8dcce1bbc92f2057748803f: Status 404 returned error can't find the container with id 6d4993b67a3be9a6ffe60adb3f245f984a483472f8dcce1bbc92f2057748803f
Jul 02 21:05:59.111031 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:59.111002    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:05:59.111091 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:59.111066    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:05:59.111128 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:59.111094    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:05:59.630280 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:59.630244    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4" event={"ID":"c6600e98-c44d-4294-8ad7-42296ce8a046","Type":"ContainerStarted","Data":"78298b8ae47ee069bfad1f7942e56a5767d26c1645e461ec088740d874d21e29"}
Jul 02 21:05:59.630425 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:59.630298    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4" event={"ID":"c6600e98-c44d-4294-8ad7-42296ce8a046","Type":"ContainerStarted","Data":"6d4993b67a3be9a6ffe60adb3f245f984a483472f8dcce1bbc92f2057748803f"}
Jul 02 21:05:59.651282 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:59.651229    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4" podStartSLOduration=1.651212034 podStartE2EDuration="1.651212034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:05:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:05:59.649015133 +0000 UTC m=+2003.772026703" watchObservedRunningTime="2026-07-02 21:05:59.651212034 +0000 UTC m=+2003.774223604"
Jul 02 21:05:59.971022 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:05:59.970940    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:06:00.976152 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:00.976124    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:06:01.642062 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:01.642031    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:06:01.643175 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:01.643154    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:06:01.739961 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:01.739929    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:01.811364 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:01.811331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:01.878814 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:01.878738    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:01.985333 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:01.985246    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:02.303451 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:02.303357    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:02.403572 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:02.403531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:02.594186 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:02.594149    2565 patch_prober.go:28] interesting pod/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 21:06:02.594336 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:02.594220    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz" podUID="e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 21:06:02.967919 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:02.967891    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:06:03.077713 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.077672    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-workload-socket\") pod \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") "
Jul 02 21:06:03.078123 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.077795    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-token\") pod \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") "
Jul 02 21:06:03.078123 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.077838    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-podinfo\") pod \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") "
Jul 02 21:06:03.078123 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.077898    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-envoy\") pod \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") "
Jul 02 21:06:03.078123 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.077958    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-data\") pod \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") "
Jul 02 21:06:03.078123 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.077993    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istiod-ca-cert\") pod \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") "
Jul 02 21:06:03.078123 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.078012    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" (UID: "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:06:03.078123 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.078022    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-workload-certs\") pod \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") "
Jul 02 21:06:03.078123 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.078059    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72nnv\" (UniqueName: \"kubernetes.io/projected/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-kube-api-access-72nnv\") pod \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") "
Jul 02 21:06:03.078123 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.078089    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-credential-socket\") pod \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\" (UID: \"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4\") "
Jul 02 21:06:03.078626 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.078351    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" (UID: "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:06:03.078626 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.078428    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istiod-ca-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:03.078626 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.078446    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-workload-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:03.078626 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.078511    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" (UID: "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:06:03.078861 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.078681    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" (UID: "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:06:03.078929 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.078900    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-data" (OuterVolumeSpecName: "istio-data") pod "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" (UID: "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:06:03.080520 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.080497    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" (UID: "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 21:06:03.080593 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.080525    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" (UID: "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:06:03.080706 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.080684    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-kube-api-access-72nnv" (OuterVolumeSpecName: "kube-api-access-72nnv") pod "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" (UID: "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4"). InnerVolumeSpecName "kube-api-access-72nnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:06:03.080802 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.080784    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" (UID: "e1f7dd01-ab5d-464b-b9a5-cd12acc466b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:06:03.179567 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.179485    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-token\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:03.179567 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.179509    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-podinfo\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:03.179567 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.179523    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-envoy\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:03.179567 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.179536    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-istio-data\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:03.179567 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.179543    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-workload-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:03.179567 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.179552    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72nnv\" (UniqueName: \"kubernetes.io/projected/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-kube-api-access-72nnv\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:03.179567 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.179561    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4-credential-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:03.653433 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.653396    2565 generic.go:356] "Generic (PLEG): container finished" podID="e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" containerID="84f4b178a3b84bef11a524f42ed6eb1e883247386d8193ca83352193c7fea1fd" exitCode=0
Jul 02 21:06:03.653630 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.653448    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"
Jul 02 21:06:03.653630 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.653476    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz" event={"ID":"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4","Type":"ContainerDied","Data":"84f4b178a3b84bef11a524f42ed6eb1e883247386d8193ca83352193c7fea1fd"}
Jul 02 21:06:03.653630 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.653527    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz" event={"ID":"e1f7dd01-ab5d-464b-b9a5-cd12acc466b4","Type":"ContainerDied","Data":"cd5b71ea676afa725c10e36a3844ed505194de5bf7233d9111f0a06990ad6edc"}
Jul 02 21:06:03.653630 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.653553    2565 scope.go:117] "RemoveContainer" containerID="84f4b178a3b84bef11a524f42ed6eb1e883247386d8193ca83352193c7fea1fd"
Jul 02 21:06:03.663134 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.663110    2565 scope.go:117] "RemoveContainer" containerID="15456f66f43b7c8dfad7e24c3d8ee0b983c2a388308a4e01ef55f3f21e1717c2"
Jul 02 21:06:03.671460 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.671441    2565 scope.go:117] "RemoveContainer" containerID="84f4b178a3b84bef11a524f42ed6eb1e883247386d8193ca83352193c7fea1fd"
Jul 02 21:06:03.671700 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:06:03.671668    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84f4b178a3b84bef11a524f42ed6eb1e883247386d8193ca83352193c7fea1fd\": container with ID starting with 84f4b178a3b84bef11a524f42ed6eb1e883247386d8193ca83352193c7fea1fd not found: ID does not exist" containerID="84f4b178a3b84bef11a524f42ed6eb1e883247386d8193ca83352193c7fea1fd"
Jul 02 21:06:03.671750 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.671708    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84f4b178a3b84bef11a524f42ed6eb1e883247386d8193ca83352193c7fea1fd"} err="failed to get container status \"84f4b178a3b84bef11a524f42ed6eb1e883247386d8193ca83352193c7fea1fd\": rpc error: code = NotFound desc = could not find container \"84f4b178a3b84bef11a524f42ed6eb1e883247386d8193ca83352193c7fea1fd\": container with ID starting with 84f4b178a3b84bef11a524f42ed6eb1e883247386d8193ca83352193c7fea1fd not found: ID does not exist"
Jul 02 21:06:03.671750 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.671726    2565 scope.go:117] "RemoveContainer" containerID="15456f66f43b7c8dfad7e24c3d8ee0b983c2a388308a4e01ef55f3f21e1717c2"
Jul 02 21:06:03.672006 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:06:03.671984    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15456f66f43b7c8dfad7e24c3d8ee0b983c2a388308a4e01ef55f3f21e1717c2\": container with ID starting with 15456f66f43b7c8dfad7e24c3d8ee0b983c2a388308a4e01ef55f3f21e1717c2 not found: ID does not exist" containerID="15456f66f43b7c8dfad7e24c3d8ee0b983c2a388308a4e01ef55f3f21e1717c2"
Jul 02 21:06:03.672058 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.672011    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15456f66f43b7c8dfad7e24c3d8ee0b983c2a388308a4e01ef55f3f21e1717c2"} err="failed to get container status \"15456f66f43b7c8dfad7e24c3d8ee0b983c2a388308a4e01ef55f3f21e1717c2\": rpc error: code = NotFound desc = could not find container \"15456f66f43b7c8dfad7e24c3d8ee0b983c2a388308a4e01ef55f3f21e1717c2\": container with ID starting with 15456f66f43b7c8dfad7e24c3d8ee0b983c2a388308a4e01ef55f3f21e1717c2 not found: ID does not exist"
Jul 02 21:06:03.678014 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.677993    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"]
Jul 02 21:06:03.681616 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:03.681595    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-d34e2e-openshift-default-7bfc48fc69-t2hjz"]
Jul 02 21:06:04.299259 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:04.299229    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" path="/var/lib/kubelet/pods/e1f7dd01-ab5d-464b-b9a5-cd12acc466b4/volumes"
Jul 02 21:06:06.295817 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:06.295776    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:06.783668 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:06.783634    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:07.077967 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.077870    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"]
Jul 02 21:06:07.078252 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.078239    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" containerName="istio-proxy"
Jul 02 21:06:07.078252 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.078253    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" containerName="istio-proxy"
Jul 02 21:06:07.078370 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.078263    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" containerName="istio-proxy"
Jul 02 21:06:07.078370 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.078270    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" containerName="istio-proxy"
Jul 02 21:06:07.078370 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.078325    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" containerName="istio-proxy"
Jul 02 21:06:07.078370 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.078335    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1f7dd01-ab5d-464b-b9a5-cd12acc466b4" containerName="istio-proxy"
Jul 02 21:06:07.083090 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.083067    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.085629 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.085612    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ff2295-openshift-default-dockercfg-ttl7x\""
Jul 02 21:06:07.094577 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.094550    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"]
Jul 02 21:06:07.107492 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.107462    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:07.218683 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.218649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-token\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.218683 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.218685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-podinfo\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.218914 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.218713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-workload-socket\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.218914 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.218797    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mccxv\" (UniqueName: \"kubernetes.io/projected/77bb806d-1a37-4b1f-ad73-60922662bb43-kube-api-access-mccxv\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.218914 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.218838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77bb806d-1a37-4b1f-ad73-60922662bb43-istiod-ca-cert\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.218914 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.218853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-workload-certs\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.218914 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.218866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-data\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.219132 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.218966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-envoy\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.219132 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.219014    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-credential-socket\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.320418 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.320385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-token\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.320418 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.320421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-podinfo\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.321011 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.320450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-workload-socket\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.321011 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.320579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mccxv\" (UniqueName: \"kubernetes.io/projected/77bb806d-1a37-4b1f-ad73-60922662bb43-kube-api-access-mccxv\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.321011 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.320653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77bb806d-1a37-4b1f-ad73-60922662bb43-istiod-ca-cert\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.321011 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.320685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-workload-certs\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.321011 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.320711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-data\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.321011 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.320799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-envoy\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.321011 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.320852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-credential-socket\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.321011 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.320866    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-workload-socket\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.321382 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.321054    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-workload-certs\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.321382 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.321118    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-data\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.321382 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.321183    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-credential-socket\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.321382 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.321362    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77bb806d-1a37-4b1f-ad73-60922662bb43-istiod-ca-cert\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.322876 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.322853    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-envoy\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.322972 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.322918    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-podinfo\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.325579 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.325557    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:07.328483 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.328430    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-token\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.328708 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.328692    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mccxv\" (UniqueName: \"kubernetes.io/projected/77bb806d-1a37-4b1f-ad73-60922662bb43-kube-api-access-mccxv\") pod \"e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") " pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.395533 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.395498    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:07.531921 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.531897    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"]
Jul 02 21:06:07.532942 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:06:07.532915    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77bb806d_1a37_4b1f_ad73_60922662bb43.slice/crio-9be18f7b4fb699a85dd26ba232875625bfa8e5361e180fd964025f08bdd7e252 WatchSource:0}: Error finding container 9be18f7b4fb699a85dd26ba232875625bfa8e5361e180fd964025f08bdd7e252: Status 404 returned error can't find the container with id 9be18f7b4fb699a85dd26ba232875625bfa8e5361e180fd964025f08bdd7e252
Jul 02 21:06:07.535176 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.535141    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:07.535246 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.535227    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:07.535314 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.535289    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:07.679904 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.679847    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t" event={"ID":"77bb806d-1a37-4b1f-ad73-60922662bb43","Type":"ContainerStarted","Data":"0de2ab89588efdd53837249abac37a1457d1f1ad5caf671346e192e604e37016"}
Jul 02 21:06:07.680203 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.679924    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t" event={"ID":"77bb806d-1a37-4b1f-ad73-60922662bb43","Type":"ContainerStarted","Data":"9be18f7b4fb699a85dd26ba232875625bfa8e5361e180fd964025f08bdd7e252"}
Jul 02 21:06:07.700180 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:07.699990    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t" podStartSLOduration=0.69995835 podStartE2EDuration="699.95835ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:06:07.699477268 +0000 UTC m=+2011.822488837" watchObservedRunningTime="2026-07-02 21:06:07.69995835 +0000 UTC m=+2011.822969914"
Jul 02 21:06:08.396109 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:08.396074    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:08.401398 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:08.401376    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:08.687424 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:08.687338    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:08.688404 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:08.688385    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:09.748347 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:09.748252    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:09.843669 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:09.843632    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:09.899742 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:09.899708    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:10.145212 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:10.145175    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:10.481471 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:10.481387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:10.582015 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:10.581983    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:14.297025 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:14.296986    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:16.644330 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:16.644280    2565 patch_prober.go:28] interesting pod/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 02 21:06:16.644921 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:16.644370    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4" podUID="c6600e98-c44d-4294-8ad7-42296ce8a046" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 02 21:06:16.741675 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:16.741633    2565 generic.go:356] "Generic (PLEG): container finished" podID="c6600e98-c44d-4294-8ad7-42296ce8a046" containerID="78298b8ae47ee069bfad1f7942e56a5767d26c1645e461ec088740d874d21e29" exitCode=0
Jul 02 21:06:16.741897 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:16.741706    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4" event={"ID":"c6600e98-c44d-4294-8ad7-42296ce8a046","Type":"ContainerDied","Data":"78298b8ae47ee069bfad1f7942e56a5767d26c1645e461ec088740d874d21e29"}
Jul 02 21:06:16.742262 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:16.742237    2565 scope.go:117] "RemoveContainer" containerID="78298b8ae47ee069bfad1f7942e56a5767d26c1645e461ec088740d874d21e29"
Jul 02 21:06:16.744198 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:16.744159    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:16.744314 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:16.744250    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:16.744314 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:16.744295    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:17.752707 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:17.752663    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4" event={"ID":"c6600e98-c44d-4294-8ad7-42296ce8a046","Type":"ContainerStarted","Data":"2ee25aef9aa3cbab45ae4bd33520d546cc48e3578e806d7ab7304a92e33d5351"}
Jul 02 21:06:17.971996 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:17.971184    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:06:17.971996 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:17.971327    2565 patch_prober.go:28] interesting pod/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 02 21:06:17.971996 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:17.971374    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4" podUID="c6600e98-c44d-4294-8ad7-42296ce8a046" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 02 21:06:18.971988 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:18.971946    2565 patch_prober.go:28] interesting pod/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 02 21:06:18.972404 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:18.972004    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4" podUID="c6600e98-c44d-4294-8ad7-42296ce8a046" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 02 21:06:19.971241 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:19.971201    2565 patch_prober.go:28] interesting pod/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 02 21:06:19.971404 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:19.971259    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4" podUID="c6600e98-c44d-4294-8ad7-42296ce8a046" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 02 21:06:20.971421 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:20.971376    2565 patch_prober.go:28] interesting pod/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 02 21:06:20.971849 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:20.971454    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4" podUID="c6600e98-c44d-4294-8ad7-42296ce8a046" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 02 21:06:21.779293 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:21.779199    2565 generic.go:356] "Generic (PLEG): container finished" podID="77bb806d-1a37-4b1f-ad73-60922662bb43" containerID="0de2ab89588efdd53837249abac37a1457d1f1ad5caf671346e192e604e37016" exitCode=0
Jul 02 21:06:21.779293 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:21.779273    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t" event={"ID":"77bb806d-1a37-4b1f-ad73-60922662bb43","Type":"ContainerDied","Data":"0de2ab89588efdd53837249abac37a1457d1f1ad5caf671346e192e604e37016"}
Jul 02 21:06:21.779768 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:21.779741    2565 scope.go:117] "RemoveContainer" containerID="0de2ab89588efdd53837249abac37a1457d1f1ad5caf671346e192e604e37016"
Jul 02 21:06:21.780830 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:21.780803    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:21.780926 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:21.780869    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:21.780926 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:21.780899    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:21.975354 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:21.975322    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:06:21.975806 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:21.975711    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:06:21.976472 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:21.976454    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:06:22.578866 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:22.578779    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:22.787144 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:22.787113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t" event={"ID":"77bb806d-1a37-4b1f-ad73-60922662bb43","Type":"ContainerStarted","Data":"82f77ec41b6222279faf216352962a7440d60b7ffc82b119e349507068a10515"}
Jul 02 21:06:22.991941 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:22.991904    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:23.092746 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:23.092713    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:23.243837 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:23.242155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:23.395671 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:23.395635    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:23.396840 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:23.396811    2565 patch_prober.go:28] interesting pod/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 02 21:06:23.396987 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:23.396868    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t" podUID="77bb806d-1a37-4b1f-ad73-60922662bb43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 02 21:06:23.687588 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:23.687555    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:24.396373 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:24.396333    2565 patch_prober.go:28] interesting pod/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 02 21:06:24.396846 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:24.396394    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t" podUID="77bb806d-1a37-4b1f-ad73-60922662bb43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 02 21:06:25.396275 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:25.396231    2565 patch_prober.go:28] interesting pod/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 02 21:06:25.396488 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:25.396295    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t" podUID="77bb806d-1a37-4b1f-ad73-60922662bb43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 02 21:06:26.396633 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:26.396595    2565 patch_prober.go:28] interesting pod/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 02 21:06:26.397040 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:26.396660    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t" podUID="77bb806d-1a37-4b1f-ad73-60922662bb43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 02 21:06:27.400174 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:27.400141    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:27.401038 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:27.401017    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:28.608895 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:28.608863    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:28.667752 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:28.667717    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:28.849638 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:28.849600    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"]
Jul 02 21:06:28.849874 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:28.849849    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4" podUID="c6600e98-c44d-4294-8ad7-42296ce8a046" containerName="istio-proxy" containerID="cri-o://2ee25aef9aa3cbab45ae4bd33520d546cc48e3578e806d7ab7304a92e33d5351" gracePeriod=30
Jul 02 21:06:28.868907 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:28.868832    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:29.098048 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:29.098014    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:29.280046 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:29.279965    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:29.676495 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:29.676462    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:29.824841 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:29.824802    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:29.923590 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:29.923556    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:30.056537 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:30.056458    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:34.113410 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.113354    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:06:34.184991 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.184959    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-credential-socket\") pod \"c6600e98-c44d-4294-8ad7-42296ce8a046\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") "
Jul 02 21:06:34.185165 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.185033    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-podinfo\") pod \"c6600e98-c44d-4294-8ad7-42296ce8a046\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") "
Jul 02 21:06:34.185165 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.185070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-workload-socket\") pod \"c6600e98-c44d-4294-8ad7-42296ce8a046\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") "
Jul 02 21:06:34.185165 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.185096    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-data\") pod \"c6600e98-c44d-4294-8ad7-42296ce8a046\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") "
Jul 02 21:06:34.185165 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.185131    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-envoy\") pod \"c6600e98-c44d-4294-8ad7-42296ce8a046\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") "
Jul 02 21:06:34.185387 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.185168    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wpks\" (UniqueName: \"kubernetes.io/projected/c6600e98-c44d-4294-8ad7-42296ce8a046-kube-api-access-7wpks\") pod \"c6600e98-c44d-4294-8ad7-42296ce8a046\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") "
Jul 02 21:06:34.185387 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.185216    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-token\") pod \"c6600e98-c44d-4294-8ad7-42296ce8a046\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") "
Jul 02 21:06:34.185387 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.185218    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c6600e98-c44d-4294-8ad7-42296ce8a046" (UID: "c6600e98-c44d-4294-8ad7-42296ce8a046"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:06:34.185387 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.185240    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6600e98-c44d-4294-8ad7-42296ce8a046-istiod-ca-cert\") pod \"c6600e98-c44d-4294-8ad7-42296ce8a046\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") "
Jul 02 21:06:34.185387 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.185289    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-workload-certs\") pod \"c6600e98-c44d-4294-8ad7-42296ce8a046\" (UID: \"c6600e98-c44d-4294-8ad7-42296ce8a046\") "
Jul 02 21:06:34.185387 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.185349    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c6600e98-c44d-4294-8ad7-42296ce8a046" (UID: "c6600e98-c44d-4294-8ad7-42296ce8a046"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:06:34.185660 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.185607    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c6600e98-c44d-4294-8ad7-42296ce8a046" (UID: "c6600e98-c44d-4294-8ad7-42296ce8a046"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:06:34.185660 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.185613    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-credential-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:34.185660 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.185634    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6600e98-c44d-4294-8ad7-42296ce8a046-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c6600e98-c44d-4294-8ad7-42296ce8a046" (UID: "c6600e98-c44d-4294-8ad7-42296ce8a046"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:06:34.185660 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.185647    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-workload-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:34.186208 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.186179    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-data" (OuterVolumeSpecName: "istio-data") pod "c6600e98-c44d-4294-8ad7-42296ce8a046" (UID: "c6600e98-c44d-4294-8ad7-42296ce8a046"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:06:34.187228 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.187200    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c6600e98-c44d-4294-8ad7-42296ce8a046" (UID: "c6600e98-c44d-4294-8ad7-42296ce8a046"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 21:06:34.187354 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.187337    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-token" (OuterVolumeSpecName: "istio-token") pod "c6600e98-c44d-4294-8ad7-42296ce8a046" (UID: "c6600e98-c44d-4294-8ad7-42296ce8a046"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:06:34.187415 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.187397    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c6600e98-c44d-4294-8ad7-42296ce8a046" (UID: "c6600e98-c44d-4294-8ad7-42296ce8a046"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:06:34.187606 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.187591    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6600e98-c44d-4294-8ad7-42296ce8a046-kube-api-access-7wpks" (OuterVolumeSpecName: "kube-api-access-7wpks") pod "c6600e98-c44d-4294-8ad7-42296ce8a046" (UID: "c6600e98-c44d-4294-8ad7-42296ce8a046"). InnerVolumeSpecName "kube-api-access-7wpks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:06:34.287035 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.286999    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-podinfo\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:34.287035 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.287028    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-data\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:34.287035 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.287040    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-envoy\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:34.287274 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.287051    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wpks\" (UniqueName: \"kubernetes.io/projected/c6600e98-c44d-4294-8ad7-42296ce8a046-kube-api-access-7wpks\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:34.287274 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.287064    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6600e98-c44d-4294-8ad7-42296ce8a046-istio-token\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:34.287274 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.287076    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6600e98-c44d-4294-8ad7-42296ce8a046-istiod-ca-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:34.287274 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.287087    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6600e98-c44d-4294-8ad7-42296ce8a046-workload-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:34.861191 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.861152    2565 generic.go:356] "Generic (PLEG): container finished" podID="c6600e98-c44d-4294-8ad7-42296ce8a046" containerID="2ee25aef9aa3cbab45ae4bd33520d546cc48e3578e806d7ab7304a92e33d5351" exitCode=0
Jul 02 21:06:34.861339 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.861204    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"
Jul 02 21:06:34.861339 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.861236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4" event={"ID":"c6600e98-c44d-4294-8ad7-42296ce8a046","Type":"ContainerDied","Data":"2ee25aef9aa3cbab45ae4bd33520d546cc48e3578e806d7ab7304a92e33d5351"}
Jul 02 21:06:34.861339 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.861293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4" event={"ID":"c6600e98-c44d-4294-8ad7-42296ce8a046","Type":"ContainerDied","Data":"6d4993b67a3be9a6ffe60adb3f245f984a483472f8dcce1bbc92f2057748803f"}
Jul 02 21:06:34.861339 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.861321    2565 scope.go:117] "RemoveContainer" containerID="2ee25aef9aa3cbab45ae4bd33520d546cc48e3578e806d7ab7304a92e33d5351"
Jul 02 21:06:34.870747 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.870692    2565 scope.go:117] "RemoveContainer" containerID="78298b8ae47ee069bfad1f7942e56a5767d26c1645e461ec088740d874d21e29"
Jul 02 21:06:34.880009 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.879983    2565 scope.go:117] "RemoveContainer" containerID="2ee25aef9aa3cbab45ae4bd33520d546cc48e3578e806d7ab7304a92e33d5351"
Jul 02 21:06:34.880299 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:06:34.880279    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ee25aef9aa3cbab45ae4bd33520d546cc48e3578e806d7ab7304a92e33d5351\": container with ID starting with 2ee25aef9aa3cbab45ae4bd33520d546cc48e3578e806d7ab7304a92e33d5351 not found: ID does not exist" containerID="2ee25aef9aa3cbab45ae4bd33520d546cc48e3578e806d7ab7304a92e33d5351"
Jul 02 21:06:34.880393 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.880312    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ee25aef9aa3cbab45ae4bd33520d546cc48e3578e806d7ab7304a92e33d5351"} err="failed to get container status \"2ee25aef9aa3cbab45ae4bd33520d546cc48e3578e806d7ab7304a92e33d5351\": rpc error: code = NotFound desc = could not find container \"2ee25aef9aa3cbab45ae4bd33520d546cc48e3578e806d7ab7304a92e33d5351\": container with ID starting with 2ee25aef9aa3cbab45ae4bd33520d546cc48e3578e806d7ab7304a92e33d5351 not found: ID does not exist"
Jul 02 21:06:34.880393 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.880336    2565 scope.go:117] "RemoveContainer" containerID="78298b8ae47ee069bfad1f7942e56a5767d26c1645e461ec088740d874d21e29"
Jul 02 21:06:34.880575 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.880558    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"]
Jul 02 21:06:34.880618 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:06:34.880583    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78298b8ae47ee069bfad1f7942e56a5767d26c1645e461ec088740d874d21e29\": container with ID starting with 78298b8ae47ee069bfad1f7942e56a5767d26c1645e461ec088740d874d21e29 not found: ID does not exist" containerID="78298b8ae47ee069bfad1f7942e56a5767d26c1645e461ec088740d874d21e29"
Jul 02 21:06:34.880618 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.880606    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78298b8ae47ee069bfad1f7942e56a5767d26c1645e461ec088740d874d21e29"} err="failed to get container status \"78298b8ae47ee069bfad1f7942e56a5767d26c1645e461ec088740d874d21e29\": rpc error: code = NotFound desc = could not find container \"78298b8ae47ee069bfad1f7942e56a5767d26c1645e461ec088740d874d21e29\": container with ID starting with 78298b8ae47ee069bfad1f7942e56a5767d26c1645e461ec088740d874d21e29 not found: ID does not exist"
Jul 02 21:06:34.884019 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:34.883999    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-586d03-openshift-default-7f455fb95f-thdx4"]
Jul 02 21:06:35.490428 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:35.490398    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:35.593350 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:35.593318    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:35.750627 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:35.750550    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"]
Jul 02 21:06:35.750801 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:35.750772    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t" podUID="77bb806d-1a37-4b1f-ad73-60922662bb43" containerName="istio-proxy" containerID="cri-o://82f77ec41b6222279faf216352962a7440d60b7ffc82b119e349507068a10515" gracePeriod=30
Jul 02 21:06:35.775566 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:35.775542    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:35.997821 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:35.997784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:36.299391 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.299356    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6600e98-c44d-4294-8ad7-42296ce8a046" path="/var/lib/kubelet/pods/c6600e98-c44d-4294-8ad7-42296ce8a046/volumes"
Jul 02 21:06:36.350032 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.350001    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:36.638646 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.638618    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"]
Jul 02 21:06:36.639039 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.639002    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6600e98-c44d-4294-8ad7-42296ce8a046" containerName="istio-proxy"
Jul 02 21:06:36.639039 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.639015    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6600e98-c44d-4294-8ad7-42296ce8a046" containerName="istio-proxy"
Jul 02 21:06:36.639159 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.639111    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6600e98-c44d-4294-8ad7-42296ce8a046" containerName="istio-proxy"
Jul 02 21:06:36.639159 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.639121    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6600e98-c44d-4294-8ad7-42296ce8a046" containerName="istio-proxy"
Jul 02 21:06:36.644076 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.644058    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.646709 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.646693    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-ffa3c8-openshift-default-dockercfg-xpm5j\""
Jul 02 21:06:36.654400 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.654375    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"]
Jul 02 21:06:36.665639 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.665595    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:36.712067 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.712040    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-podinfo\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.712195 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.712086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4x9p\" (UniqueName: \"kubernetes.io/projected/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-kube-api-access-k4x9p\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.712195 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.712115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-credential-socket\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.712317 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.712195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-envoy\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.712317 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.712250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-data\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.712317 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.712284    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-workload-socket\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.712456 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.712338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-workload-certs\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.712456 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.712416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-token\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.712456 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.712453    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istiod-ca-cert\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.813608 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.813573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4x9p\" (UniqueName: \"kubernetes.io/projected/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-kube-api-access-k4x9p\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.813608 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.813617    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-credential-socket\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.813950 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.813655    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-envoy\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.813950 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.813696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-data\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.813950 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.813726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-workload-socket\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.813950 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.813806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-workload-certs\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.813950 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.813871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-token\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.813950 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.813913    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istiod-ca-cert\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.814329 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.813972    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-podinfo\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.814329 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.814073    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-credential-socket\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.814329 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.814169    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-workload-socket\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.814329 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.814224    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-data\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.814329 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.814309    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-workload-certs\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.814676 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.814652    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istiod-ca-cert\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.816048 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.816030    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-envoy\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.816373 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.816355    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-podinfo\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.822611 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.822582    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-token\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.822831 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.822811    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4x9p\" (UniqueName: \"kubernetes.io/projected/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-kube-api-access-k4x9p\") pod \"e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") " pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:36.954935 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:36.954843    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:37.090710 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:37.090686    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"]
Jul 02 21:06:37.091914 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:06:37.091886    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d54b7e_0e07_4171_9126_b6d3d0ba5a66.slice/crio-c300784f3937a741a7845b136f5c1c328eed00ab3561613ee703d753c936a897 WatchSource:0}: Error finding container c300784f3937a741a7845b136f5c1c328eed00ab3561613ee703d753c936a897: Status 404 returned error can't find the container with id c300784f3937a741a7845b136f5c1c328eed00ab3561613ee703d753c936a897
Jul 02 21:06:37.094152 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:37.094119    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:37.094267 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:37.094195    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:37.094267 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:37.094238    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:37.105482 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:37.105459    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:37.207100 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:37.207011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:37.306432 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:37.306398    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:37.886544 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:37.886509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx" event={"ID":"93d54b7e-0e07-4171-9126-b6d3d0ba5a66","Type":"ContainerStarted","Data":"8f73486e454de63ddb9637d724b56d88a460b27141b8f96bca97cb6cbacd9bc9"}
Jul 02 21:06:37.887052 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:37.886568    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx" event={"ID":"93d54b7e-0e07-4171-9126-b6d3d0ba5a66","Type":"ContainerStarted","Data":"c300784f3937a741a7845b136f5c1c328eed00ab3561613ee703d753c936a897"}
Jul 02 21:06:37.909081 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:37.909035    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx" podStartSLOduration=1.909019774 podStartE2EDuration="1.909019774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:06:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:06:37.907934647 +0000 UTC m=+2042.030946245" watchObservedRunningTime="2026-07-02 21:06:37.909019774 +0000 UTC m=+2042.032031345"
Jul 02 21:06:37.955550 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:37.955524    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:38.960188 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:38.960161    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:39.896840 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:39.896747    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:39.897946 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:39.897905    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:39.957182 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:39.957151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:40.069114 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:40.069069    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:40.182894 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:40.182797    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:40.273815 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:40.273780    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:40.625373 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:40.625334    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:40.725734 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:40.725702    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:40.904667 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:40.904581    2565 generic.go:356] "Generic (PLEG): container finished" podID="77bb806d-1a37-4b1f-ad73-60922662bb43" containerID="82f77ec41b6222279faf216352962a7440d60b7ffc82b119e349507068a10515" exitCode=0
Jul 02 21:06:40.904667 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:40.904656    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t" event={"ID":"77bb806d-1a37-4b1f-ad73-60922662bb43","Type":"ContainerDied","Data":"82f77ec41b6222279faf216352962a7440d60b7ffc82b119e349507068a10515"}
Jul 02 21:06:40.904889 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:40.904739    2565 scope.go:117] "RemoveContainer" containerID="0de2ab89588efdd53837249abac37a1457d1f1ad5caf671346e192e604e37016"
Jul 02 21:06:41.022315 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.022286    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:41.156378 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.156289    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-workload-certs\") pod \"77bb806d-1a37-4b1f-ad73-60922662bb43\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") "
Jul 02 21:06:41.156378 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.156358    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-credential-socket\") pod \"77bb806d-1a37-4b1f-ad73-60922662bb43\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") "
Jul 02 21:06:41.156882 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.156385    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-podinfo\") pod \"77bb806d-1a37-4b1f-ad73-60922662bb43\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") "
Jul 02 21:06:41.156882 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.156407    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-workload-socket\") pod \"77bb806d-1a37-4b1f-ad73-60922662bb43\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") "
Jul 02 21:06:41.156882 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.156434    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-token\") pod \"77bb806d-1a37-4b1f-ad73-60922662bb43\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") "
Jul 02 21:06:41.156882 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.156450    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-envoy\") pod \"77bb806d-1a37-4b1f-ad73-60922662bb43\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") "
Jul 02 21:06:41.156882 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.156508    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77bb806d-1a37-4b1f-ad73-60922662bb43-istiod-ca-cert\") pod \"77bb806d-1a37-4b1f-ad73-60922662bb43\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") "
Jul 02 21:06:41.156882 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.156571    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mccxv\" (UniqueName: \"kubernetes.io/projected/77bb806d-1a37-4b1f-ad73-60922662bb43-kube-api-access-mccxv\") pod \"77bb806d-1a37-4b1f-ad73-60922662bb43\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") "
Jul 02 21:06:41.156882 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.156597    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-data\") pod \"77bb806d-1a37-4b1f-ad73-60922662bb43\" (UID: \"77bb806d-1a37-4b1f-ad73-60922662bb43\") "
Jul 02 21:06:41.156882 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.156607    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "77bb806d-1a37-4b1f-ad73-60922662bb43" (UID: "77bb806d-1a37-4b1f-ad73-60922662bb43"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:06:41.156882 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.156711    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "77bb806d-1a37-4b1f-ad73-60922662bb43" (UID: "77bb806d-1a37-4b1f-ad73-60922662bb43"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:06:41.156882 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.156728    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "77bb806d-1a37-4b1f-ad73-60922662bb43" (UID: "77bb806d-1a37-4b1f-ad73-60922662bb43"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:06:41.157392 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.156963    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77bb806d-1a37-4b1f-ad73-60922662bb43-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "77bb806d-1a37-4b1f-ad73-60922662bb43" (UID: "77bb806d-1a37-4b1f-ad73-60922662bb43"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:06:41.157392 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.156989    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-workload-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:41.157392 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.157012    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-credential-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:41.157392 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.157027    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-workload-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:41.157606 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.157563    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-data" (OuterVolumeSpecName: "istio-data") pod "77bb806d-1a37-4b1f-ad73-60922662bb43" (UID: "77bb806d-1a37-4b1f-ad73-60922662bb43"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:06:41.158851 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.158823    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "77bb806d-1a37-4b1f-ad73-60922662bb43" (UID: "77bb806d-1a37-4b1f-ad73-60922662bb43"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:06:41.158851 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.158841    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "77bb806d-1a37-4b1f-ad73-60922662bb43" (UID: "77bb806d-1a37-4b1f-ad73-60922662bb43"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 21:06:41.158997 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.158854    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77bb806d-1a37-4b1f-ad73-60922662bb43-kube-api-access-mccxv" (OuterVolumeSpecName: "kube-api-access-mccxv") pod "77bb806d-1a37-4b1f-ad73-60922662bb43" (UID: "77bb806d-1a37-4b1f-ad73-60922662bb43"). InnerVolumeSpecName "kube-api-access-mccxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:06:41.158997 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.158891    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-token" (OuterVolumeSpecName: "istio-token") pod "77bb806d-1a37-4b1f-ad73-60922662bb43" (UID: "77bb806d-1a37-4b1f-ad73-60922662bb43"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:06:41.258406 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.258368    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mccxv\" (UniqueName: \"kubernetes.io/projected/77bb806d-1a37-4b1f-ad73-60922662bb43-kube-api-access-mccxv\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:41.258406 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.258400    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-data\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:41.258406 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.258410    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-podinfo\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:41.258406 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.258418    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-token\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:41.258682 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.258428    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77bb806d-1a37-4b1f-ad73-60922662bb43-istio-envoy\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:41.258682 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.258436    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77bb806d-1a37-4b1f-ad73-60922662bb43-istiod-ca-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:06:41.912247 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.912219    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"
Jul 02 21:06:41.912425 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.912267    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t" event={"ID":"77bb806d-1a37-4b1f-ad73-60922662bb43","Type":"ContainerDied","Data":"9be18f7b4fb699a85dd26ba232875625bfa8e5361e180fd964025f08bdd7e252"}
Jul 02 21:06:41.912425 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.912320    2565 scope.go:117] "RemoveContainer" containerID="82f77ec41b6222279faf216352962a7440d60b7ffc82b119e349507068a10515"
Jul 02 21:06:41.934972 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.934945    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"]
Jul 02 21:06:41.942226 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:41.942205    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ff2295-openshift-default-c47db6d97-8zz9t"]
Jul 02 21:06:42.299648 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:42.299570    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77bb806d-1a37-4b1f-ad73-60922662bb43" path="/var/lib/kubelet/pods/77bb806d-1a37-4b1f-ad73-60922662bb43/volumes"
Jul 02 21:06:44.466057 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:44.466020    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:44.798977 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:44.798891    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:45.077184 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.077100    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"]
Jul 02 21:06:45.077590 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.077571    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77bb806d-1a37-4b1f-ad73-60922662bb43" containerName="istio-proxy"
Jul 02 21:06:45.077678 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.077592    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="77bb806d-1a37-4b1f-ad73-60922662bb43" containerName="istio-proxy"
Jul 02 21:06:45.077678 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.077602    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6600e98-c44d-4294-8ad7-42296ce8a046" containerName="istio-proxy"
Jul 02 21:06:45.077678 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.077611    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6600e98-c44d-4294-8ad7-42296ce8a046" containerName="istio-proxy"
Jul 02 21:06:45.077678 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.077624    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77bb806d-1a37-4b1f-ad73-60922662bb43" containerName="istio-proxy"
Jul 02 21:06:45.077678 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.077632    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="77bb806d-1a37-4b1f-ad73-60922662bb43" containerName="istio-proxy"
Jul 02 21:06:45.078258 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.077746    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="77bb806d-1a37-4b1f-ad73-60922662bb43" containerName="istio-proxy"
Jul 02 21:06:45.078258 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.077773    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="77bb806d-1a37-4b1f-ad73-60922662bb43" containerName="istio-proxy"
Jul 02 21:06:45.082186 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.082166    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.084777 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.084741    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-b780eb-openshift-default-dockercfg-qxtlh\""
Jul 02 21:06:45.094065 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.094044    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"]
Jul 02 21:06:45.112475 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.112447    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:45.197365 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.197335    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90287e85-c081-4c0c-bf60-2b44efd76603-istio-token\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.197535 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.197375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-workload-certs\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.197535 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.197404    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-istio-data\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.197535 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.197497    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-workload-socket\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.197667 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.197560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-istio-envoy\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.197667 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.197587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-credential-socket\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.197667 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.197613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp5qz\" (UniqueName: \"kubernetes.io/projected/90287e85-c081-4c0c-bf60-2b44efd76603-kube-api-access-rp5qz\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.197847 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.197716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90287e85-c081-4c0c-bf60-2b44efd76603-istiod-ca-cert\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.197847 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.197803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90287e85-c081-4c0c-bf60-2b44efd76603-istio-podinfo\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.298919 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.298886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-istio-envoy\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.298919 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.298920    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-credential-socket\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.299135 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.298939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp5qz\" (UniqueName: \"kubernetes.io/projected/90287e85-c081-4c0c-bf60-2b44efd76603-kube-api-access-rp5qz\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.299135 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.298963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90287e85-c081-4c0c-bf60-2b44efd76603-istiod-ca-cert\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.299135 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.299000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90287e85-c081-4c0c-bf60-2b44efd76603-istio-podinfo\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.299135 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.299081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90287e85-c081-4c0c-bf60-2b44efd76603-istio-token\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.299135 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.299117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-workload-certs\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.299415 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.299164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-istio-data\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.299415 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.299198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-workload-socket\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.299415 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.299309    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-credential-socket\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.299572 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.299500    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-istio-data\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.299572 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.299559    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-workload-socket\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.299746 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.299713    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90287e85-c081-4c0c-bf60-2b44efd76603-istiod-ca-cert\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.299844 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.299818    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-workload-certs\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.301167 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.301150    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-istio-envoy\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.301495 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.301474    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90287e85-c081-4c0c-bf60-2b44efd76603-istio-podinfo\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.314315 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.314291    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90287e85-c081-4c0c-bf60-2b44efd76603-istio-token\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.314436 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.314418    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp5qz\" (UniqueName: \"kubernetes.io/projected/90287e85-c081-4c0c-bf60-2b44efd76603-kube-api-access-rp5qz\") pod \"e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") " pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.393373 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.393345    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:45.562253 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.562225    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"]
Jul 02 21:06:45.564065 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:06:45.564035    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90287e85_c081_4c0c_bf60_2b44efd76603.slice/crio-7ed72319935a73482de467b91156d8427fdcf61d091cefee9b63fc6e2479aaef WatchSource:0}: Error finding container 7ed72319935a73482de467b91156d8427fdcf61d091cefee9b63fc6e2479aaef: Status 404 returned error can't find the container with id 7ed72319935a73482de467b91156d8427fdcf61d091cefee9b63fc6e2479aaef
Jul 02 21:06:45.566325 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.566292    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:45.566392 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.566362    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:45.566430 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.566392    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:45.938844 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.938799    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt" event={"ID":"90287e85-c081-4c0c-bf60-2b44efd76603","Type":"ContainerStarted","Data":"db057b9ea97ca42a5aeede775b265e6fe8345827aab816892addce65bd0e3391"}
Jul 02 21:06:45.939060 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.938872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt" event={"ID":"90287e85-c081-4c0c-bf60-2b44efd76603","Type":"ContainerStarted","Data":"7ed72319935a73482de467b91156d8427fdcf61d091cefee9b63fc6e2479aaef"}
Jul 02 21:06:45.959794 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:45.959724    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt" podStartSLOduration=0.959706366 podStartE2EDuration="959.706366ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:06:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:06:45.957669075 +0000 UTC m=+2050.080680657" watchObservedRunningTime="2026-07-02 21:06:45.959706366 +0000 UTC m=+2050.082717937"
Jul 02 21:06:46.016872 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:46.016839    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:46.394470 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:46.394439    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:46.398920 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:46.398898    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:46.948278 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:46.948242    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:46.950416 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:46.950389    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:06:48.010248 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:48.010213    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:48.162674 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:48.162641    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:48.298206 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:48.298109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:48.396844 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:48.396804    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:48.648905 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:48.648865    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:48.746392 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:48.746351    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:49.147516 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:49.147477    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:49.206101 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:49.206068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:52.537046 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:52.536965    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:52.991061 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:52.991027    2565 generic.go:356] "Generic (PLEG): container finished" podID="93d54b7e-0e07-4171-9126-b6d3d0ba5a66" containerID="8f73486e454de63ddb9637d724b56d88a460b27141b8f96bca97cb6cbacd9bc9" exitCode=0
Jul 02 21:06:52.991231 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:52.991088    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx" event={"ID":"93d54b7e-0e07-4171-9126-b6d3d0ba5a66","Type":"ContainerDied","Data":"8f73486e454de63ddb9637d724b56d88a460b27141b8f96bca97cb6cbacd9bc9"}
Jul 02 21:06:52.991474 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:52.991461    2565 scope.go:117] "RemoveContainer" containerID="8f73486e454de63ddb9637d724b56d88a460b27141b8f96bca97cb6cbacd9bc9"
Jul 02 21:06:52.992444 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:52.992413    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:52.992542 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:52.992499    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:52.992603 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:52.992544    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:06:53.997932 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:53.997897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx" event={"ID":"93d54b7e-0e07-4171-9126-b6d3d0ba5a66","Type":"ContainerStarted","Data":"170429ff98a593c30bf0e5fd0c2345f2fb4858487a03c8475f6f2540f0eee38f"}
Jul 02 21:06:54.897684 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:54.897652    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:54.956842 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:54.956801    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:54.957051 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:54.957005    2565 patch_prober.go:28] interesting pod/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 02 21:06:54.957125 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:54.957070    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx" podUID="93d54b7e-0e07-4171-9126-b6d3d0ba5a66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 02 21:06:55.955780 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:55.955716    2565 patch_prober.go:28] interesting pod/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 02 21:06:55.956387 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:55.956345    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx" podUID="93d54b7e-0e07-4171-9126-b6d3d0ba5a66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 02 21:06:56.955696 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:56.955664    2565 patch_prober.go:28] interesting pod/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 02 21:06:56.955867 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:56.955717    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx" podUID="93d54b7e-0e07-4171-9126-b6d3d0ba5a66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 02 21:06:57.959427 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:57.959343    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:06:57.960429 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:06:57.960410    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:07:00.033107 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:00.033035    2565 generic.go:356] "Generic (PLEG): container finished" podID="90287e85-c081-4c0c-bf60-2b44efd76603" containerID="db057b9ea97ca42a5aeede775b265e6fe8345827aab816892addce65bd0e3391" exitCode=0
Jul 02 21:07:00.033582 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:00.033116    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt" event={"ID":"90287e85-c081-4c0c-bf60-2b44efd76603","Type":"ContainerDied","Data":"db057b9ea97ca42a5aeede775b265e6fe8345827aab816892addce65bd0e3391"}
Jul 02 21:07:00.033655 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:00.033607    2565 scope.go:117] "RemoveContainer" containerID="db057b9ea97ca42a5aeede775b265e6fe8345827aab816892addce65bd0e3391"
Jul 02 21:07:00.034691 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:00.034664    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:07:00.034818 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:00.034800    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:07:00.034864 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:00.034847    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 02 21:07:01.049176 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:01.049132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt" event={"ID":"90287e85-c081-4c0c-bf60-2b44efd76603","Type":"ContainerStarted","Data":"5412ade647477ff56c1b010d5d043bed8f597811b70583f027551092df4cef20"}
Jul 02 21:07:01.393495 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:01.393465    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:07:01.394721 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:01.394698    2565 patch_prober.go:28] interesting pod/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 02 21:07:01.394817 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:01.394747    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt" podUID="90287e85-c081-4c0c-bf60-2b44efd76603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 02 21:07:01.948970 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:01.948930    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:07:02.250451 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.250365    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:07:02.394176 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.394140    2565 patch_prober.go:28] interesting pod/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 02 21:07:02.394353 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.394200    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt" podUID="90287e85-c081-4c0c-bf60-2b44efd76603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 02 21:07:02.406188 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.406160    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:07:02.890055 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.890020    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"]
Jul 02 21:07:02.894428 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.894403    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:02.898142 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.898112    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ffa3c8\"/\"default-dockercfg-9swqf\""
Jul 02 21:07:02.898306 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.898163    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ffa3c8\"/\"auth-test-model-ffa3c8-kserve-self-signed-certs\""
Jul 02 21:07:02.898306 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.898196    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ffa3c8\"/\"openshift-service-ca.crt\""
Jul 02 21:07:02.898306 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.898128    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ffa3c8\"/\"kube-root-ca.crt\""
Jul 02 21:07:02.904475 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.904446    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"]
Jul 02 21:07:02.951217 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.951180    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:07:02.982542 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.982506    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-model-cache\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:02.982542 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.982539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c252cc96-c092-4d29-8673-3f01f2609f94-tls-certs\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:02.982853 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.982670    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxcfk\" (UniqueName: \"kubernetes.io/projected/c252cc96-c092-4d29-8673-3f01f2609f94-kube-api-access-sxcfk\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:02.982853 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.982743    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-dshm\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:02.982853 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.982813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-tmp-dir\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:02.982996 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:02.982853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-home\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:03.084114 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:03.084082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxcfk\" (UniqueName: \"kubernetes.io/projected/c252cc96-c092-4d29-8673-3f01f2609f94-kube-api-access-sxcfk\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:03.084328 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:03.084129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-dshm\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:03.084328 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:03.084233    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-tmp-dir\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:03.084328 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:03.084276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-home\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:03.084502 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:03.084429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-model-cache\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:03.084502 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:03.084466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c252cc96-c092-4d29-8673-3f01f2609f94-tls-certs\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:03.084614 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:03.084520    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-tmp-dir\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:03.084699 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:03.084677    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-home\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:03.084845 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:03.084819    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-model-cache\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:03.086549 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:03.086518    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-dshm\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:03.086798 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:03.086781    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c252cc96-c092-4d29-8673-3f01f2609f94-tls-certs\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:03.092354 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:03.092335    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxcfk\" (UniqueName: \"kubernetes.io/projected/c252cc96-c092-4d29-8673-3f01f2609f94-kube-api-access-sxcfk\") pod \"auth-test-model-ffa3c8-kserve-d7475944c-4zpdx\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") " pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:03.207140 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:03.207050    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:03.391904 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:03.391881    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"]
Jul 02 21:07:03.393772 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:03.393729    2565 patch_prober.go:28] interesting pod/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 02 21:07:03.393903 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:03.393816    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt" podUID="90287e85-c081-4c0c-bf60-2b44efd76603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 02 21:07:03.393903 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:07:03.393742    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc252cc96_c092_4d29_8673_3f01f2609f94.slice/crio-4f444bed1b6bf9dcd269bc90edcaa3d997ba2f9d90e7d9aa0283346ea4baf2b9 WatchSource:0}: Error finding container 4f444bed1b6bf9dcd269bc90edcaa3d997ba2f9d90e7d9aa0283346ea4baf2b9: Status 404 returned error can't find the container with id 4f444bed1b6bf9dcd269bc90edcaa3d997ba2f9d90e7d9aa0283346ea4baf2b9
Jul 02 21:07:04.066972 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:04.066939    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx" event={"ID":"c252cc96-c092-4d29-8673-3f01f2609f94","Type":"ContainerStarted","Data":"17ffaac2698d1572ddafd430d8ac8c9df38c5146378ead3dfa20c6ee2b61d6a2"}
Jul 02 21:07:04.066972 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:04.066978    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx" event={"ID":"c252cc96-c092-4d29-8673-3f01f2609f94","Type":"ContainerStarted","Data":"4f444bed1b6bf9dcd269bc90edcaa3d997ba2f9d90e7d9aa0283346ea4baf2b9"}
Jul 02 21:07:04.086121 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:04.086072    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx" podStartSLOduration=2.086056464 podStartE2EDuration="2.086056464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:07:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:07:04.083853452 +0000 UTC m=+2068.206865024" watchObservedRunningTime="2026-07-02 21:07:04.086056464 +0000 UTC m=+2068.209068035"
Jul 02 21:07:04.394502 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:04.394465    2565 patch_prober.go:28] interesting pod/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 02 21:07:04.394928 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:04.394520    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt" podUID="90287e85-c081-4c0c-bf60-2b44efd76603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 02 21:07:05.398297 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:05.398267    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:07:05.399242 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:05.399223    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:07:10.120438 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:10.120397    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:07:10.221545 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:10.221511    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:07:11.093150 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:11.093114    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:07:13.207639 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:13.207604    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:13.207639 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:13.207649    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:13.220063 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:13.220039    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:14.131822 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:14.131789    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:07:15.927652 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:15.927617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:07:28.041673 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:28.041637    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:07:29.393317 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.393285    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"]
Jul 02 21:07:29.396942 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.396914    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.400590 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.400566    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b780eb\"/\"auth-test-model-b780eb-kserve-self-signed-certs\""
Jul 02 21:07:29.400590 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.400575    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b780eb\"/\"openshift-service-ca.crt\""
Jul 02 21:07:29.400769 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.400598    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b780eb\"/\"kube-root-ca.crt\""
Jul 02 21:07:29.400769 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.400630    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b780eb\"/\"default-dockercfg-8rd5s\""
Jul 02 21:07:29.406156 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.406134    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"]
Jul 02 21:07:29.415905 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.415874    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:07:29.543597 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.543562    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82837016-7d2b-4642-a8de-623555fc4fae-tls-certs\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.543786 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.543599    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5skz7\" (UniqueName: \"kubernetes.io/projected/82837016-7d2b-4642-a8de-623555fc4fae-kube-api-access-5skz7\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.543786 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.543640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-dshm\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.543786 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.543700    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-home\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.543786 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.543733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-model-cache\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.543952 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.543833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-tmp-dir\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.645126 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.645054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-home\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.645126 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.645084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-model-cache\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.645318 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.645128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-tmp-dir\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.645318 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.645189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82837016-7d2b-4642-a8de-623555fc4fae-tls-certs\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.645318 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.645212    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5skz7\" (UniqueName: \"kubernetes.io/projected/82837016-7d2b-4642-a8de-623555fc4fae-kube-api-access-5skz7\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.645318 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.645259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-dshm\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.645533 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.645461    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-home\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.645533 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.645498    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-model-cache\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.645631 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.645562    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-tmp-dir\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.647427 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.647407    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-dshm\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.647682 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.647664    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82837016-7d2b-4642-a8de-623555fc4fae-tls-certs\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.652716 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.652695    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5skz7\" (UniqueName: \"kubernetes.io/projected/82837016-7d2b-4642-a8de-623555fc4fae-kube-api-access-5skz7\") pod \"auth-test-model-b780eb-kserve-7677997b79-fkmqq\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") " pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.707814 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.707790    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:29.841581 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:29.841553    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"]
Jul 02 21:07:29.843142 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:07:29.843116    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82837016_7d2b_4642_a8de_623555fc4fae.slice/crio-c3e48fc3b19a03c10d17211dd662f216e29e5992535b30fbf02201551a4544ba WatchSource:0}: Error finding container c3e48fc3b19a03c10d17211dd662f216e29e5992535b30fbf02201551a4544ba: Status 404 returned error can't find the container with id c3e48fc3b19a03c10d17211dd662f216e29e5992535b30fbf02201551a4544ba
Jul 02 21:07:30.210567 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:30.210466    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq" event={"ID":"82837016-7d2b-4642-a8de-623555fc4fae","Type":"ContainerStarted","Data":"5cfa7c8affb2a50b00b43641787b7cabbb408f2c0f19ba80209130977cb227b4"}
Jul 02 21:07:30.210567 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:30.210512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq" event={"ID":"82837016-7d2b-4642-a8de-623555fc4fae","Type":"ContainerStarted","Data":"c3e48fc3b19a03c10d17211dd662f216e29e5992535b30fbf02201551a4544ba"}
Jul 02 21:07:30.230844 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:30.230795    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq" podStartSLOduration=1.230780396 podStartE2EDuration="1.230780396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:07:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:07:30.227432257 +0000 UTC m=+2094.350443829" watchObservedRunningTime="2026-07-02 21:07:30.230780396 +0000 UTC m=+2094.353791964"
Jul 02 21:07:36.473957 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:36.473931    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 21:07:36.486588 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:36.486560    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 21:07:39.708234 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:39.708199    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:39.708713 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:39.708267    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:39.720771 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:39.720732    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:07:40.274975 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:07:40.274947    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:09:18.447551 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:18.447519    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"]
Jul 02 21:09:18.497816 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:18.497781    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:09:19.409819 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:19.409789    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"]
Jul 02 21:09:19.730316 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:19.730223    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:09:33.467864 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.467822    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx" podUID="c252cc96-c092-4d29-8673-3f01f2609f94" containerName="main" containerID="cri-o://17ffaac2698d1572ddafd430d8ac8c9df38c5146378ead3dfa20c6ee2b61d6a2" gracePeriod=45
Jul 02 21:09:33.723008 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.722925    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:09:33.725814 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.725793    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:09:33.807824 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.807789    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c252cc96-c092-4d29-8673-3f01f2609f94-tls-certs\") pod \"c252cc96-c092-4d29-8673-3f01f2609f94\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") "
Jul 02 21:09:33.807996 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.807946    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-dshm\") pod \"c252cc96-c092-4d29-8673-3f01f2609f94\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") "
Jul 02 21:09:33.808046 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.808028    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxcfk\" (UniqueName: \"kubernetes.io/projected/c252cc96-c092-4d29-8673-3f01f2609f94-kube-api-access-sxcfk\") pod \"c252cc96-c092-4d29-8673-3f01f2609f94\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") "
Jul 02 21:09:33.808095 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.808073    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-model-cache\") pod \"c252cc96-c092-4d29-8673-3f01f2609f94\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") "
Jul 02 21:09:33.808153 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.808104    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-tmp-dir\") pod \"c252cc96-c092-4d29-8673-3f01f2609f94\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") "
Jul 02 21:09:33.808209 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.808191    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-home\") pod \"c252cc96-c092-4d29-8673-3f01f2609f94\" (UID: \"c252cc96-c092-4d29-8673-3f01f2609f94\") "
Jul 02 21:09:33.808397 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.808369    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-model-cache" (OuterVolumeSpecName: "model-cache") pod "c252cc96-c092-4d29-8673-3f01f2609f94" (UID: "c252cc96-c092-4d29-8673-3f01f2609f94"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:09:33.808611 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.808590    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c252cc96-c092-4d29-8673-3f01f2609f94" (UID: "c252cc96-c092-4d29-8673-3f01f2609f94"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:09:33.808721 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.808624    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-model-cache\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:09:33.808811 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.808601    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-home" (OuterVolumeSpecName: "home") pod "c252cc96-c092-4d29-8673-3f01f2609f94" (UID: "c252cc96-c092-4d29-8673-3f01f2609f94"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:09:33.810190 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.810169    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-dshm" (OuterVolumeSpecName: "dshm") pod "c252cc96-c092-4d29-8673-3f01f2609f94" (UID: "c252cc96-c092-4d29-8673-3f01f2609f94"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:09:33.810316 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.810296    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c252cc96-c092-4d29-8673-3f01f2609f94-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c252cc96-c092-4d29-8673-3f01f2609f94" (UID: "c252cc96-c092-4d29-8673-3f01f2609f94"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:09:33.810431 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.810407    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c252cc96-c092-4d29-8673-3f01f2609f94-kube-api-access-sxcfk" (OuterVolumeSpecName: "kube-api-access-sxcfk") pod "c252cc96-c092-4d29-8673-3f01f2609f94" (UID: "c252cc96-c092-4d29-8673-3f01f2609f94"). InnerVolumeSpecName "kube-api-access-sxcfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:09:33.884222 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.884185    2565 generic.go:356] "Generic (PLEG): container finished" podID="c252cc96-c092-4d29-8673-3f01f2609f94" containerID="17ffaac2698d1572ddafd430d8ac8c9df38c5146378ead3dfa20c6ee2b61d6a2" exitCode=0
Jul 02 21:09:33.884390 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.884229    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"
Jul 02 21:09:33.884390 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.884278    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx" event={"ID":"c252cc96-c092-4d29-8673-3f01f2609f94","Type":"ContainerDied","Data":"17ffaac2698d1572ddafd430d8ac8c9df38c5146378ead3dfa20c6ee2b61d6a2"}
Jul 02 21:09:33.884390 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.884321    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx" event={"ID":"c252cc96-c092-4d29-8673-3f01f2609f94","Type":"ContainerDied","Data":"4f444bed1b6bf9dcd269bc90edcaa3d997ba2f9d90e7d9aa0283346ea4baf2b9"}
Jul 02 21:09:33.884390 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.884339    2565 scope.go:117] "RemoveContainer" containerID="17ffaac2698d1572ddafd430d8ac8c9df38c5146378ead3dfa20c6ee2b61d6a2"
Jul 02 21:09:33.893934 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.893918    2565 scope.go:117] "RemoveContainer" containerID="17ffaac2698d1572ddafd430d8ac8c9df38c5146378ead3dfa20c6ee2b61d6a2"
Jul 02 21:09:33.894195 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:09:33.894178    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17ffaac2698d1572ddafd430d8ac8c9df38c5146378ead3dfa20c6ee2b61d6a2\": container with ID starting with 17ffaac2698d1572ddafd430d8ac8c9df38c5146378ead3dfa20c6ee2b61d6a2 not found: ID does not exist" containerID="17ffaac2698d1572ddafd430d8ac8c9df38c5146378ead3dfa20c6ee2b61d6a2"
Jul 02 21:09:33.894260 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.894208    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17ffaac2698d1572ddafd430d8ac8c9df38c5146378ead3dfa20c6ee2b61d6a2"} err="failed to get container status \"17ffaac2698d1572ddafd430d8ac8c9df38c5146378ead3dfa20c6ee2b61d6a2\": rpc error: code = NotFound desc = could not find container \"17ffaac2698d1572ddafd430d8ac8c9df38c5146378ead3dfa20c6ee2b61d6a2\": container with ID starting with 17ffaac2698d1572ddafd430d8ac8c9df38c5146378ead3dfa20c6ee2b61d6a2 not found: ID does not exist"
Jul 02 21:09:33.905691 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.905664    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"]
Jul 02 21:09:33.909282 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.909258    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxcfk\" (UniqueName: \"kubernetes.io/projected/c252cc96-c092-4d29-8673-3f01f2609f94-kube-api-access-sxcfk\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:09:33.909379 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.909302    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-tmp-dir\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:09:33.909379 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.909314    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-home\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:09:33.909379 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.909322    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c252cc96-c092-4d29-8673-3f01f2609f94-tls-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:09:33.909379 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.909331    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c252cc96-c092-4d29-8673-3f01f2609f94-dshm\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:09:33.911309 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:33.911279    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ffa3c8/auth-test-model-ffa3c8-kserve-d7475944c-4zpdx"]
Jul 02 21:09:34.299165 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.299133    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c252cc96-c092-4d29-8673-3f01f2609f94" path="/var/lib/kubelet/pods/c252cc96-c092-4d29-8673-3f01f2609f94/volumes"
Jul 02 21:09:34.430153 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.430119    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq" podUID="82837016-7d2b-4642-a8de-623555fc4fae" containerName="main" containerID="cri-o://5cfa7c8affb2a50b00b43641787b7cabbb408f2c0f19ba80209130977cb227b4" gracePeriod=45
Jul 02 21:09:34.691411 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.691387    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:09:34.817114 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.817077    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-home\") pod \"82837016-7d2b-4642-a8de-623555fc4fae\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") "
Jul 02 21:09:34.817289 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.817140    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-tmp-dir\") pod \"82837016-7d2b-4642-a8de-623555fc4fae\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") "
Jul 02 21:09:34.817289 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.817196    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-model-cache\") pod \"82837016-7d2b-4642-a8de-623555fc4fae\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") "
Jul 02 21:09:34.817289 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.817232    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-dshm\") pod \"82837016-7d2b-4642-a8de-623555fc4fae\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") "
Jul 02 21:09:34.817446 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.817288    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5skz7\" (UniqueName: \"kubernetes.io/projected/82837016-7d2b-4642-a8de-623555fc4fae-kube-api-access-5skz7\") pod \"82837016-7d2b-4642-a8de-623555fc4fae\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") "
Jul 02 21:09:34.817446 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.817338    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82837016-7d2b-4642-a8de-623555fc4fae-tls-certs\") pod \"82837016-7d2b-4642-a8de-623555fc4fae\" (UID: \"82837016-7d2b-4642-a8de-623555fc4fae\") "
Jul 02 21:09:34.817446 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.817356    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-home" (OuterVolumeSpecName: "home") pod "82837016-7d2b-4642-a8de-623555fc4fae" (UID: "82837016-7d2b-4642-a8de-623555fc4fae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:09:34.817446 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.817380    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "82837016-7d2b-4642-a8de-623555fc4fae" (UID: "82837016-7d2b-4642-a8de-623555fc4fae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:09:34.817656 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.817454    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-model-cache" (OuterVolumeSpecName: "model-cache") pod "82837016-7d2b-4642-a8de-623555fc4fae" (UID: "82837016-7d2b-4642-a8de-623555fc4fae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:09:34.817738 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.817719    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-tmp-dir\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:09:34.817832 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.817738    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-model-cache\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:09:34.817832 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.817747    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-home\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:09:34.819510 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.819478    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82837016-7d2b-4642-a8de-623555fc4fae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "82837016-7d2b-4642-a8de-623555fc4fae" (UID: "82837016-7d2b-4642-a8de-623555fc4fae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:09:34.819619 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.819518    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82837016-7d2b-4642-a8de-623555fc4fae-kube-api-access-5skz7" (OuterVolumeSpecName: "kube-api-access-5skz7") pod "82837016-7d2b-4642-a8de-623555fc4fae" (UID: "82837016-7d2b-4642-a8de-623555fc4fae"). InnerVolumeSpecName "kube-api-access-5skz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:09:34.819619 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.819558    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-dshm" (OuterVolumeSpecName: "dshm") pod "82837016-7d2b-4642-a8de-623555fc4fae" (UID: "82837016-7d2b-4642-a8de-623555fc4fae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:09:34.892244 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.892148    2565 generic.go:356] "Generic (PLEG): container finished" podID="82837016-7d2b-4642-a8de-623555fc4fae" containerID="5cfa7c8affb2a50b00b43641787b7cabbb408f2c0f19ba80209130977cb227b4" exitCode=0
Jul 02 21:09:34.892244 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.892193    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"
Jul 02 21:09:34.892452 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.892236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq" event={"ID":"82837016-7d2b-4642-a8de-623555fc4fae","Type":"ContainerDied","Data":"5cfa7c8affb2a50b00b43641787b7cabbb408f2c0f19ba80209130977cb227b4"}
Jul 02 21:09:34.892452 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.892276    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq" event={"ID":"82837016-7d2b-4642-a8de-623555fc4fae","Type":"ContainerDied","Data":"c3e48fc3b19a03c10d17211dd662f216e29e5992535b30fbf02201551a4544ba"}
Jul 02 21:09:34.892452 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.892293    2565 scope.go:117] "RemoveContainer" containerID="5cfa7c8affb2a50b00b43641787b7cabbb408f2c0f19ba80209130977cb227b4"
Jul 02 21:09:34.901616 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.901598    2565 scope.go:117] "RemoveContainer" containerID="5cfa7c8affb2a50b00b43641787b7cabbb408f2c0f19ba80209130977cb227b4"
Jul 02 21:09:34.901891 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:09:34.901870    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cfa7c8affb2a50b00b43641787b7cabbb408f2c0f19ba80209130977cb227b4\": container with ID starting with 5cfa7c8affb2a50b00b43641787b7cabbb408f2c0f19ba80209130977cb227b4 not found: ID does not exist" containerID="5cfa7c8affb2a50b00b43641787b7cabbb408f2c0f19ba80209130977cb227b4"
Jul 02 21:09:34.901967 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.901904    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cfa7c8affb2a50b00b43641787b7cabbb408f2c0f19ba80209130977cb227b4"} err="failed to get container status \"5cfa7c8affb2a50b00b43641787b7cabbb408f2c0f19ba80209130977cb227b4\": rpc error: code = NotFound desc = could not find container \"5cfa7c8affb2a50b00b43641787b7cabbb408f2c0f19ba80209130977cb227b4\": container with ID starting with 5cfa7c8affb2a50b00b43641787b7cabbb408f2c0f19ba80209130977cb227b4 not found: ID does not exist"
Jul 02 21:09:34.913185 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.913160    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"]
Jul 02 21:09:34.916803 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.916782    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/auth-test-model-b780eb-kserve-7677997b79-fkmqq"]
Jul 02 21:09:34.918881 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.918863    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82837016-7d2b-4642-a8de-623555fc4fae-dshm\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:09:34.918926 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.918885    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5skz7\" (UniqueName: \"kubernetes.io/projected/82837016-7d2b-4642-a8de-623555fc4fae-kube-api-access-5skz7\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:09:34.918926 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:34.918899    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82837016-7d2b-4642-a8de-623555fc4fae-tls-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:09:36.300052 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:36.300018    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82837016-7d2b-4642-a8de-623555fc4fae" path="/var/lib/kubelet/pods/82837016-7d2b-4642-a8de-623555fc4fae/volumes"
Jul 02 21:09:52.199130 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.199097    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"]
Jul 02 21:09:52.199636 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.199490    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c252cc96-c092-4d29-8673-3f01f2609f94" containerName="main"
Jul 02 21:09:52.199636 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.199503    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c252cc96-c092-4d29-8673-3f01f2609f94" containerName="main"
Jul 02 21:09:52.199636 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.199524    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82837016-7d2b-4642-a8de-623555fc4fae" containerName="main"
Jul 02 21:09:52.199636 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.199532    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82837016-7d2b-4642-a8de-623555fc4fae" containerName="main"
Jul 02 21:09:52.199636 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.199616    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c252cc96-c092-4d29-8673-3f01f2609f94" containerName="main"
Jul 02 21:09:52.199636 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.199627    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="82837016-7d2b-4642-a8de-623555fc4fae" containerName="main"
Jul 02 21:09:52.202373 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.202358    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.205280 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.205259    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b780eb\"/\"kube-root-ca.crt\""
Jul 02 21:09:52.206586 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.206562    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b780eb\"/\"default-dockercfg-8rd5s\""
Jul 02 21:09:52.206695 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.206635    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b780eb\"/\"sub-test-model-b780eb-kserve-self-signed-certs\""
Jul 02 21:09:52.206956 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.206937    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b780eb\"/\"openshift-service-ca.crt\""
Jul 02 21:09:52.213300 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.213276    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"]
Jul 02 21:09:52.225059 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.225033    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:09:52.281181 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.281157    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-home\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.281315 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.281194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv2j2\" (UniqueName: \"kubernetes.io/projected/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-kube-api-access-bv2j2\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.281315 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.281238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-tls-certs\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.281315 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.281285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-model-cache\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.281315 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.281311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-tmp-dir\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.281464 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.281342    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-dshm\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.382367 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.382332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-model-cache\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.382530 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.382385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-tmp-dir\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.382530 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.382509    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-dshm\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.382652 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.382631    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-home\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.382713 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.382680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv2j2\" (UniqueName: \"kubernetes.io/projected/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-kube-api-access-bv2j2\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.382797 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.382784    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-tmp-dir\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.382863 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.382806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-tls-certs\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.382863 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.382838    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-model-cache\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.383029 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.383009    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-home\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.384700 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.384668    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-dshm\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.385099 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.385083    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-tls-certs\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.391194 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.391171    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv2j2\" (UniqueName: \"kubernetes.io/projected/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-kube-api-access-bv2j2\") pod \"sub-test-model-b780eb-kserve-7764df8f95-kqgjg\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") " pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.512200 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.512118    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:09:52.643900 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.643877    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"]
Jul 02 21:09:52.645516 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:09:52.645487    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb60fc4cc_2394_4a19_b4d0_9fd1391dc03a.slice/crio-589394d0a70d135a40102a52e614b119031d3b359c975fafac0509606dec2b66 WatchSource:0}: Error finding container 589394d0a70d135a40102a52e614b119031d3b359c975fafac0509606dec2b66: Status 404 returned error can't find the container with id 589394d0a70d135a40102a52e614b119031d3b359c975fafac0509606dec2b66
Jul 02 21:09:52.988702 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.988662    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg" event={"ID":"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a","Type":"ContainerStarted","Data":"1aa4052e5c062e236b64199054278d682c87d263971f393652f198ac9278c396"}
Jul 02 21:09:52.988702 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:52.988707    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg" event={"ID":"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a","Type":"ContainerStarted","Data":"589394d0a70d135a40102a52e614b119031d3b359c975fafac0509606dec2b66"}
Jul 02 21:09:53.006043 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:09:53.005996    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg" podStartSLOduration=1.00598082 podStartE2EDuration="1.00598082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:09:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:09:53.004610653 +0000 UTC m=+2237.127622225" watchObservedRunningTime="2026-07-02 21:09:53.00598082 +0000 UTC m=+2237.128992391"
Jul 02 21:10:02.512925 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:02.512827    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:10:02.512925 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:02.512881    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:10:02.525193 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:02.525169    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:10:03.064642 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:03.064610    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:10:38.876770 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:38.876731    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:10:39.709748 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:39.709711    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"]
Jul 02 21:10:39.728060 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:39.728022    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:10:46.600039 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.600002    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"]
Jul 02 21:10:46.603353 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.603334    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.607639 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.607619    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ffa3c8\"/\"kube-root-ca.crt\""
Jul 02 21:10:46.607639 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.607626    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ffa3c8\"/\"rate-test-model-ffa3c8-kserve-self-signed-certs\""
Jul 02 21:10:46.607878 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.607658    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ffa3c8\"/\"default-dockercfg-9swqf\""
Jul 02 21:10:46.607878 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.607660    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ffa3c8\"/\"openshift-service-ca.crt\""
Jul 02 21:10:46.614727 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.614707    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"]
Jul 02 21:10:46.626523 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.626494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:10:46.708095 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.708055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-model-cache\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.708289 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.708122    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-tmp-dir\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.708289 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.708212    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-dshm\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.708289 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.708255    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmm2t\" (UniqueName: \"kubernetes.io/projected/567e97e3-2edb-49a3-8262-5fea98c51bf0-kube-api-access-nmm2t\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.708470 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.708445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/567e97e3-2edb-49a3-8262-5fea98c51bf0-tls-certs\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.708591 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.708560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-home\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.809899 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.809862    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-dshm\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.809899 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.809905    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmm2t\" (UniqueName: \"kubernetes.io/projected/567e97e3-2edb-49a3-8262-5fea98c51bf0-kube-api-access-nmm2t\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.810127 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.809944    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/567e97e3-2edb-49a3-8262-5fea98c51bf0-tls-certs\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.810127 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.809971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-home\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.810127 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.810057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-model-cache\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.810289 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.810132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-tmp-dir\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.810406 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.810386    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-model-cache\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.810475 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.810457    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-home\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.810537 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.810494    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-tmp-dir\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.812134 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.812103    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-dshm\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.812362 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.812345    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/567e97e3-2edb-49a3-8262-5fea98c51bf0-tls-certs\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.818136 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.818115    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmm2t\" (UniqueName: \"kubernetes.io/projected/567e97e3-2edb-49a3-8262-5fea98c51bf0-kube-api-access-nmm2t\") pod \"rate-test-model-ffa3c8-kserve-b866849f9-xss99\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") " pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:46.913961 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:46.913867    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:47.053352 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:47.053299    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"]
Jul 02 21:10:47.055744 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:10:47.055714    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod567e97e3_2edb_49a3_8262_5fea98c51bf0.slice/crio-fb01946ffdb87589faf0dbda37d02e88697e6bfd507d9327187348fafdf21da0 WatchSource:0}: Error finding container fb01946ffdb87589faf0dbda37d02e88697e6bfd507d9327187348fafdf21da0: Status 404 returned error can't find the container with id fb01946ffdb87589faf0dbda37d02e88697e6bfd507d9327187348fafdf21da0
Jul 02 21:10:47.286907 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:47.286809    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99" event={"ID":"567e97e3-2edb-49a3-8262-5fea98c51bf0","Type":"ContainerStarted","Data":"548d9f39fe92a04f60fe02e98975a5e497bb39126a6aee2d35c72cfce1680311"}
Jul 02 21:10:47.286907 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:47.286858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99" event={"ID":"567e97e3-2edb-49a3-8262-5fea98c51bf0","Type":"ContainerStarted","Data":"fb01946ffdb87589faf0dbda37d02e88697e6bfd507d9327187348fafdf21da0"}
Jul 02 21:10:47.303973 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:47.303923    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99" podStartSLOduration=1.303907096 podStartE2EDuration="1.303907096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:10:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:10:47.303297924 +0000 UTC m=+2291.426309477" watchObservedRunningTime="2026-07-02 21:10:47.303907096 +0000 UTC m=+2291.426918666"
Jul 02 21:10:54.730389 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:54.730343    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg" podUID="b60fc4cc-2394-4a19-b4d0-9fd1391dc03a" containerName="main" containerID="cri-o://1aa4052e5c062e236b64199054278d682c87d263971f393652f198ac9278c396" gracePeriod=45
Jul 02 21:10:54.977064 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:54.977039    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:10:55.094074 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.094044    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-tmp-dir\") pod \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") "
Jul 02 21:10:55.094244 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.094090    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-model-cache\") pod \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") "
Jul 02 21:10:55.094244 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.094135    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv2j2\" (UniqueName: \"kubernetes.io/projected/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-kube-api-access-bv2j2\") pod \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") "
Jul 02 21:10:55.094244 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.094178    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-dshm\") pod \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") "
Jul 02 21:10:55.094244 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.094200    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-home\") pod \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") "
Jul 02 21:10:55.094463 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.094259    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-tls-certs\") pod \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\" (UID: \"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a\") "
Jul 02 21:10:55.094463 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.094312    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b60fc4cc-2394-4a19-b4d0-9fd1391dc03a" (UID: "b60fc4cc-2394-4a19-b4d0-9fd1391dc03a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:10:55.094463 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.094425    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-model-cache" (OuterVolumeSpecName: "model-cache") pod "b60fc4cc-2394-4a19-b4d0-9fd1391dc03a" (UID: "b60fc4cc-2394-4a19-b4d0-9fd1391dc03a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:10:55.094602 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.094491    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-home" (OuterVolumeSpecName: "home") pod "b60fc4cc-2394-4a19-b4d0-9fd1391dc03a" (UID: "b60fc4cc-2394-4a19-b4d0-9fd1391dc03a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:10:55.094639 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.094621    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-tmp-dir\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:10:55.094639 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.094635    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-model-cache\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:10:55.094710 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.094644    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-home\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:10:55.096306 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.096284    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b60fc4cc-2394-4a19-b4d0-9fd1391dc03a" (UID: "b60fc4cc-2394-4a19-b4d0-9fd1391dc03a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:10:55.096788 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.096743    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-dshm" (OuterVolumeSpecName: "dshm") pod "b60fc4cc-2394-4a19-b4d0-9fd1391dc03a" (UID: "b60fc4cc-2394-4a19-b4d0-9fd1391dc03a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:10:55.096788 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.096774    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-kube-api-access-bv2j2" (OuterVolumeSpecName: "kube-api-access-bv2j2") pod "b60fc4cc-2394-4a19-b4d0-9fd1391dc03a" (UID: "b60fc4cc-2394-4a19-b4d0-9fd1391dc03a"). InnerVolumeSpecName "kube-api-access-bv2j2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:10:55.195991 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.195958    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-dshm\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:10:55.195991 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.195986    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-tls-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:10:55.195991 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.195997    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv2j2\" (UniqueName: \"kubernetes.io/projected/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a-kube-api-access-bv2j2\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:10:55.333276 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.333236    2565 generic.go:356] "Generic (PLEG): container finished" podID="b60fc4cc-2394-4a19-b4d0-9fd1391dc03a" containerID="1aa4052e5c062e236b64199054278d682c87d263971f393652f198ac9278c396" exitCode=0
Jul 02 21:10:55.333451 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.333283    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"
Jul 02 21:10:55.333451 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.333300    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg" event={"ID":"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a","Type":"ContainerDied","Data":"1aa4052e5c062e236b64199054278d682c87d263971f393652f198ac9278c396"}
Jul 02 21:10:55.333451 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.333334    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg" event={"ID":"b60fc4cc-2394-4a19-b4d0-9fd1391dc03a","Type":"ContainerDied","Data":"589394d0a70d135a40102a52e614b119031d3b359c975fafac0509606dec2b66"}
Jul 02 21:10:55.333451 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.333356    2565 scope.go:117] "RemoveContainer" containerID="1aa4052e5c062e236b64199054278d682c87d263971f393652f198ac9278c396"
Jul 02 21:10:55.342902 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.342886    2565 scope.go:117] "RemoveContainer" containerID="1aa4052e5c062e236b64199054278d682c87d263971f393652f198ac9278c396"
Jul 02 21:10:55.343140 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:10:55.343124    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aa4052e5c062e236b64199054278d682c87d263971f393652f198ac9278c396\": container with ID starting with 1aa4052e5c062e236b64199054278d682c87d263971f393652f198ac9278c396 not found: ID does not exist" containerID="1aa4052e5c062e236b64199054278d682c87d263971f393652f198ac9278c396"
Jul 02 21:10:55.343191 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.343146    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa4052e5c062e236b64199054278d682c87d263971f393652f198ac9278c396"} err="failed to get container status \"1aa4052e5c062e236b64199054278d682c87d263971f393652f198ac9278c396\": rpc error: code = NotFound desc = could not find container \"1aa4052e5c062e236b64199054278d682c87d263971f393652f198ac9278c396\": container with ID starting with 1aa4052e5c062e236b64199054278d682c87d263971f393652f198ac9278c396 not found: ID does not exist"
Jul 02 21:10:55.355774 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.355693    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"]
Jul 02 21:10:55.358125 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:55.358105    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/sub-test-model-b780eb-kserve-7764df8f95-kqgjg"]
Jul 02 21:10:56.299450 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:56.299417    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b60fc4cc-2394-4a19-b4d0-9fd1391dc03a" path="/var/lib/kubelet/pods/b60fc4cc-2394-4a19-b4d0-9fd1391dc03a/volumes"
Jul 02 21:10:56.915101 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:56.915056    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:56.915101 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:56.915112    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:56.928407 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:56.928382    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:10:57.356148 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:10:57.356121    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:11:31.078787 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.078722    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"]
Jul 02 21:11:31.079221 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.079113    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b60fc4cc-2394-4a19-b4d0-9fd1391dc03a" containerName="main"
Jul 02 21:11:31.079221 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.079125    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b60fc4cc-2394-4a19-b4d0-9fd1391dc03a" containerName="main"
Jul 02 21:11:31.079221 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.079201    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b60fc4cc-2394-4a19-b4d0-9fd1391dc03a" containerName="main"
Jul 02 21:11:31.082391 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.082376    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.086490 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.086295    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b780eb\"/\"openshift-service-ca.crt\""
Jul 02 21:11:31.086490 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.086395    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b780eb\"/\"rate-test-model-b780eb-kserve-self-signed-certs\""
Jul 02 21:11:31.086490 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.086459    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b780eb\"/\"default-dockercfg-8rd5s\""
Jul 02 21:11:31.086973 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.086953    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b780eb\"/\"kube-root-ca.crt\""
Jul 02 21:11:31.089863 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.089495    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"]
Jul 02 21:11:31.104897 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.104870    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:31.235635 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.235601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-model-cache\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.235635 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.235634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-tmp-dir\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.235935 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.235740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-dshm\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.235935 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.235824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65d760f2-7d85-4a76-a50e-3aece410fec5-tls-certs\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.235935 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.235852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-home\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.236056 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.235937    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw9hj\" (UniqueName: \"kubernetes.io/projected/65d760f2-7d85-4a76-a50e-3aece410fec5-kube-api-access-mw9hj\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.337318 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.337211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw9hj\" (UniqueName: \"kubernetes.io/projected/65d760f2-7d85-4a76-a50e-3aece410fec5-kube-api-access-mw9hj\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.337318 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.337287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-model-cache\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.337318 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.337315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-tmp-dir\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.337596 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.337385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-dshm\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.337596 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.337423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65d760f2-7d85-4a76-a50e-3aece410fec5-tls-certs\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.337596 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.337446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-home\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.337838 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.337802    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-model-cache\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.337912 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.337834    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-tmp-dir\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.337912 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.337893    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-home\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.339549 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.339531    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-dshm\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.339884 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.339866    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65d760f2-7d85-4a76-a50e-3aece410fec5-tls-certs\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.344958 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.344935    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw9hj\" (UniqueName: \"kubernetes.io/projected/65d760f2-7d85-4a76-a50e-3aece410fec5-kube-api-access-mw9hj\") pod \"rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") " pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.392585 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.392554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:31.525642 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:31.525616    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"]
Jul 02 21:11:31.526922 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:11:31.526884    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65d760f2_7d85_4a76_a50e_3aece410fec5.slice/crio-33d73987ec3f28e027e75f4b16accd56f5f6c4ceb21b02685b481d5d3a74fa5e WatchSource:0}: Error finding container 33d73987ec3f28e027e75f4b16accd56f5f6c4ceb21b02685b481d5d3a74fa5e: Status 404 returned error can't find the container with id 33d73987ec3f28e027e75f4b16accd56f5f6c4ceb21b02685b481d5d3a74fa5e
Jul 02 21:11:32.526276 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:32.526240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7" event={"ID":"65d760f2-7d85-4a76-a50e-3aece410fec5","Type":"ContainerStarted","Data":"d83dbb8dcb2c32edd15f7ab50d028acf6a34ef40651e2d2743f2224d984fdf5f"}
Jul 02 21:11:32.526684 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:32.526289    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7" event={"ID":"65d760f2-7d85-4a76-a50e-3aece410fec5","Type":"ContainerStarted","Data":"33d73987ec3f28e027e75f4b16accd56f5f6c4ceb21b02685b481d5d3a74fa5e"}
Jul 02 21:11:32.544403 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:32.544348    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7" podStartSLOduration=1.544330609 podStartE2EDuration="1.544330609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:11:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:11:32.541844517 +0000 UTC m=+2336.664856090" watchObservedRunningTime="2026-07-02 21:11:32.544330609 +0000 UTC m=+2336.667342206"
Jul 02 21:11:35.079560 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:35.079523    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:35.184011 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:35.183978    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:37.874234 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:37.874199    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:37.976095 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:37.976054    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:41.393084 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:41.393048    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:41.393600 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:41.393105    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:41.406118 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:41.406090    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:11:41.584934 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:11:41.584908    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:12:03.106638 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:03.106568    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:12:03.342871 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:03.342841    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:12:03.445013 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:03.444915    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:12:10.773207 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:10.773170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:12:10.874318 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:10.874274    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:12:19.786715 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:19.786678    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"]
Jul 02 21:12:19.804413 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:19.804357    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:12:20.705074 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:20.705039    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"]
Jul 02 21:12:20.729204 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:20.729175    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:12:21.904422 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:21.904385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:12:22.347461 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:22.347418    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:12:22.449879 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:22.449845    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:12:22.583126 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:22.583089    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:12:22.745983 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:22.745896    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:12:22.845435 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:22.845405    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:12:27.429201 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:27.429169    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:12:34.808490 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:34.808434    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99" podUID="567e97e3-2edb-49a3-8262-5fea98c51bf0" containerName="main" containerID="cri-o://548d9f39fe92a04f60fe02e98975a5e497bb39126a6aee2d35c72cfce1680311" gracePeriod=45
Jul 02 21:12:35.059829 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.059749    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:12:35.161238 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.161202    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/567e97e3-2edb-49a3-8262-5fea98c51bf0-tls-certs\") pod \"567e97e3-2edb-49a3-8262-5fea98c51bf0\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") "
Jul 02 21:12:35.161428 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.161264    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmm2t\" (UniqueName: \"kubernetes.io/projected/567e97e3-2edb-49a3-8262-5fea98c51bf0-kube-api-access-nmm2t\") pod \"567e97e3-2edb-49a3-8262-5fea98c51bf0\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") "
Jul 02 21:12:35.161428 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.161308    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-tmp-dir\") pod \"567e97e3-2edb-49a3-8262-5fea98c51bf0\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") "
Jul 02 21:12:35.161428 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.161331    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-dshm\") pod \"567e97e3-2edb-49a3-8262-5fea98c51bf0\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") "
Jul 02 21:12:35.161428 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.161373    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-home\") pod \"567e97e3-2edb-49a3-8262-5fea98c51bf0\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") "
Jul 02 21:12:35.161650 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.161440    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-model-cache\") pod \"567e97e3-2edb-49a3-8262-5fea98c51bf0\" (UID: \"567e97e3-2edb-49a3-8262-5fea98c51bf0\") "
Jul 02 21:12:35.161650 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.161599    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "567e97e3-2edb-49a3-8262-5fea98c51bf0" (UID: "567e97e3-2edb-49a3-8262-5fea98c51bf0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:12:35.161741 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.161686    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-home" (OuterVolumeSpecName: "home") pod "567e97e3-2edb-49a3-8262-5fea98c51bf0" (UID: "567e97e3-2edb-49a3-8262-5fea98c51bf0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:12:35.161816 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.161749    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-model-cache" (OuterVolumeSpecName: "model-cache") pod "567e97e3-2edb-49a3-8262-5fea98c51bf0" (UID: "567e97e3-2edb-49a3-8262-5fea98c51bf0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:12:35.161904 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.161885    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-model-cache\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:12:35.161975 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.161908    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-tmp-dir\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:12:35.161975 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.161923    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-home\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:12:35.163516 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.163488    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-dshm" (OuterVolumeSpecName: "dshm") pod "567e97e3-2edb-49a3-8262-5fea98c51bf0" (UID: "567e97e3-2edb-49a3-8262-5fea98c51bf0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:12:35.163516 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.163511    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/567e97e3-2edb-49a3-8262-5fea98c51bf0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "567e97e3-2edb-49a3-8262-5fea98c51bf0" (UID: "567e97e3-2edb-49a3-8262-5fea98c51bf0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:12:35.163682 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.163523    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/567e97e3-2edb-49a3-8262-5fea98c51bf0-kube-api-access-nmm2t" (OuterVolumeSpecName: "kube-api-access-nmm2t") pod "567e97e3-2edb-49a3-8262-5fea98c51bf0" (UID: "567e97e3-2edb-49a3-8262-5fea98c51bf0"). InnerVolumeSpecName "kube-api-access-nmm2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:12:35.263305 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.263275    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/567e97e3-2edb-49a3-8262-5fea98c51bf0-tls-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:12:35.263305 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.263302    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmm2t\" (UniqueName: \"kubernetes.io/projected/567e97e3-2edb-49a3-8262-5fea98c51bf0-kube-api-access-nmm2t\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:12:35.263305 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.263311    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/567e97e3-2edb-49a3-8262-5fea98c51bf0-dshm\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:12:35.725468 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.725405    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7" podUID="65d760f2-7d85-4a76-a50e-3aece410fec5" containerName="main" containerID="cri-o://d83dbb8dcb2c32edd15f7ab50d028acf6a34ef40651e2d2743f2224d984fdf5f" gracePeriod=45
Jul 02 21:12:35.871817 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.871784    2565 generic.go:356] "Generic (PLEG): container finished" podID="65d760f2-7d85-4a76-a50e-3aece410fec5" containerID="d83dbb8dcb2c32edd15f7ab50d028acf6a34ef40651e2d2743f2224d984fdf5f" exitCode=0
Jul 02 21:12:35.872245 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.871854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7" event={"ID":"65d760f2-7d85-4a76-a50e-3aece410fec5","Type":"ContainerDied","Data":"d83dbb8dcb2c32edd15f7ab50d028acf6a34ef40651e2d2743f2224d984fdf5f"}
Jul 02 21:12:35.873269 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.873247    2565 generic.go:356] "Generic (PLEG): container finished" podID="567e97e3-2edb-49a3-8262-5fea98c51bf0" containerID="548d9f39fe92a04f60fe02e98975a5e497bb39126a6aee2d35c72cfce1680311" exitCode=0
Jul 02 21:12:35.873398 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.873299    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"
Jul 02 21:12:35.873398 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.873326    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99" event={"ID":"567e97e3-2edb-49a3-8262-5fea98c51bf0","Type":"ContainerDied","Data":"548d9f39fe92a04f60fe02e98975a5e497bb39126a6aee2d35c72cfce1680311"}
Jul 02 21:12:35.873398 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.873361    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99" event={"ID":"567e97e3-2edb-49a3-8262-5fea98c51bf0","Type":"ContainerDied","Data":"fb01946ffdb87589faf0dbda37d02e88697e6bfd507d9327187348fafdf21da0"}
Jul 02 21:12:35.873398 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.873377    2565 scope.go:117] "RemoveContainer" containerID="548d9f39fe92a04f60fe02e98975a5e497bb39126a6aee2d35c72cfce1680311"
Jul 02 21:12:35.883575 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.883554    2565 scope.go:117] "RemoveContainer" containerID="548d9f39fe92a04f60fe02e98975a5e497bb39126a6aee2d35c72cfce1680311"
Jul 02 21:12:35.883851 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:12:35.883831    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"548d9f39fe92a04f60fe02e98975a5e497bb39126a6aee2d35c72cfce1680311\": container with ID starting with 548d9f39fe92a04f60fe02e98975a5e497bb39126a6aee2d35c72cfce1680311 not found: ID does not exist" containerID="548d9f39fe92a04f60fe02e98975a5e497bb39126a6aee2d35c72cfce1680311"
Jul 02 21:12:35.883911 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.883858    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548d9f39fe92a04f60fe02e98975a5e497bb39126a6aee2d35c72cfce1680311"} err="failed to get container status \"548d9f39fe92a04f60fe02e98975a5e497bb39126a6aee2d35c72cfce1680311\": rpc error: code = NotFound desc = could not find container \"548d9f39fe92a04f60fe02e98975a5e497bb39126a6aee2d35c72cfce1680311\": container with ID starting with 548d9f39fe92a04f60fe02e98975a5e497bb39126a6aee2d35c72cfce1680311 not found: ID does not exist"
Jul 02 21:12:35.894957 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.894932    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"]
Jul 02 21:12:35.899211 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.899187    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ffa3c8/rate-test-model-ffa3c8-kserve-b866849f9-xss99"]
Jul 02 21:12:35.982360 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:35.982299    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:12:36.069873 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.069839    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw9hj\" (UniqueName: \"kubernetes.io/projected/65d760f2-7d85-4a76-a50e-3aece410fec5-kube-api-access-mw9hj\") pod \"65d760f2-7d85-4a76-a50e-3aece410fec5\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") "
Jul 02 21:12:36.070039 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.069884    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-model-cache\") pod \"65d760f2-7d85-4a76-a50e-3aece410fec5\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") "
Jul 02 21:12:36.070039 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.069926    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-dshm\") pod \"65d760f2-7d85-4a76-a50e-3aece410fec5\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") "
Jul 02 21:12:36.070039 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.070021    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-home\") pod \"65d760f2-7d85-4a76-a50e-3aece410fec5\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") "
Jul 02 21:12:36.070155 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.070092    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65d760f2-7d85-4a76-a50e-3aece410fec5-tls-certs\") pod \"65d760f2-7d85-4a76-a50e-3aece410fec5\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") "
Jul 02 21:12:36.070155 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.070122    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-tmp-dir\") pod \"65d760f2-7d85-4a76-a50e-3aece410fec5\" (UID: \"65d760f2-7d85-4a76-a50e-3aece410fec5\") "
Jul 02 21:12:36.070257 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.070187    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-model-cache" (OuterVolumeSpecName: "model-cache") pod "65d760f2-7d85-4a76-a50e-3aece410fec5" (UID: "65d760f2-7d85-4a76-a50e-3aece410fec5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:12:36.070312 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.070264    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-home" (OuterVolumeSpecName: "home") pod "65d760f2-7d85-4a76-a50e-3aece410fec5" (UID: "65d760f2-7d85-4a76-a50e-3aece410fec5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:12:36.070423 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.070401    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "65d760f2-7d85-4a76-a50e-3aece410fec5" (UID: "65d760f2-7d85-4a76-a50e-3aece410fec5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:12:36.070524 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.070511    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-home\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:12:36.070585 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.070530    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-tmp-dir\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:12:36.070585 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.070546    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-model-cache\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:12:36.072178 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.072160    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65d760f2-7d85-4a76-a50e-3aece410fec5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "65d760f2-7d85-4a76-a50e-3aece410fec5" (UID: "65d760f2-7d85-4a76-a50e-3aece410fec5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:12:36.072476 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.072452    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-dshm" (OuterVolumeSpecName: "dshm") pod "65d760f2-7d85-4a76-a50e-3aece410fec5" (UID: "65d760f2-7d85-4a76-a50e-3aece410fec5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:12:36.072543 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.072454    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65d760f2-7d85-4a76-a50e-3aece410fec5-kube-api-access-mw9hj" (OuterVolumeSpecName: "kube-api-access-mw9hj") pod "65d760f2-7d85-4a76-a50e-3aece410fec5" (UID: "65d760f2-7d85-4a76-a50e-3aece410fec5"). InnerVolumeSpecName "kube-api-access-mw9hj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:12:36.172001 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.171967    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw9hj\" (UniqueName: \"kubernetes.io/projected/65d760f2-7d85-4a76-a50e-3aece410fec5-kube-api-access-mw9hj\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:12:36.172001 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.171994    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65d760f2-7d85-4a76-a50e-3aece410fec5-dshm\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:12:36.172001 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.172003    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65d760f2-7d85-4a76-a50e-3aece410fec5-tls-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:12:36.299661 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.299583    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="567e97e3-2edb-49a3-8262-5fea98c51bf0" path="/var/lib/kubelet/pods/567e97e3-2edb-49a3-8262-5fea98c51bf0/volumes"
Jul 02 21:12:36.517134 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.517104    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 21:12:36.526724 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.526701    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 21:12:36.879932 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.879853    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"
Jul 02 21:12:36.880353 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.879852    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7" event={"ID":"65d760f2-7d85-4a76-a50e-3aece410fec5","Type":"ContainerDied","Data":"33d73987ec3f28e027e75f4b16accd56f5f6c4ceb21b02685b481d5d3a74fa5e"}
Jul 02 21:12:36.880353 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.879971    2565 scope.go:117] "RemoveContainer" containerID="d83dbb8dcb2c32edd15f7ab50d028acf6a34ef40651e2d2743f2224d984fdf5f"
Jul 02 21:12:36.896918 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.896893    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"]
Jul 02 21:12:36.901896 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:36.901876    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b780eb/rate-test-model-b780eb-kserve-7b4b54f59f-ltpv7"]
Jul 02 21:12:38.299390 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:12:38.299357    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65d760f2-7d85-4a76-a50e-3aece410fec5" path="/var/lib/kubelet/pods/65d760f2-7d85-4a76-a50e-3aece410fec5/volumes"
Jul 02 21:13:04.048297 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:04.048201    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:13:04.301809 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:04.301670    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"]
Jul 02 21:13:04.302020 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:04.301936    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx" podUID="93d54b7e-0e07-4171-9126-b6d3d0ba5a66" containerName="istio-proxy" containerID="cri-o://170429ff98a593c30bf0e5fd0c2345f2fb4858487a03c8475f6f2540f0eee38f" gracePeriod=30
Jul 02 21:13:04.326293 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:04.326262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:13:04.561007 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:04.560920    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:13:04.745042 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:04.745004    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:13:05.153376 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:05.153341    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:13:05.254714 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:05.254671    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:13:05.395522 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:05.395464    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:13:09.557377 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.557354    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:13:09.675635 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.675605    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-credential-socket\") pod \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") "
Jul 02 21:13:09.675862 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.675648    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-podinfo\") pod \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") "
Jul 02 21:13:09.675862 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.675677    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-workload-socket\") pod \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") "
Jul 02 21:13:09.675862 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.675697    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-token\") pod \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") "
Jul 02 21:13:09.675862 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.675821    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-data\") pod \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") "
Jul 02 21:13:09.676082 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.675888    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-envoy\") pod \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") "
Jul 02 21:13:09.676082 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.675924    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4x9p\" (UniqueName: \"kubernetes.io/projected/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-kube-api-access-k4x9p\") pod \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") "
Jul 02 21:13:09.676082 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.675941    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "93d54b7e-0e07-4171-9126-b6d3d0ba5a66" (UID: "93d54b7e-0e07-4171-9126-b6d3d0ba5a66"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:13:09.676082 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.675974    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-workload-certs\") pod \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") "
Jul 02 21:13:09.676082 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.676025    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "93d54b7e-0e07-4171-9126-b6d3d0ba5a66" (UID: "93d54b7e-0e07-4171-9126-b6d3d0ba5a66"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:13:09.676082 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.676038    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istiod-ca-cert\") pod \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\" (UID: \"93d54b7e-0e07-4171-9126-b6d3d0ba5a66\") "
Jul 02 21:13:09.676410 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.676269    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "93d54b7e-0e07-4171-9126-b6d3d0ba5a66" (UID: "93d54b7e-0e07-4171-9126-b6d3d0ba5a66"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:13:09.676410 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.676394    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-credential-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:09.676526 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.676414    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-workload-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:09.676526 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.676429    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-workload-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:09.676669 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.676632    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "93d54b7e-0e07-4171-9126-b6d3d0ba5a66" (UID: "93d54b7e-0e07-4171-9126-b6d3d0ba5a66"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:13:09.676830 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.676799    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-data" (OuterVolumeSpecName: "istio-data") pod "93d54b7e-0e07-4171-9126-b6d3d0ba5a66" (UID: "93d54b7e-0e07-4171-9126-b6d3d0ba5a66"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:13:09.678026 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.678005    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "93d54b7e-0e07-4171-9126-b6d3d0ba5a66" (UID: "93d54b7e-0e07-4171-9126-b6d3d0ba5a66"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 21:13:09.678109 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.678051    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-token" (OuterVolumeSpecName: "istio-token") pod "93d54b7e-0e07-4171-9126-b6d3d0ba5a66" (UID: "93d54b7e-0e07-4171-9126-b6d3d0ba5a66"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:13:09.678425 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.678408    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "93d54b7e-0e07-4171-9126-b6d3d0ba5a66" (UID: "93d54b7e-0e07-4171-9126-b6d3d0ba5a66"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:13:09.678484 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.678429    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-kube-api-access-k4x9p" (OuterVolumeSpecName: "kube-api-access-k4x9p") pod "93d54b7e-0e07-4171-9126-b6d3d0ba5a66" (UID: "93d54b7e-0e07-4171-9126-b6d3d0ba5a66"). InnerVolumeSpecName "kube-api-access-k4x9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:13:09.777224 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.777186    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-podinfo\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:09.777224 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.777218    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-token\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:09.777224 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.777228    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-data\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:09.777453 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.777239    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istio-envoy\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:09.777453 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.777247    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4x9p\" (UniqueName: \"kubernetes.io/projected/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-kube-api-access-k4x9p\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:09.777453 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:09.777256    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93d54b7e-0e07-4171-9126-b6d3d0ba5a66-istiod-ca-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:10.053459 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:10.053365    2565 generic.go:356] "Generic (PLEG): container finished" podID="93d54b7e-0e07-4171-9126-b6d3d0ba5a66" containerID="170429ff98a593c30bf0e5fd0c2345f2fb4858487a03c8475f6f2540f0eee38f" exitCode=0
Jul 02 21:13:10.053459 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:10.053412    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"
Jul 02 21:13:10.053459 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:10.053440    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx" event={"ID":"93d54b7e-0e07-4171-9126-b6d3d0ba5a66","Type":"ContainerDied","Data":"170429ff98a593c30bf0e5fd0c2345f2fb4858487a03c8475f6f2540f0eee38f"}
Jul 02 21:13:10.053724 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:10.053490    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx" event={"ID":"93d54b7e-0e07-4171-9126-b6d3d0ba5a66","Type":"ContainerDied","Data":"c300784f3937a741a7845b136f5c1c328eed00ab3561613ee703d753c936a897"}
Jul 02 21:13:10.053724 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:10.053512    2565 scope.go:117] "RemoveContainer" containerID="170429ff98a593c30bf0e5fd0c2345f2fb4858487a03c8475f6f2540f0eee38f"
Jul 02 21:13:10.066536 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:10.066512    2565 scope.go:117] "RemoveContainer" containerID="8f73486e454de63ddb9637d724b56d88a460b27141b8f96bca97cb6cbacd9bc9"
Jul 02 21:13:10.075806 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:10.075786    2565 scope.go:117] "RemoveContainer" containerID="170429ff98a593c30bf0e5fd0c2345f2fb4858487a03c8475f6f2540f0eee38f"
Jul 02 21:13:10.076034 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:13:10.076018    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"170429ff98a593c30bf0e5fd0c2345f2fb4858487a03c8475f6f2540f0eee38f\": container with ID starting with 170429ff98a593c30bf0e5fd0c2345f2fb4858487a03c8475f6f2540f0eee38f not found: ID does not exist" containerID="170429ff98a593c30bf0e5fd0c2345f2fb4858487a03c8475f6f2540f0eee38f"
Jul 02 21:13:10.076075 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:10.076041    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"170429ff98a593c30bf0e5fd0c2345f2fb4858487a03c8475f6f2540f0eee38f"} err="failed to get container status \"170429ff98a593c30bf0e5fd0c2345f2fb4858487a03c8475f6f2540f0eee38f\": rpc error: code = NotFound desc = could not find container \"170429ff98a593c30bf0e5fd0c2345f2fb4858487a03c8475f6f2540f0eee38f\": container with ID starting with 170429ff98a593c30bf0e5fd0c2345f2fb4858487a03c8475f6f2540f0eee38f not found: ID does not exist"
Jul 02 21:13:10.076075 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:10.076056    2565 scope.go:117] "RemoveContainer" containerID="8f73486e454de63ddb9637d724b56d88a460b27141b8f96bca97cb6cbacd9bc9"
Jul 02 21:13:10.076318 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:13:10.076296    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f73486e454de63ddb9637d724b56d88a460b27141b8f96bca97cb6cbacd9bc9\": container with ID starting with 8f73486e454de63ddb9637d724b56d88a460b27141b8f96bca97cb6cbacd9bc9 not found: ID does not exist" containerID="8f73486e454de63ddb9637d724b56d88a460b27141b8f96bca97cb6cbacd9bc9"
Jul 02 21:13:10.076362 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:10.076324    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f73486e454de63ddb9637d724b56d88a460b27141b8f96bca97cb6cbacd9bc9"} err="failed to get container status \"8f73486e454de63ddb9637d724b56d88a460b27141b8f96bca97cb6cbacd9bc9\": rpc error: code = NotFound desc = could not find container \"8f73486e454de63ddb9637d724b56d88a460b27141b8f96bca97cb6cbacd9bc9\": container with ID starting with 8f73486e454de63ddb9637d724b56d88a460b27141b8f96bca97cb6cbacd9bc9 not found: ID does not exist"
Jul 02 21:13:10.083330 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:10.083299    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"]
Jul 02 21:13:10.086738 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:10.086715    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-ffa3c8-openshift-default-f68bc89c5-fgzlx"]
Jul 02 21:13:10.299030 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:10.298998    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93d54b7e-0e07-4171-9126-b6d3d0ba5a66" path="/var/lib/kubelet/pods/93d54b7e-0e07-4171-9126-b6d3d0ba5a66/volumes"
Jul 02 21:13:10.895617 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:10.895578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:13:11.032524 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:11.032489    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:13:11.183470 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:11.183385    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"]
Jul 02 21:13:11.183685 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:11.183649    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt" podUID="90287e85-c081-4c0c-bf60-2b44efd76603" containerName="istio-proxy" containerID="cri-o://5412ade647477ff56c1b010d5d043bed8f597811b70583f027551092df4cef20" gracePeriod=30
Jul 02 21:13:11.206896 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:11.206865    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:13:11.439167 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:11.439066    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:13:16.424234 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.424210    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:13:16.535242 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.535161    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-credential-socket\") pod \"90287e85-c081-4c0c-bf60-2b44efd76603\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") "
Jul 02 21:13:16.535242 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.535218    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90287e85-c081-4c0c-bf60-2b44efd76603-istio-podinfo\") pod \"90287e85-c081-4c0c-bf60-2b44efd76603\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") "
Jul 02 21:13:16.535436 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.535254    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-workload-socket\") pod \"90287e85-c081-4c0c-bf60-2b44efd76603\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") "
Jul 02 21:13:16.535436 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.535290    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90287e85-c081-4c0c-bf60-2b44efd76603-istiod-ca-cert\") pod \"90287e85-c081-4c0c-bf60-2b44efd76603\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") "
Jul 02 21:13:16.535436 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.535344    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-istio-envoy\") pod \"90287e85-c081-4c0c-bf60-2b44efd76603\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") "
Jul 02 21:13:16.535436 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.535362    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp5qz\" (UniqueName: \"kubernetes.io/projected/90287e85-c081-4c0c-bf60-2b44efd76603-kube-api-access-rp5qz\") pod \"90287e85-c081-4c0c-bf60-2b44efd76603\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") "
Jul 02 21:13:16.535436 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.535383    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-workload-certs\") pod \"90287e85-c081-4c0c-bf60-2b44efd76603\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") "
Jul 02 21:13:16.535436 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.535416    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-istio-data\") pod \"90287e85-c081-4c0c-bf60-2b44efd76603\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") "
Jul 02 21:13:16.535742 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.535447    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90287e85-c081-4c0c-bf60-2b44efd76603-istio-token\") pod \"90287e85-c081-4c0c-bf60-2b44efd76603\" (UID: \"90287e85-c081-4c0c-bf60-2b44efd76603\") "
Jul 02 21:13:16.535742 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.535462    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "90287e85-c081-4c0c-bf60-2b44efd76603" (UID: "90287e85-c081-4c0c-bf60-2b44efd76603"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:13:16.535742 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.535543    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "90287e85-c081-4c0c-bf60-2b44efd76603" (UID: "90287e85-c081-4c0c-bf60-2b44efd76603"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:13:16.535742 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.535704    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-credential-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:16.535742 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.535738    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-workload-socket\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:16.536047 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.535781    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "90287e85-c081-4c0c-bf60-2b44efd76603" (UID: "90287e85-c081-4c0c-bf60-2b44efd76603"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:13:16.536047 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.535880    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90287e85-c081-4c0c-bf60-2b44efd76603-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "90287e85-c081-4c0c-bf60-2b44efd76603" (UID: "90287e85-c081-4c0c-bf60-2b44efd76603"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:13:16.536356 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.536330    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-istio-data" (OuterVolumeSpecName: "istio-data") pod "90287e85-c081-4c0c-bf60-2b44efd76603" (UID: "90287e85-c081-4c0c-bf60-2b44efd76603"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:13:16.537605 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.537575    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90287e85-c081-4c0c-bf60-2b44efd76603-istio-token" (OuterVolumeSpecName: "istio-token") pod "90287e85-c081-4c0c-bf60-2b44efd76603" (UID: "90287e85-c081-4c0c-bf60-2b44efd76603"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:13:16.537727 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.537604    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90287e85-c081-4c0c-bf60-2b44efd76603-kube-api-access-rp5qz" (OuterVolumeSpecName: "kube-api-access-rp5qz") pod "90287e85-c081-4c0c-bf60-2b44efd76603" (UID: "90287e85-c081-4c0c-bf60-2b44efd76603"). InnerVolumeSpecName "kube-api-access-rp5qz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:13:16.537727 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.537614    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90287e85-c081-4c0c-bf60-2b44efd76603-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "90287e85-c081-4c0c-bf60-2b44efd76603" (UID: "90287e85-c081-4c0c-bf60-2b44efd76603"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 21:13:16.537727 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.537656    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "90287e85-c081-4c0c-bf60-2b44efd76603" (UID: "90287e85-c081-4c0c-bf60-2b44efd76603"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:13:16.636716 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.636695    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90287e85-c081-4c0c-bf60-2b44efd76603-istiod-ca-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:16.636716 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.636715    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-istio-envoy\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:16.636866 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.636724    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp5qz\" (UniqueName: \"kubernetes.io/projected/90287e85-c081-4c0c-bf60-2b44efd76603-kube-api-access-rp5qz\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:16.636866 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.636733    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-workload-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:16.636866 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.636741    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90287e85-c081-4c0c-bf60-2b44efd76603-istio-data\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:16.636866 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.636748    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90287e85-c081-4c0c-bf60-2b44efd76603-istio-token\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:16.636866 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:16.636773    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90287e85-c081-4c0c-bf60-2b44efd76603-istio-podinfo\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\""
Jul 02 21:13:17.093627 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:17.093589    2565 generic.go:356] "Generic (PLEG): container finished" podID="90287e85-c081-4c0c-bf60-2b44efd76603" containerID="5412ade647477ff56c1b010d5d043bed8f597811b70583f027551092df4cef20" exitCode=0
Jul 02 21:13:17.093854 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:17.093647    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"
Jul 02 21:13:17.093854 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:17.093670    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt" event={"ID":"90287e85-c081-4c0c-bf60-2b44efd76603","Type":"ContainerDied","Data":"5412ade647477ff56c1b010d5d043bed8f597811b70583f027551092df4cef20"}
Jul 02 21:13:17.093854 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:17.093724    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt" event={"ID":"90287e85-c081-4c0c-bf60-2b44efd76603","Type":"ContainerDied","Data":"7ed72319935a73482de467b91156d8427fdcf61d091cefee9b63fc6e2479aaef"}
Jul 02 21:13:17.093854 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:17.093746    2565 scope.go:117] "RemoveContainer" containerID="5412ade647477ff56c1b010d5d043bed8f597811b70583f027551092df4cef20"
Jul 02 21:13:17.103006 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:17.102989    2565 scope.go:117] "RemoveContainer" containerID="db057b9ea97ca42a5aeede775b265e6fe8345827aab816892addce65bd0e3391"
Jul 02 21:13:17.111236 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:17.111219    2565 scope.go:117] "RemoveContainer" containerID="5412ade647477ff56c1b010d5d043bed8f597811b70583f027551092df4cef20"
Jul 02 21:13:17.111488 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:13:17.111469    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5412ade647477ff56c1b010d5d043bed8f597811b70583f027551092df4cef20\": container with ID starting with 5412ade647477ff56c1b010d5d043bed8f597811b70583f027551092df4cef20 not found: ID does not exist" containerID="5412ade647477ff56c1b010d5d043bed8f597811b70583f027551092df4cef20"
Jul 02 21:13:17.111539 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:17.111497    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5412ade647477ff56c1b010d5d043bed8f597811b70583f027551092df4cef20"} err="failed to get container status \"5412ade647477ff56c1b010d5d043bed8f597811b70583f027551092df4cef20\": rpc error: code = NotFound desc = could not find container \"5412ade647477ff56c1b010d5d043bed8f597811b70583f027551092df4cef20\": container with ID starting with 5412ade647477ff56c1b010d5d043bed8f597811b70583f027551092df4cef20 not found: ID does not exist"
Jul 02 21:13:17.111539 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:17.111515    2565 scope.go:117] "RemoveContainer" containerID="db057b9ea97ca42a5aeede775b265e6fe8345827aab816892addce65bd0e3391"
Jul 02 21:13:17.111783 ip-10-0-133-123 kubenswrapper[2565]: E0702 21:13:17.111742    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db057b9ea97ca42a5aeede775b265e6fe8345827aab816892addce65bd0e3391\": container with ID starting with db057b9ea97ca42a5aeede775b265e6fe8345827aab816892addce65bd0e3391 not found: ID does not exist" containerID="db057b9ea97ca42a5aeede775b265e6fe8345827aab816892addce65bd0e3391"
Jul 02 21:13:17.111865 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:17.111785    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db057b9ea97ca42a5aeede775b265e6fe8345827aab816892addce65bd0e3391"} err="failed to get container status \"db057b9ea97ca42a5aeede775b265e6fe8345827aab816892addce65bd0e3391\": rpc error: code = NotFound desc = could not find container \"db057b9ea97ca42a5aeede775b265e6fe8345827aab816892addce65bd0e3391\": container with ID starting with db057b9ea97ca42a5aeede775b265e6fe8345827aab816892addce65bd0e3391 not found: ID does not exist"
Jul 02 21:13:17.117191 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:17.117169    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"]
Jul 02 21:13:17.121509 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:17.121489    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-b780eb-openshift-default-6ff4998bbc-5qtlt"]
Jul 02 21:13:17.176520 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:17.176502    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717100-p98rz_cf376f1e-dc1b-4a18-b019-5a2511b735b7/cleanup/0.log"
Jul 02 21:13:17.819947 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:17.819879    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-857d77d4-pdgzl_99198449-7006-4215-b8b6-1cb667ba2959/manager/0.log"
Jul 02 21:13:17.831408 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:17.831386    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-857d77d4-pdgzl_99198449-7006-4215-b8b6-1cb667ba2959/copy-manifests/0.log"
Jul 02 21:13:18.299126 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:18.299087    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90287e85-c081-4c0c-bf60-2b44efd76603" path="/var/lib/kubelet/pods/90287e85-c081-4c0c-bf60-2b44efd76603/volumes"
Jul 02 21:13:18.841348 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:18.841319    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j_cf33c63b-e711-422f-8c25-08ff8ca002d2/util/0.log"
Jul 02 21:13:18.847537 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:18.847505    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j_cf33c63b-e711-422f-8c25-08ff8ca002d2/pull/0.log"
Jul 02 21:13:18.853611 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:18.853590    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j_cf33c63b-e711-422f-8c25-08ff8ca002d2/extract/0.log"
Jul 02 21:13:18.962068 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:18.962041    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw_66ebd2f2-878f-4598-bb36-bebfb6094889/extract/0.log"
Jul 02 21:13:18.968470 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:18.968442    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw_66ebd2f2-878f-4598-bb36-bebfb6094889/util/0.log"
Jul 02 21:13:18.975085 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:18.975053    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw_66ebd2f2-878f-4598-bb36-bebfb6094889/pull/0.log"
Jul 02 21:13:19.095655 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:19.095585    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6_9f13b5f4-f92a-48a6-946b-c8ed8442a6ff/util/0.log"
Jul 02 21:13:19.102151 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:19.102125    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6_9f13b5f4-f92a-48a6-946b-c8ed8442a6ff/pull/0.log"
Jul 02 21:13:19.107933 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:19.107905    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6_9f13b5f4-f92a-48a6-946b-c8ed8442a6ff/extract/0.log"
Jul 02 21:13:19.223751 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:19.223724    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr_68cc7d19-a799-4719-bdb3-b6a3881bea59/pull/0.log"
Jul 02 21:13:19.230752 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:19.230729    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr_68cc7d19-a799-4719-bdb3-b6a3881bea59/extract/0.log"
Jul 02 21:13:19.237464 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:19.237446    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr_68cc7d19-a799-4719-bdb3-b6a3881bea59/util/0.log"
Jul 02 21:13:19.697351 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:19.697326    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-h5vc4_b60adaf4-a8ac-4dd9-8353-be9b53a23897/kuadrant-console-plugin/0.log"
Jul 02 21:13:20.791154 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:20.791125    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84bc744f59-5ffgk_3f31769c-99ca-426b-958d-587d879f68b7/kube-auth-proxy/0.log"
Jul 02 21:13:21.877946 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:21.877890    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-9tkj2_f51bb928-0241-4504-95f6-06af25015e75/main/0.log"
Jul 02 21:13:21.993699 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:21.993669    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-cd6jv_44934f5a-a23e-4953-ad5e-64fb834715d1/main/0.log"
Jul 02 21:13:22.248913 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:22.248801    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-lccnf_84a29309-b17e-40f3-9554-28a8495306f6/main/0.log"
Jul 02 21:13:22.358279 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:22.358251    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-nmb28_d16b38a4-36f4-4ac3-9652-b1a53a8e8b8a/main/0.log"
Jul 02 21:13:26.277362 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277330    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mt95b/must-gather-b9lsw"]
Jul 02 21:13:26.277733 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277668    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93d54b7e-0e07-4171-9126-b6d3d0ba5a66" containerName="istio-proxy"
Jul 02 21:13:26.277733 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277679    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="93d54b7e-0e07-4171-9126-b6d3d0ba5a66" containerName="istio-proxy"
Jul 02 21:13:26.277733 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277694    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90287e85-c081-4c0c-bf60-2b44efd76603" containerName="istio-proxy"
Jul 02 21:13:26.277733 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277700    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90287e85-c081-4c0c-bf60-2b44efd76603" containerName="istio-proxy"
Jul 02 21:13:26.277733 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277709    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93d54b7e-0e07-4171-9126-b6d3d0ba5a66" containerName="istio-proxy"
Jul 02 21:13:26.277733 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277715    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="93d54b7e-0e07-4171-9126-b6d3d0ba5a66" containerName="istio-proxy"
Jul 02 21:13:26.277733 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277728    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65d760f2-7d85-4a76-a50e-3aece410fec5" containerName="main"
Jul 02 21:13:26.277733 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277733    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="65d760f2-7d85-4a76-a50e-3aece410fec5" containerName="main"
Jul 02 21:13:26.278021 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277740    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90287e85-c081-4c0c-bf60-2b44efd76603" containerName="istio-proxy"
Jul 02 21:13:26.278021 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277746    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90287e85-c081-4c0c-bf60-2b44efd76603" containerName="istio-proxy"
Jul 02 21:13:26.278021 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277768    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="567e97e3-2edb-49a3-8262-5fea98c51bf0" containerName="main"
Jul 02 21:13:26.278021 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277774    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="567e97e3-2edb-49a3-8262-5fea98c51bf0" containerName="main"
Jul 02 21:13:26.278021 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277828    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="93d54b7e-0e07-4171-9126-b6d3d0ba5a66" containerName="istio-proxy"
Jul 02 21:13:26.278021 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277838    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="567e97e3-2edb-49a3-8262-5fea98c51bf0" containerName="main"
Jul 02 21:13:26.278021 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277844    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="93d54b7e-0e07-4171-9126-b6d3d0ba5a66" containerName="istio-proxy"
Jul 02 21:13:26.278021 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277852    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="90287e85-c081-4c0c-bf60-2b44efd76603" containerName="istio-proxy"
Jul 02 21:13:26.278021 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277858    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="90287e85-c081-4c0c-bf60-2b44efd76603" containerName="istio-proxy"
Jul 02 21:13:26.278021 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.277864    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="65d760f2-7d85-4a76-a50e-3aece410fec5" containerName="main"
Jul 02 21:13:26.280177 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.280148    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:13:26.282433 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.282414    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mt95b/must-gather-b9lsw"
Jul 02 21:13:26.285125 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.285108    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mt95b\"/\"kube-root-ca.crt\""
Jul 02 21:13:26.286143 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.286121    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mt95b\"/\"openshift-service-ca.crt\""
Jul 02 21:13:26.286273 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.286137    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mt95b\"/\"default-dockercfg-czfgl\""
Jul 02 21:13:26.289513 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.289492    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mt95b/must-gather-b9lsw"]
Jul 02 21:13:26.382162 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.382131    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log" limit=1024
Jul 02 21:13:26.425158 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.425128    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/84e3ec27-1c58-48d0-a3cd-1a5dbc112190-must-gather-output\") pod \"must-gather-b9lsw\" (UID: \"84e3ec27-1c58-48d0-a3cd-1a5dbc112190\") " pod="openshift-must-gather-mt95b/must-gather-b9lsw"
Jul 02 21:13:26.425292 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.425213    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngxjj\" (UniqueName: \"kubernetes.io/projected/84e3ec27-1c58-48d0-a3cd-1a5dbc112190-kube-api-access-ngxjj\") pod \"must-gather-b9lsw\" (UID: \"84e3ec27-1c58-48d0-a3cd-1a5dbc112190\") " pod="openshift-must-gather-mt95b/must-gather-b9lsw"
Jul 02 21:13:26.526048 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.526016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/84e3ec27-1c58-48d0-a3cd-1a5dbc112190-must-gather-output\") pod \"must-gather-b9lsw\" (UID: \"84e3ec27-1c58-48d0-a3cd-1a5dbc112190\") " pod="openshift-must-gather-mt95b/must-gather-b9lsw"
Jul 02 21:13:26.526226 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.526085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngxjj\" (UniqueName: \"kubernetes.io/projected/84e3ec27-1c58-48d0-a3cd-1a5dbc112190-kube-api-access-ngxjj\") pod \"must-gather-b9lsw\" (UID: \"84e3ec27-1c58-48d0-a3cd-1a5dbc112190\") " pod="openshift-must-gather-mt95b/must-gather-b9lsw"
Jul 02 21:13:26.526356 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.526337    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/84e3ec27-1c58-48d0-a3cd-1a5dbc112190-must-gather-output\") pod \"must-gather-b9lsw\" (UID: \"84e3ec27-1c58-48d0-a3cd-1a5dbc112190\") " pod="openshift-must-gather-mt95b/must-gather-b9lsw"
Jul 02 21:13:26.534728 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.534665    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngxjj\" (UniqueName: \"kubernetes.io/projected/84e3ec27-1c58-48d0-a3cd-1a5dbc112190-kube-api-access-ngxjj\") pod \"must-gather-b9lsw\" (UID: \"84e3ec27-1c58-48d0-a3cd-1a5dbc112190\") " pod="openshift-must-gather-mt95b/must-gather-b9lsw"
Jul 02 21:13:26.592818 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.592785    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mt95b/must-gather-b9lsw"
Jul 02 21:13:26.725999 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.723900    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mt95b/must-gather-b9lsw"]
Jul 02 21:13:26.729382 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:26.729349    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 21:13:27.149661 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:27.149618    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mt95b/must-gather-b9lsw" event={"ID":"84e3ec27-1c58-48d0-a3cd-1a5dbc112190","Type":"ContainerStarted","Data":"89a1e1a7a9031e51455cdac2025868a7ff3f99c341278453e6165aee15425d5d"}
Jul 02 21:13:28.160982 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:28.160940    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mt95b/must-gather-b9lsw" event={"ID":"84e3ec27-1c58-48d0-a3cd-1a5dbc112190","Type":"ContainerStarted","Data":"f5194ec73fb62a09d7f4ccf359fbd6bc9c0a1d064dae9eb296b69453641eb2cb"}
Jul 02 21:13:28.161373 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:28.160998    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mt95b/must-gather-b9lsw" event={"ID":"84e3ec27-1c58-48d0-a3cd-1a5dbc112190","Type":"ContainerStarted","Data":"342e8458934eb53110d642b1289ecde4f041501fad237e221e9fb5b217b24f04"}
Jul 02 21:13:28.178234 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:28.178181    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mt95b/must-gather-b9lsw" podStartSLOduration=1.121835276 podStartE2EDuration="2.178163748s" totalImagesPullingTime="1.056328472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:13:28.17502589 +0000 UTC m=+2452.298037458" watchObservedRunningTime="2026-07-02 21:13:28.178163748 +0000 UTC m=+2452.301175322"
Jul 02 21:13:29.342128 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:29.342098    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n5bj2_6d77247d-e7bf-42d1-9f3f-310fed10b354/global-pull-secret-syncer/0.log"
Jul 02 21:13:29.436702 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:29.436661    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8r9rr_58a9c44e-34ad-4112-a08b-48b27fcf339d/konnectivity-agent/0.log"
Jul 02 21:13:29.516961 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:29.516932    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-123.ec2.internal_74288498fb0c2498191bac60d7d7a2bd/haproxy/0.log"
Jul 02 21:13:34.377454 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:34.377425    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j_cf33c63b-e711-422f-8c25-08ff8ca002d2/extract/0.log"
Jul 02 21:13:34.397544 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:34.397520    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j_cf33c63b-e711-422f-8c25-08ff8ca002d2/util/0.log"
Jul 02 21:13:34.422510 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:34.422473    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759svc7j_cf33c63b-e711-422f-8c25-08ff8ca002d2/pull/0.log"
Jul 02 21:13:34.472928 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:34.472901    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw_66ebd2f2-878f-4598-bb36-bebfb6094889/extract/0.log"
Jul 02 21:13:34.493862 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:34.493832    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw_66ebd2f2-878f-4598-bb36-bebfb6094889/util/0.log"
Jul 02 21:13:34.515591 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:34.515567    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n2lbw_66ebd2f2-878f-4598-bb36-bebfb6094889/pull/0.log"
Jul 02 21:13:34.552186 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:34.551422    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6_9f13b5f4-f92a-48a6-946b-c8ed8442a6ff/extract/0.log"
Jul 02 21:13:34.572426 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:34.572278    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6_9f13b5f4-f92a-48a6-946b-c8ed8442a6ff/util/0.log"
Jul 02 21:13:34.592586 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:34.592551    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nfdk6_9f13b5f4-f92a-48a6-946b-c8ed8442a6ff/pull/0.log"
Jul 02 21:13:34.631004 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:34.630898    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr_68cc7d19-a799-4719-bdb3-b6a3881bea59/extract/0.log"
Jul 02 21:13:34.649666 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:34.649640    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr_68cc7d19-a799-4719-bdb3-b6a3881bea59/util/0.log"
Jul 02 21:13:34.677001 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:34.676967    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16zsdr_68cc7d19-a799-4719-bdb3-b6a3881bea59/pull/0.log"
Jul 02 21:13:35.002088 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:35.001986    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-h5vc4_b60adaf4-a8ac-4dd9-8353-be9b53a23897/kuadrant-console-plugin/0.log"
Jul 02 21:13:36.872342 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:36.872264    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_51b83f38-cd03-4e4e-8966-b8cd71e68e38/alertmanager/0.log"
Jul 02 21:13:36.896475 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:36.896437    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_51b83f38-cd03-4e4e-8966-b8cd71e68e38/config-reloader/0.log"
Jul 02 21:13:36.922126 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:36.922015    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_51b83f38-cd03-4e4e-8966-b8cd71e68e38/kube-rbac-proxy-web/0.log"
Jul 02 21:13:36.944251 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:36.944219    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_51b83f38-cd03-4e4e-8966-b8cd71e68e38/kube-rbac-proxy/0.log"
Jul 02 21:13:36.967191 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:36.967160    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_51b83f38-cd03-4e4e-8966-b8cd71e68e38/kube-rbac-proxy-metric/0.log"
Jul 02 21:13:36.989154 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:36.989123    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_51b83f38-cd03-4e4e-8966-b8cd71e68e38/prom-label-proxy/0.log"
Jul 02 21:13:37.012397 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:37.012374    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_51b83f38-cd03-4e4e-8966-b8cd71e68e38/init-config-reloader/0.log"
Jul 02 21:13:37.143566 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:37.143479    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7c7fccbd7c-8hfvh_e3407905-9d1f-48e3-b8f5-f962456bcbf3/metrics-server/0.log"
Jul 02 21:13:37.205047 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:37.205019    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2n4rx_0020b6e1-8347-4c48-ac8f-195e9c28784e/node-exporter/0.log"
Jul 02 21:13:37.228299 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:37.228272    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2n4rx_0020b6e1-8347-4c48-ac8f-195e9c28784e/kube-rbac-proxy/0.log"
Jul 02 21:13:37.252003 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:37.251962    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2n4rx_0020b6e1-8347-4c48-ac8f-195e9c28784e/init-textfile/0.log"
Jul 02 21:13:37.405219 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:37.405123    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ttbcz_f00184a1-06cf-48ee-8f8c-1aeafef5a7e7/kube-rbac-proxy-main/0.log"
Jul 02 21:13:37.429365 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:37.429332    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ttbcz_f00184a1-06cf-48ee-8f8c-1aeafef5a7e7/kube-rbac-proxy-self/0.log"
Jul 02 21:13:37.454624 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:37.454595    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ttbcz_f00184a1-06cf-48ee-8f8c-1aeafef5a7e7/openshift-state-metrics/0.log"
Jul 02 21:13:37.661310 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:37.661234    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-fl5dr_6b742864-dee4-40ef-a7a1-6f65a41d16ff/prometheus-operator/0.log"
Jul 02 21:13:37.683047 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:37.683013    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-fl5dr_6b742864-dee4-40ef-a7a1-6f65a41d16ff/kube-rbac-proxy/0.log"
Jul 02 21:13:37.725061 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:37.725023    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-hvdgn_f5bab5f6-8643-4700-a643-2e895c0ea899/prometheus-operator-admission-webhook/0.log"
Jul 02 21:13:37.785181 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:37.785146    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-567fbf45cd-rmth6_f93126da-ce01-442c-bfc3-bb2e943622a5/telemeter-client/0.log"
Jul 02 21:13:37.826060 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:37.826023    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-567fbf45cd-rmth6_f93126da-ce01-442c-bfc3-bb2e943622a5/reload/0.log"
Jul 02 21:13:37.868000 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:37.867967    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-567fbf45cd-rmth6_f93126da-ce01-442c-bfc3-bb2e943622a5/kube-rbac-proxy/0.log"
Jul 02 21:13:39.439810 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.439774    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"]
Jul 02 21:13:39.447862 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.447832    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.452333 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.452305    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"]
Jul 02 21:13:39.560271 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.560226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c91d5a1d-33bc-4f37-8604-adcb491ac18f-lib-modules\") pod \"perf-node-gather-daemonset-fr2gk\" (UID: \"c91d5a1d-33bc-4f37-8604-adcb491ac18f\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.560464 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.560389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c91d5a1d-33bc-4f37-8604-adcb491ac18f-sys\") pod \"perf-node-gather-daemonset-fr2gk\" (UID: \"c91d5a1d-33bc-4f37-8604-adcb491ac18f\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.560464 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.560419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c91d5a1d-33bc-4f37-8604-adcb491ac18f-proc\") pod \"perf-node-gather-daemonset-fr2gk\" (UID: \"c91d5a1d-33bc-4f37-8604-adcb491ac18f\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.560588 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.560541    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j94qs\" (UniqueName: \"kubernetes.io/projected/c91d5a1d-33bc-4f37-8604-adcb491ac18f-kube-api-access-j94qs\") pod \"perf-node-gather-daemonset-fr2gk\" (UID: \"c91d5a1d-33bc-4f37-8604-adcb491ac18f\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.560588 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.560571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c91d5a1d-33bc-4f37-8604-adcb491ac18f-podres\") pod \"perf-node-gather-daemonset-fr2gk\" (UID: \"c91d5a1d-33bc-4f37-8604-adcb491ac18f\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.661996 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.661959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j94qs\" (UniqueName: \"kubernetes.io/projected/c91d5a1d-33bc-4f37-8604-adcb491ac18f-kube-api-access-j94qs\") pod \"perf-node-gather-daemonset-fr2gk\" (UID: \"c91d5a1d-33bc-4f37-8604-adcb491ac18f\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.662253 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.662229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c91d5a1d-33bc-4f37-8604-adcb491ac18f-podres\") pod \"perf-node-gather-daemonset-fr2gk\" (UID: \"c91d5a1d-33bc-4f37-8604-adcb491ac18f\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.662422 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.662391    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c91d5a1d-33bc-4f37-8604-adcb491ac18f-podres\") pod \"perf-node-gather-daemonset-fr2gk\" (UID: \"c91d5a1d-33bc-4f37-8604-adcb491ac18f\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.662516 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.662414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c91d5a1d-33bc-4f37-8604-adcb491ac18f-lib-modules\") pod \"perf-node-gather-daemonset-fr2gk\" (UID: \"c91d5a1d-33bc-4f37-8604-adcb491ac18f\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.662625 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.662603    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c91d5a1d-33bc-4f37-8604-adcb491ac18f-lib-modules\") pod \"perf-node-gather-daemonset-fr2gk\" (UID: \"c91d5a1d-33bc-4f37-8604-adcb491ac18f\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.662831 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.662811    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c91d5a1d-33bc-4f37-8604-adcb491ac18f-sys\") pod \"perf-node-gather-daemonset-fr2gk\" (UID: \"c91d5a1d-33bc-4f37-8604-adcb491ac18f\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.662954 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.662939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c91d5a1d-33bc-4f37-8604-adcb491ac18f-proc\") pod \"perf-node-gather-daemonset-fr2gk\" (UID: \"c91d5a1d-33bc-4f37-8604-adcb491ac18f\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.663137 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.663120    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c91d5a1d-33bc-4f37-8604-adcb491ac18f-proc\") pod \"perf-node-gather-daemonset-fr2gk\" (UID: \"c91d5a1d-33bc-4f37-8604-adcb491ac18f\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.663287 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.663271    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c91d5a1d-33bc-4f37-8604-adcb491ac18f-sys\") pod \"perf-node-gather-daemonset-fr2gk\" (UID: \"c91d5a1d-33bc-4f37-8604-adcb491ac18f\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.670329 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.670305    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j94qs\" (UniqueName: \"kubernetes.io/projected/c91d5a1d-33bc-4f37-8604-adcb491ac18f-kube-api-access-j94qs\") pod \"perf-node-gather-daemonset-fr2gk\" (UID: \"c91d5a1d-33bc-4f37-8604-adcb491ac18f\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.765209 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.765123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:39.770358 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.770321    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/1.log"
Jul 02 21:13:39.779383 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.779356    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-424b9_f72c892a-6de0-401e-9db4-aa036b2a4164/console-operator/2.log"
Jul 02 21:13:39.945958 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:39.945924    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"]
Jul 02 21:13:39.949099 ip-10-0-133-123 kubenswrapper[2565]: W0702 21:13:39.949068    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc91d5a1d_33bc_4f37_8604_adcb491ac18f.slice/crio-f6b03b4eb77da74796a76f5f936b67d09b233e0bb1c682eb4aac752c84c40aa9 WatchSource:0}: Error finding container f6b03b4eb77da74796a76f5f936b67d09b233e0bb1c682eb4aac752c84c40aa9: Status 404 returned error can't find the container with id f6b03b4eb77da74796a76f5f936b67d09b233e0bb1c682eb4aac752c84c40aa9
Jul 02 21:13:40.240568 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:40.240487    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f9f59fbcb-k6ll8_699c5a18-73b8-41fb-a41a-12835bfed798/console/0.log"
Jul 02 21:13:40.258780 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:40.258721    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk" event={"ID":"c91d5a1d-33bc-4f37-8604-adcb491ac18f","Type":"ContainerStarted","Data":"c404b96c8e25c5c743b8f270d56ac1ec1df0937a76291e233e99a8d95dc6f461"}
Jul 02 21:13:40.258949 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:40.258814    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:40.258949 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:40.258842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk" event={"ID":"c91d5a1d-33bc-4f37-8604-adcb491ac18f","Type":"ContainerStarted","Data":"f6b03b4eb77da74796a76f5f936b67d09b233e0bb1c682eb4aac752c84c40aa9"}
Jul 02 21:13:40.277172 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:40.277124    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk" podStartSLOduration=1.277108701 podStartE2EDuration="1.277108701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:13:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:13:40.276162608 +0000 UTC m=+2464.399174183" watchObservedRunningTime="2026-07-02 21:13:40.277108701 +0000 UTC m=+2464.400120271"
Jul 02 21:13:41.780249 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:41.780217    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-glq7r_d85f6511-daa2-4d28-a33d-d9e1b2efc9de/dns/0.log"
Jul 02 21:13:41.801349 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:41.801319    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-glq7r_d85f6511-daa2-4d28-a33d-d9e1b2efc9de/kube-rbac-proxy/0.log"
Jul 02 21:13:41.941442 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:41.941410    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m5mhl_1f6346a1-13f2-49ba-9b76-1fb229b002d3/dns-node-resolver/0.log"
Jul 02 21:13:42.534597 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:42.534565    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x26xq_3eee63fc-ae15-428d-8a57-390c573de403/node-ca/0.log"
Jul 02 21:13:43.554444 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:43.554415    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84bc744f59-5ffgk_3f31769c-99ca-426b-958d-587d879f68b7/kube-auth-proxy/0.log"
Jul 02 21:13:44.403932 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:44.403897    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nbfbm_a523904c-ccf1-4bb8-9dd8-9be32d8492da/serve-healthcheck-canary/0.log"
Jul 02 21:13:44.944789 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:44.944739    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jkczh_8975be29-803c-4f6d-a631-c7b09c812664/kube-rbac-proxy/0.log"
Jul 02 21:13:44.963134 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:44.963108    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jkczh_8975be29-803c-4f6d-a631-c7b09c812664/exporter/0.log"
Jul 02 21:13:44.986346 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:44.986316    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jkczh_8975be29-803c-4f6d-a631-c7b09c812664/extractor/0.log"
Jul 02 21:13:46.276995 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:46.276966    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-fr2gk"
Jul 02 21:13:47.323844 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:47.323788    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717100-p98rz_cf376f1e-dc1b-4a18-b019-5a2511b735b7/cleanup/0.log"
Jul 02 21:13:47.653159 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:47.653121    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-857d77d4-pdgzl_99198449-7006-4215-b8b6-1cb667ba2959/manager/0.log"
Jul 02 21:13:47.668374 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:47.668343    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-857d77d4-pdgzl_99198449-7006-4215-b8b6-1cb667ba2959/copy-manifests/0.log"
Jul 02 21:13:49.177957 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:49.177921    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d6cb4dc5f-959ng_86898a14-16d6-43f1-a729-119782f64690/manager/0.log"
Jul 02 21:13:49.726575 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:49.726538    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84bc744f59-5ffgk_3f31769c-99ca-426b-958d-587d879f68b7/kube-auth-proxy/0.log"
Jul 02 21:13:51.106582 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:51.106549    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84bc744f59-5ffgk_3f31769c-99ca-426b-958d-587d879f68b7/kube-auth-proxy/0.log"
Jul 02 21:13:55.776210 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:55.776181    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zf9bn_1419c726-721f-4fd9-bfb9-7043d578cf0c/kube-multus-additional-cni-plugins/0.log"
Jul 02 21:13:55.794069 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:55.794044    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zf9bn_1419c726-721f-4fd9-bfb9-7043d578cf0c/egress-router-binary-copy/0.log"
Jul 02 21:13:55.812879 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:55.812858    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zf9bn_1419c726-721f-4fd9-bfb9-7043d578cf0c/cni-plugins/0.log"
Jul 02 21:13:55.830476 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:55.830451    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zf9bn_1419c726-721f-4fd9-bfb9-7043d578cf0c/bond-cni-plugin/0.log"
Jul 02 21:13:55.848701 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:55.848673    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zf9bn_1419c726-721f-4fd9-bfb9-7043d578cf0c/routeoverride-cni/0.log"
Jul 02 21:13:55.867439 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:55.867416    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zf9bn_1419c726-721f-4fd9-bfb9-7043d578cf0c/whereabouts-cni-bincopy/0.log"
Jul 02 21:13:55.885929 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:55.885906    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zf9bn_1419c726-721f-4fd9-bfb9-7043d578cf0c/whereabouts-cni/0.log"
Jul 02 21:13:55.929240 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:55.929209    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k8rtk_e0d5f826-a176-4167-b921-e05de73d1825/kube-multus/0.log"
Jul 02 21:13:56.086652 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:56.086565    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-swrg9_888788da-c29d-4687-a880-bcbbd7bfa01f/network-metrics-daemon/0.log"
Jul 02 21:13:56.100435 ip-10-0-133-123 kubenswrapper[2565]: I0702 21:13:56.100411    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-swrg9_888788da-c29d-4687-a880-bcbbd7bfa01f/kube-rbac-proxy/0.log"